-- Logs begin at Tue 2021-09-14 18:39:22 UTC, end at Tue 2021-09-14 20:28:01 UTC. -- Sep 14 19:32:52.880691 dv-cinder-805887-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 19:32:52.889947 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 14 19:32:52 2021] *** Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: nodename: dv-cinder-805887-12-iscsi Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: machine: x86_64 Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: clock source: unix Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: pcre jit disabled Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: detected number of CPU cores: 4 Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: current working directory: / Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: detected binary path: /usr/bin/uwsgi-core Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: your processes number limit is 47680 Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: your memory page size is 4096 bytes Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: detected max file descriptor number: 2048 Sep 14 19:32:52.891841 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: lock engine: pthread robust mutexes Sep 14 19:32:52.893602 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: thunder lock: enabled Sep 14 19:32:52.893602 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 19:32:52.893602 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 14 19:32:52.938582 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: Python main interpreter initialized at 0x56299cba59c0 Sep 14 19:32:52.938582 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: python threads support enabled Sep 14 19:32:52.938582 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: your server socket listen backlog is limited to 100 connections Sep 14 19:32:52.938582 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: your mercy for graceful operations on workers is 90 seconds Sep 14 19:32:52.939100 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 19:32:52.939100 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: *** Operational MODE: preforking *** Sep 14 19:32:52.939303 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: *** uWSGI is running in multiple interpreter mode *** Sep 14 19:32:52.939303 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: spawned uWSGI master process (pid: 100667) Sep 14 19:32:52.939525 dv-cinder-805887-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 14 19:32:52.940156 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: spawned uWSGI worker 1 (pid: 100668, cores: 1) Sep 14 19:32:52.940492 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: spawned uWSGI worker 2 (pid: 100669, cores: 1) Sep 14 19:32:52.940632 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 19:32:54.607737 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:32:54.607737 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: from cryptography.utils import int_from_bytes Sep 14 19:32:54.608492 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:32:54.608492 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: from cryptography.utils import int_from_bytes Sep 14 19:32:54.616982 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:32:54.616982 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: from cryptography.utils import int_from_bytes Sep 14 19:32:54.617686 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:32:54.617686 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: from cryptography.utils import int_from_bytes Sep 14 19:32:57.326635 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 19:32:57.327191 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 19:32:57.327355 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 19:32:57.327728 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 19:32:57.327986 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 19:32:57.328289 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 19:32:57.328694 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.328799 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 19:32:57.328882 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.329007 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.329295 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 19:32:57.329391 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.329675 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.329878 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 19:32:57.329998 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.330228 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 19:32:57.330316 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.330615 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.330762 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.330949 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.331208 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.331303 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.331527 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.331706 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.331856 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-805887-12-iscsi {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.332185 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.332288 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.332499 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.332616 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.332806 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.332930 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.333126 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.333254 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.333445 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.333629 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.333789 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.333921 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.334099 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.334217 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.334485 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.334640 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.334809 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-805887-12-iscsi {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.335604 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.335709 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.335917 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.336010 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.336353 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.336641 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.336641 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.336872 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.336961 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.337051 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.337136 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.337219 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.337486 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.337614 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.337822 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.338202 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.338321 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.338617 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.338791 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.339095 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-805887-12-iscsi {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.339258 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.339438 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.339737 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.339890 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.340243 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.340333 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.340683 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.340803 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.341116 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.341226 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.341558 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.341716 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.341888 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.342080 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.342226 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.342600 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.342693 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.342942 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.343027 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.343343 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.343439 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-805887-12-iscsi {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.343662 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.343753 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.343978 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.344071 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.344296 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.344381 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.344659 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.344768 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.345017 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.345107 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.345330 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.345421 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.345675 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.345782 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.345997 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.346087 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.346250 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.346345 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.346633 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.346837 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.346932 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.347018 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.347196 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.347430 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.347515 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.347760 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.347874 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.348016 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.348326 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.348411 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.348648 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.348807 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.348959 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.349273 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.349363 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.349608 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.349846 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.349941 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.350216 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.350307 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.350635 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.351289 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.351450 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.351678 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.351788 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.352070 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.352192 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.352391 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.352669 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.352772 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.353007 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.353104 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.353325 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.353430 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.353609 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.353755 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.353858 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.354007 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.354174 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.354319 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.354502 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.354662 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.354818 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.354984 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.355130 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.355295 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.355441 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.355618 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.355741 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.355942 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.356113 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.356254 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.356351 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.356562 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.356653 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.356961 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.357072 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.357195 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.357292 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.357537 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.357626 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.357848 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.357972 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.358104 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.358190 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.358410 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.358505 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.358721 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.358881 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.359039 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.359123 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.359349 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.359434 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.359659 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.359755 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.359967 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.360051 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.360269 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.360354 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.360578 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.360664 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.360889 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.360973 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.361196 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.361292 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.361539 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.361649 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.361838 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.361930 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.362146 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.362244 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.362474 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.362559 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.362784 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.362868 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.363036 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.363132 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.363341 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.363440 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.363651 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.363745 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.363972 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.364071 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.364283 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.364369 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.364588 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.364681 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.364896 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.365001 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.365197 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.365294 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.365520 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.365609 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.365832 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.365936 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.366205 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.366304 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.366475 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.366567 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.366786 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.366932 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.367094 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.367186 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.367402 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.367493 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.367706 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.367791 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.368012 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.368102 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.368316 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.368400 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.368626 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.368718 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.369023 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.369122 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.369248 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.369456 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.369585 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.369666 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.369875 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.369971 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.370178 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.370268 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.370484 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.370570 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.370789 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.370875 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.371093 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.371178 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.371469 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.371753 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.371843 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.371920 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.372003 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.372081 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.372300 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.372385 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.372676 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.372774 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.372913 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.373011 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.373227 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.373314 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.373544 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.373908 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.374133 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.374230 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.374310 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.374386 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.374661 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.374831 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.374967 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.375172 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.375264 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.375348 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.375428 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.375504 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.375663 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.375813 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.375898 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.376130 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.376218 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.376447 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.376541 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.376762 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.376846 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.377075 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.377174 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.377379 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.377476 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.377715 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.377809 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.378023 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.378108 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.378343 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:32:57.378444 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.378681 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.378766 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.379020 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.379112 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.379335 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.379427 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.379656 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.379741 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.379969 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.380056 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.380290 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.380375 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.380611 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.380701 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.380925 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.381010 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.381237 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.381334 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.381589 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.381689 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.382437 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.382527 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.382752 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.382838 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.383065 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.383149 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.383386 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.383471 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.383708 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.383793 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.384025 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.384108 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.384344 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.384428 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.384660 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.384745 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.384982 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.385074 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.385296 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.385389 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.385636 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.385733 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.385965 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.386093 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.386290 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.386384 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.386603 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.386687 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.386909 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.386992 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.387222 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.387322 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.387533 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.387625 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.387845 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.387937 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.388153 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.388254 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.388479 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.388565 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.388796 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.388881 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.389112 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.389198 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.389433 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.389571 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.389773 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.389859 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.390086 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.390170 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.390396 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.390480 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.390705 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.390791 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.391021 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.391107 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.391335 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.391420 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.391641 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.391731 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.391951 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.392047 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.392260 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.392352 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.392566 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.392649 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.392870 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.392956 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.393188 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.393272 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.393518 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.393632 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.393830 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.393929 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.394142 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.394335 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.394457 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.394554 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.394766 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.394851 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.395080 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.395165 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.395392 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.395511 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.395698 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.395791 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.396006 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.396098 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.396313 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.396403 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.396637 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.396729 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.396946 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.397039 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.397254 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.397348 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.398180 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.398281 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.398490 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.398586 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.398796 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.398883 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.399112 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.399197 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.399428 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.399525 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.399742 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.399828 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.400058 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.400149 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.400368 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.400454 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.400679 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.400763 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.400985 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.401069 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.401291 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.401388 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.401622 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.401713 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.401951 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.402087 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.402266 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.402369 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.402553 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.402651 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.402858 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.402950 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.403163 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.403257 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.403490 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.403575 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.403797 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.403888 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.404103 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.404200 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.404408 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.404500 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.404742 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.404840 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.405019 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.405112 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.405325 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.405419 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.405654 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.405753 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.405963 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.406053 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.406267 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.406352 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.406589 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.406684 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.406899 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.406986 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.407201 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.407293 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.407519 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.407626 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.407808 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.407895 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.408148 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.408234 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.408457 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.408550 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.408791 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.408875 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.409117 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.409209 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.409427 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.409558 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.409778 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.409871 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.410091 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.410177 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.410410 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.410504 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.410724 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.410813 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.411039 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.411171 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.411355 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.411449 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.411668 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.411752 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.411982 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.412073 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.412295 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.412430 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.412604 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.412746 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.412915 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.413068 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.413268 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.413409 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.413605 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.413826 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.413977 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.414113 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.414259 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.414400 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.414533 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.414684 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.414819 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.414951 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.415143 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.415273 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.415451 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.415540 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.415768 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.415860 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.416087 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.416172 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.416404 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.416489 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.416715 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.416812 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.417281 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.417378 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.417622 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.417712 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.417935 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.418030 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.418245 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.418329 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.418556 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.418646 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.418866 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.418959 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.419174 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.419259 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.419485 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.419580 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.420289 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.420402 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.420485 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.420562 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.420638 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.421010 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.421010 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.421489 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.421747 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.422119 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.422348 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.422591 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.422790 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.422875 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.423113 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.423420 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.423729 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.424097 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.424199 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.424280 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.424447 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.424530 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.424615 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.424688 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.424780 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.424859 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.424942 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425019 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425095 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425180 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425258 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425342 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425416 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425488 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425583 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425661 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425736 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425805 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425881 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.425963 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.426045 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.426135 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.426220 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.426297 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.426463 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.426606 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.426779 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.426874 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.427099 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.427183 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.427411 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.427504 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.427728 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.427902 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.428039 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.428170 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.428337 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.428467 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.428661 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.428808 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.428989 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.429120 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.429302 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.429439 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.429632 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.429769 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.429932 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.430062 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.430242 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.430371 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.430554 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.430705 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.430881 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.431015 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.431184 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.431297 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.431501 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.431632 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.431822 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.431956 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.432132 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.432271 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.432444 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.432531 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.432753 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.432836 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.433063 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.433337 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.433423 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.433714 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.433810 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.434023 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.434122 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.434336 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.434430 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.434650 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.434736 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.434963 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.435058 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.435276 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.435361 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.435599 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.435683 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.435911 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.436073 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.436220 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.436305 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.436532 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.436654 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.436838 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.436932 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.437147 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.437231 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.437460 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.437583 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.437793 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.438055 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.438143 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.438391 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.438483 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.438702 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.438799 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.439014 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.439099 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.439321 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.439413 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.439638 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.439731 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.439945 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.440039 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.440264 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.440351 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.440573 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.440657 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.440883 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.440968 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.441188 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.441273 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.441515 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.441602 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.441822 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.441908 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.442127 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.442211 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.442434 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.442521 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.442742 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.442829 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.443048 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.443133 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.443361 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.443446 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.443668 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.443761 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.443974 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.444058 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.444802 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.444908 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.445112 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.445211 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.445431 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.445538 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.445764 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.445911 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.446079 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.446217 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.446385 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.446516 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.446711 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.446841 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.447022 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.447159 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.447328 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.447469 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.447632 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.447783 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.447996 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.448136 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.448272 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.448402 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.448659 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.453795 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.454005 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.454145 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.454145 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.454406 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.454564 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.454710 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.454853 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.454991 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.455121 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.455250 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.455385 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.455527 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.455660 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.455749 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.455815 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.456012 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.456147 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.456296 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.456427 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.456556 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.456684 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.456818 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.456960 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.457058 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.457139 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.457215 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.457366 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.457570 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.457672 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.457761 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.457839 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.457939 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458033 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458113 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458113 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458263 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458340 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458417 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458417 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458554 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458554 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458713 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458790 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458866 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.458941 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459016 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459104 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459183 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459259 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459351 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459430 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459518 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459597 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459674 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459749 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459826 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.459928 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.460044 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.460616 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.460694 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.460771 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.460848 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.460924 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461008 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461087 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461165 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461247 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461325 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461400 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461485 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461571 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461642 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461706 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461781 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.461939 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462026 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462104 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462180 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462256 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462332 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462416 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462495 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462571 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462646 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462711 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462774 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462845 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462921 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.462997 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.463079 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.463156 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.463238 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.463328 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.463406 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.463481 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.463669 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.463825 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.463960 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.464049 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.464279 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.464365 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.464600 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.464685 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.464915 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.465007 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.465269 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466049 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466146 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466225 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466225 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466512 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466512 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466631 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466707 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466783 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466869 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.466947 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.467021 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.467087 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.467329 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.467414 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.467639 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.467732 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.467951 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.468036 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.468265 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.468365 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.468589 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.468676 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.468905 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.468990 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.469219 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.469314 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.469547 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.469646 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.469864 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.469950 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.470174 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.470270 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.470481 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.470572 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.470793 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.470878 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.471105 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.471198 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.471406 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.471490 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.471713 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.471846 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.472027 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.472116 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.472339 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.472424 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.472651 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.472743 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.472963 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.473102 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.473276 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.473414 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.473612 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.473702 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.473918 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.474052 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.474228 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.474364 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.474540 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.474673 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.474848 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.474983 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.475158 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.475308 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.475474 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.475638 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.475794 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.475926 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.476111 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.476251 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.476425 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.476563 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.476741 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.476872 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.477056 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.477186 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.477367 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.477489 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.477702 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.477799 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.478016 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.478102 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.478323 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.478417 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.478649 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.478734 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.478959 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.479046 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.479267 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.479425 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.479577 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.479747 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.479883 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.480067 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.480198 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.480384 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.480505 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.480694 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.480947 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.481047 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.481265 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.481359 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.481609 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.481737 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.481926 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.482018 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.482234 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.482328 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.482544 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.482629 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.482863 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.482994 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.483169 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.483255 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.483479 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.483562 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.483901 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.483997 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.484216 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.484301 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.484528 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.484612 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.484840 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.484933 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.485149 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.485256 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.485457 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.485596 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.485794 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.485906 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.486123 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.486254 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.486434 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.486570 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.486741 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.486870 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.487048 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.487175 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.487374 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.487516 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.487683 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.487821 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.488010 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.488143 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.488374 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.488509 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.488692 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.488822 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.489000 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.489127 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.489327 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.489465 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.489737 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.489868 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.489997 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.490125 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.490297 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.490447 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.490694 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.490820 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.491024 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.491182 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.491386 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.491530 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.491681 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.491825 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.491996 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.492142 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.492319 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.492459 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.492629 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.492766 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.492943 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.493036 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.493249 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.493397 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.493582 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.493742 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.493891 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.494028 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.494202 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.494341 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.494518 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.494657 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.494833 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.494961 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.495146 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.495283 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.495454 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.495584 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.495761 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.495892 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.496087 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.496215 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.496397 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.496531 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.496721 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.496850 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.497041 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.497169 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.497368 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.497521 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.497708 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.497794 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.498015 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.498101 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.498337 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.498425 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.498643 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.498732 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.498946 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.499043 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.499254 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.499342 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.499560 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.499647 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.499865 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.500031 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.500174 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.500260 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.500501 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.500589 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.500808 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.500906 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.501132 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.501218 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.501442 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.501580 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.501788 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.501882 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.502111 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.502240 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.502421 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.502509 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.502741 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.502829 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.503051 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.503138 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.503358 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.503446 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.503664 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.503749 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.503969 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.504061 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.504272 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.504357 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.504581 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.504667 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.504889 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.504975 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.505201 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.505294 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.505554 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.505644 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.506098 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.506204 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.506332 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.506455 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.506586 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.506670 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.507334 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.507424 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.507661 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.507758 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.507972 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.508060 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.508283 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.508371 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.508587 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.508682 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.508894 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.508989 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.509198 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.509284 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.509518 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.509621 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.509834 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.509921 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.510146 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.510235 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.510457 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.510546 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.510763 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.510851 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.511070 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.511158 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.511395 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.511493 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.511704 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.511790 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.512030 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.512126 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.512343 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.512435 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.512652 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.512789 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.512960 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.513097 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.513267 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.513356 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.513611 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.513745 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.513930 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.514165 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.514306 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.515438 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.515757 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.515925 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.516058 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.516210 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.516210 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.516475 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.516584 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.516679 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.516761 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.516848 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.516926 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517003 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517080 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517157 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517234 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517323 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517402 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517485 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517618 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517693 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517784 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517863 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.517997 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.518179 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.518311 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.518493 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.518632 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.518826 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.518950 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.519153 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.519270 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.519481 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.519819 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.519913 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.520146 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.520232 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.520465 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.520559 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.520777 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.520862 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.521090 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.521175 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.521405 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.521520 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.521748 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.521835 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.522063 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.522150 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.522914 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.525959 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.526401 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.526512 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.526598 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.526732 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.526847 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.526933 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527014 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527095 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527185 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527275 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527370 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527452 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527531 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527610 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527689 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527765 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527840 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.527980 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528069 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528154 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528235 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528348 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528439 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528527 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528608 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528687 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528765 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528858 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.528945 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529032 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529119 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529206 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529353 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529353 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529574 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529661 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529741 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529821 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529914 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.529997 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.530076 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.530154 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.530233 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.530312 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.530472 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.530554 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.530634 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.530712 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.530791 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.531036 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.531138 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.531363 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.531489 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.531681 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.531770 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.531994 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.532085 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.532304 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.532392 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.532637 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.532877 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.533012 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.533199 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.533295 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.533589 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.533720 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.533889 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.533997 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.534215 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.534465 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.534561 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.534824 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.534921 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.535152 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.535244 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.535461 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.535548 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.535770 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.535872 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.536088 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.536185 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.536398 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.536490 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.536706 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.536847 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.537018 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.537110 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.537329 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.537424 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.537659 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.537763 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.538121 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.538233 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.538316 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.538395 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.538647 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.538898 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.538988 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.539256 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.539358 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.539558 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.539655 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.539872 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.539967 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.540185 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.540274 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.540517 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.540614 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.540824 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.540912 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.541132 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.541226 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.541442 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.541572 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.541775 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.541862 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.542339 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.542427 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.542647 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.542735 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.542952 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.543040 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.543257 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.543344 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.543572 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.543666 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.543876 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.543964 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.544180 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.544274 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.544483 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.544571 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.544787 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.544874 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.545091 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.545186 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.545404 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.545518 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.545735 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.545828 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.546044 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.546141 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.546353 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.546440 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.546657 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.546743 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.546965 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.547062 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.547274 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.547361 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.547581 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.547671 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.547896 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.548000 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.548211 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.548376 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.548514 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.548641 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.548813 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.548932 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.549127 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.549415 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.549572 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.549759 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.549864 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.550067 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.550156 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.550396 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.550487 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.550709 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.550835 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.551014 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.551106 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.551337 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.551438 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.551648 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.551784 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.551968 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.552057 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.552281 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.552368 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.552592 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.552691 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.552907 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.553016 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.553224 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.553364 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.553569 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.553832 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.553961 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.554174 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.554272 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.554518 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.554622 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.554865 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.555061 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.555207 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.555409 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.555521 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.555736 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.555826 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.556060 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.556156 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.556380 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.556498 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.556728 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.556825 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.557053 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.557212 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.557362 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.557565 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.557688 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.557777 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.558000 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.558088 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.558317 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.558433 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.558632 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.558731 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.558948 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.559063 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.559256 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.559487 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.559689 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.559833 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.560006 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.560157 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.560335 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.560486 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.560662 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.560804 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.560975 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.561125 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.561302 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.561440 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.561658 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.561797 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.561978 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.562111 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.562304 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.562424 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.562621 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.562822 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.562954 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.563054 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.563303 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.563413 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.563633 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.563722 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.563959 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.564110 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.564268 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.564378 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.564576 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.564701 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.564884 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.565027 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.565197 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.565338 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.565553 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.565688 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.565876 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.566013 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.566204 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.566329 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.566519 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.566651 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.566847 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.566966 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.567156 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.567298 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.567481 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.567643 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.567805 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.567976 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.568181 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.568304 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.568506 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.568633 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.568844 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.568948 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.569161 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.569783 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.570047 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.570146 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.570425 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.570513 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.570744 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.570871 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.571059 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.571163 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.571373 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.571462 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.571695 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.571782 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.572009 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.572105 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.572317 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.572419 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.572646 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.572733 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.572966 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.573061 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.573289 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.573432 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.573624 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.573714 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.573958 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.574073 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.574257 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.574349 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.574571 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.574662 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.574884 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.574977 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.575196 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.575292 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.575507 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.575610 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.575827 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.575923 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.576147 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.576236 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.576457 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.576555 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.576837 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.576935 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.577111 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.577207 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.577439 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.577576 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.577819 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.577909 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.578137 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.578233 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.578469 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.578588 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.578792 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.578948 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.579088 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 19:32:57.579211 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.579408 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.579722 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.580042 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.580363 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.580692 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.581020 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.581346 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.581699 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.582120 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.582509 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.582708 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.583039 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:32:57.583285 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 19:32:57.603265 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG oslo_db.sqlalchemy.engines [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:32:57.606383 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:32:57.786479 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.context [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29567de0-b844-4d3a-9dfb-4fa25441a86e(cell1) {{(pid=100668) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 19:32:57.788495 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.context [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29567de0-b844-4d3a-9dfb-4fa25441a86e(cell1) {{(pid=100669) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 19:32:57.790764 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG oslo_concurrency.lockutils [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:32:57.792642 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG oslo_concurrency.lockutils [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:32:57.793204 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:32:57.793460 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG oslo_concurrency.lockutils [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:32:57.794955 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:32:57.795486 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG oslo_concurrency.lockutils [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:32:57.795671 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:32:57.797726 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:32:57.806884 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG oslo_db.sqlalchemy.engines [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:32:57.809305 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG oslo_db.sqlalchemy.engines [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:32:57.811013 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:32:57.814916 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:32:58.073797 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG oslo_db.sqlalchemy.engines [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:32:58.081304 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_db.sqlalchemy.engines [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:32:58.494186 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: WARNING keystonemiddleware.auth_token [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:32:58.500715 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: WARNING keystonemiddleware.auth_token [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:32:58.568977 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: WARNING keystonemiddleware.auth_token [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:32:58.575616 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: WARNING keystonemiddleware.auth_token [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:32:58.844355 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: WARNING keystonemiddleware.auth_token [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:32:58.849768 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: WARNING keystonemiddleware.auth_token [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:32:58.856744 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56299cba59c0 pid: 100668 (default app) Sep 14 19:32:58.858968 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:32:58.860161 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001839 Sep 14 19:32:58.860571 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 789 bytes} [Tue Sep 14 19:32:58 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:32:58.924232 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: WARNING keystonemiddleware.auth_token [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:32:58.929738 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: WARNING keystonemiddleware.auth_token [None req-9d0aef4a-c68c-41d0-a67f-d7f647ed4999 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:32:58.936017 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56299cba59c0 pid: 100669 (default app) Sep 14 19:34:27.835915 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:27.837084 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Sep 14 19:34:27.837757 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:34:28.409374 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-fde3afb0-1d1d-4095-82c0-671364456e0c admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:28.444224 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-fde3afb0-1d1d-4095-82c0-671364456e0c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.598628 Sep 14 19:34:28.445092 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Sep 14 19:34:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:34:31.258511 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:31.259536 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-d46a2ce4-c17b-48d3-8b17-8519b7512ed8 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 14 19:34:31.260212 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:34:31.359644 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-ae3616ca-c389-4304-a47f-b94f87ac8e81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "swap": 0, "name": "cirros256", "ram": 256, "vcpus": 1}} {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:31.396198 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:34:31.396198 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: warnings.warn(msg) Sep 14 19:34:31.493811 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-ae3616ca-c389-4304-a47f-b94f87ac8e81 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.225488 Sep 14 19:34:31.502325 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Sep 14 19:34:31 2021] POST /compute/v2.1/flavors => generated 407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:34:31.733383 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-380c68f2-ad19-4a9a-88a0-a898e9ccb484 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:31.736057 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:34:31.736057 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: warnings.warn(msg) Sep 14 19:34:31.874956 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-380c68f2-ad19-4a9a-88a0-a898e9ccb484 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.368884 Sep 14 19:34:31.876275 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Tue Sep 14 19:34:31 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:34:34.379829 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-ae3616ca-c389-4304-a47f-b94f87ac8e81 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:34.380970 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-ae3616ca-c389-4304-a47f-b94f87ac8e81 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001749 Sep 14 19:34:34.381422 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:34:34.519489 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-802c573b-1376-4bd6-9f45-74736d77b871 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:34.537752 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:34:34.537752 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: warnings.warn(msg) Sep 14 19:34:34.639275 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-802c573b-1376-4bd6-9f45-74736d77b871 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.249983 Sep 14 19:34:34.639851 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Sep 14 19:34:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:34:34.656476 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-0d590353-4287-4dba-bfbe-50597a043c01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:34.663548 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:34:34.663548 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: warnings.warn(msg) Sep 14 19:34:34.820393 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-0d590353-4287-4dba-bfbe-50597a043c01 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.170581 Sep 14 19:34:34.821384 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Tue Sep 14 19:34:34 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:37.654590 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-802c573b-1376-4bd6-9f45-74736d77b871 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:37.656343 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-802c573b-1376-4bd6-9f45-74736d77b871 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002492 Sep 14 19:34:37.657116 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:37 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:34:37.742330 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-11becfbb-f77b-403d-8e04-9f4bb1554052 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "vcpus": 1, "id": "d2", "name": "ds1G"}} {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:37.896487 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-11becfbb-f77b-403d-8e04-9f4bb1554052 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.226969 Sep 14 19:34:37.897193 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Sep 14 19:34:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:34:37.909936 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-ddf3e38d-2fac-4d5b-a94e-207e55bc8e25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:38.009549 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-ddf3e38d-2fac-4d5b-a94e-207e55bc8e25 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103476 Sep 14 19:34:38.010544 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Tue Sep 14 19:34:37 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:40.336722 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-11becfbb-f77b-403d-8e04-9f4bb1554052 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:40.337860 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-11becfbb-f77b-403d-8e04-9f4bb1554052 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 14 19:34:40.338354 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:34:40.400580 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-a5b5125f-6407-4f9e-aedd-84e1a375f298 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "vcpus": 2, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G"}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:40.526956 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-a5b5125f-6407-4f9e-aedd-84e1a375f298 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.181845 Sep 14 19:34:40.527576 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Sep 14 19:34:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:34:40.541355 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-b2af467e-fd49-46b5-abcb-70ee80854f69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:40.682651 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-b2af467e-fd49-46b5-abcb-70ee80854f69 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.145536 Sep 14 19:34:40.683245 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Tue Sep 14 19:34:40 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:34:42.947211 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-a5b5125f-6407-4f9e-aedd-84e1a375f298 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:42.948252 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-a5b5125f-6407-4f9e-aedd-84e1a375f298 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 14 19:34:42.948657 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:34:43.012141 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-9065c56e-8ac2-4055-8b20-0952aab645cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "disk": 20, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:43.107570 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-9065c56e-8ac2-4055-8b20-0952aab645cd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152124 Sep 14 19:34:43.109566 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Sep 14 19:34:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:34:43.120491 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-4f903ba0-75f3-4b16-9daa-141e5ee6c819 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:43.214123 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-4f903ba0-75f3-4b16-9daa-141e5ee6c819 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097251 Sep 14 19:34:43.214658 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Tue Sep 14 19:34:43 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:45.584252 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-9065c56e-8ac2-4055-8b20-0952aab645cd admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:45.585273 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-9065c56e-8ac2-4055-8b20-0952aab645cd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 14 19:34:45.585711 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:34:45.659677 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-59caafbd-10a0-40b9-af96-fdf426c6ffcc admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:45.683728 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-59caafbd-10a0-40b9-af96-fdf426c6ffcc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090767 Sep 14 19:34:45.684511 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Sep 14 19:34:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:34:48.179672 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-9065c56e-8ac2-4055-8b20-0952aab645cd admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:48.180965 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-9065c56e-8ac2-4055-8b20-0952aab645cd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001906 Sep 14 19:34:48.181551 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:34:48.266073 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-db9e843b-5255-40eb-a869-1a25e8ec2936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "ram": 512, "disk": 1}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:48.408538 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-db9e843b-5255-40eb-a869-1a25e8ec2936 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.217628 Sep 14 19:34:48.409548 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Sep 14 19:34:48 2021] POST /compute/v2.1/flavors => generated 402 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:34:48.426301 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-78b20493-fc04-4199-ab42-265295443ac3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:48.546935 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-78b20493-fc04-4199-ab42-265295443ac3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125546 Sep 14 19:34:48.547654 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Tue Sep 14 19:34:48 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:34:51.105765 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-db9e843b-5255-40eb-a869-1a25e8ec2936 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:51.107020 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-db9e843b-5255-40eb-a869-1a25e8ec2936 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Sep 14 19:34:51.107581 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:34:51.178968 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-87e8a110-ef08-4144-8a0a-33e5dc8e1b0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "ram": 2048, "vcpus": 1}} {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:51.285955 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-87e8a110-ef08-4144-8a0a-33e5dc8e1b0f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.169214 Sep 14 19:34:51.286552 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Sep 14 19:34:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:34:51.312359 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-a65c5dcd-b458-499a-a506-4ffa07539d8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:51.425920 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-a65c5dcd-b458-499a-a506-4ffa07539d8b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118067 Sep 14 19:34:51.426552 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Tue Sep 14 19:34:51 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:53.917256 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-87e8a110-ef08-4144-8a0a-33e5dc8e1b0f admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:53.918330 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-87e8a110-ef08-4144-8a0a-33e5dc8e1b0f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001800 Sep 14 19:34:53.918777 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:34:53.994820 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-a2569603-7d25-4938-857e-da4501dc1099 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:54.132724 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-a2569603-7d25-4938-857e-da4501dc1099 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.202123 Sep 14 19:34:54.133297 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Sep 14 19:34:53 2021] POST /compute/v2.1/flavors => generated 406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:34:54.147431 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-f296442c-aa00-4c58-bf98-59ffb47d2e5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:54.264941 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-f296442c-aa00-4c58-bf98-59ffb47d2e5b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122293 Sep 14 19:34:54.267161 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Tue Sep 14 19:34:54 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:56.625861 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-a2569603-7d25-4938-857e-da4501dc1099 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:56.627854 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-a2569603-7d25-4938-857e-da4501dc1099 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002491 Sep 14 19:34:56.628323 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:34:56.695801 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-c309a326-fc66-4128-a09f-b67fa5703231 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "disk": 80, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:56.804699 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-c309a326-fc66-4128-a09f-b67fa5703231 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.168507 Sep 14 19:34:56.805748 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Sep 14 19:34:56 2021] POST /compute/v2.1/flavors => generated 405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:34:56.824287 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-09b8b0ba-bd3f-47b1-942b-8841195ccae8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:34:56.945079 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-09b8b0ba-bd3f-47b1-942b-8841195ccae8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124631 Sep 14 19:34:56.945791 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Tue Sep 14 19:34:56 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:34:59.596423 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-c309a326-fc66-4128-a09f-b67fa5703231 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:34:59.597653 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-c309a326-fc66-4128-a09f-b67fa5703231 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Sep 14 19:34:59.598166 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:34:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:34:59.680905 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-95892e5f-7bf3-4432-84de-2bbb35801a4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "id": "5", "rxtx_factor": 1.0, "ram": 16384}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:35:00.346796 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-95892e5f-7bf3-4432-84de-2bbb35801a4d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.741668 Sep 14 19:35:00.347726 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Sep 14 19:34:59 2021] POST /compute/v2.1/flavors => generated 408 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:00.361559 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-15a02db5-b7d3-4035-bd7e-d5af5a8d90e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:35:00.459572 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-15a02db5-b7d3-4035-bd7e-d5af5a8d90e4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102329 Sep 14 19:35:00.460154 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Tue Sep 14 19:35:00 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:35:40.662620 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-95892e5f-7bf3-4432-84de-2bbb35801a4d admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:40.663672 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-95892e5f-7bf3-4432-84de-2bbb35801a4d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 14 19:35:40.664077 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:35:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:35:40.724139 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-f9918597-d68f-48df-9416-69277732b761 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:40.740739 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-f9918597-d68f-48df-9416-69277732b761 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069734 Sep 14 19:35:40.741290 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Sep 14 19:35:40 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:35:42.182580 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-95892e5f-7bf3-4432-84de-2bbb35801a4d admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:42.183593 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-95892e5f-7bf3-4432-84de-2bbb35801a4d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 14 19:35:42.184001 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:35:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:35:42.378660 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-23fb4667-8b87-4f72-b18c-eb30e90b1d95 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:42.384756 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.wsgi [None req-23fb4667-8b87-4f72-b18c-eb30e90b1d95 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 19:35:42.385341 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-23fb4667-8b87-4f72-b18c-eb30e90b1d95 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:35:42.386537 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-23fb4667-8b87-4f72-b18c-eb30e90b1d95 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062384 Sep 14 19:35:42.387135 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Sep 14 19:35:42 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:35:42.397923 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-8eba9cd5-73e0-46fb-8b7f-445c49cc585a admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:42.418479 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-8eba9cd5-73e0-46fb-8b7f-445c49cc585a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024117 Sep 14 19:35:42.419038 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1211 bytes} [Tue Sep 14 19:35:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:35:42.429372 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-c59e6210-7cb7-4efc-94ad-c28529516023 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:42.450951 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-c59e6210-7cb7-4efc-94ad-c28529516023 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025131 Sep 14 19:35:42.451495 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1211 bytes} [Tue Sep 14 19:35:42 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:35:42.462327 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-1ab8c8f1-5a70-49f6-ad84-0dba6e5e08fa admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:42.467882 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.wsgi [None req-1ab8c8f1-5a70-49f6-ad84-0dba6e5e08fa admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 19:35:42.468457 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-1ab8c8f1-5a70-49f6-ad84-0dba6e5e08fa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:35:42.469257 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-1ab8c8f1-5a70-49f6-ad84-0dba6e5e08fa admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010554 Sep 14 19:35:42.469810 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Sep 14 19:35:42 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:35:43.850941 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-c59e6210-7cb7-4efc-94ad-c28529516023 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:43.851948 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-c59e6210-7cb7-4efc-94ad-c28529516023 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 14 19:35:43.852340 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:35:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:35:44.047262 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-2a4c60a4-7685-453a-b97a-beb8a498c62c admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:44.053170 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.wsgi [None req-2a4c60a4-7685-453a-b97a-beb8a498c62c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 19:35:44.053873 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-2a4c60a4-7685-453a-b97a-beb8a498c62c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:35:44.054743 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-2a4c60a4-7685-453a-b97a-beb8a498c62c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063827 Sep 14 19:35:44.055370 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Sep 14 19:35:43 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:35:44.066172 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-0e8694e9-03cd-4be3-aaa9-f53d0531f57d admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:44.083422 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-0e8694e9-03cd-4be3-aaa9-f53d0531f57d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021443 Sep 14 19:35:44.084086 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1211 bytes} [Tue Sep 14 19:35:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:35:44.101989 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-cdc474b9-9f7c-42d5-a069-1468dcd160c9 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:44.116245 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-cdc474b9-9f7c-42d5-a069-1468dcd160c9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025253 Sep 14 19:35:44.116817 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1211 bytes} [Tue Sep 14 19:35:44 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:35:44.127418 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-588faf52-22db-403b-9e8e-9fad8c433cd2 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:44.133112 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.wsgi [None req-588faf52-22db-403b-9e8e-9fad8c433cd2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 19:35:44.133763 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-588faf52-22db-403b-9e8e-9fad8c433cd2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:35:44.134702 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-588faf52-22db-403b-9e8e-9fad8c433cd2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010940 Sep 14 19:35:44.135267 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1191 bytes} [Tue Sep 14 19:35:44 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:35:45.499440 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-cdc474b9-9f7c-42d5-a069-1468dcd160c9 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:45.500628 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-cdc474b9-9f7c-42d5-a069-1468dcd160c9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Sep 14 19:35:45.501034 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:35:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:35:45.696483 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-81daa324-6033-487b-957f-6a96b262f1a7 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:45.702957 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.wsgi [None req-81daa324-6033-487b-957f-6a96b262f1a7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 19:35:45.703526 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-81daa324-6033-487b-957f-6a96b262f1a7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:35:45.704328 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-81daa324-6033-487b-957f-6a96b262f1a7 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060271 Sep 14 19:35:45.704844 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Sep 14 19:35:45 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:35:45.714938 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-0614563e-0fb2-429a-8d91-8d740936f94f admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:45.729408 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-0614563e-0fb2-429a-8d91-8d740936f94f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018321 Sep 14 19:35:45.730046 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1211 bytes} [Tue Sep 14 19:35:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:35:45.740229 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:45.753806 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017107 Sep 14 19:35:45.754353 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1211 bytes} [Tue Sep 14 19:35:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:35:45.764375 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-e72a4b06-b66a-47e8-9224-4c1bd7077775 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:45.770129 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.wsgi [None req-e72a4b06-b66a-47e8-9224-4c1bd7077775 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 19:35:45.770692 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-e72a4b06-b66a-47e8-9224-4c1bd7077775 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:35:45.771469 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-e72a4b06-b66a-47e8-9224-4c1bd7077775 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010821 Sep 14 19:35:45.771958 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Sep 14 19:35:45 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:35:47.113942 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:47.114940 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 14 19:35:47.115324 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:35:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:35:47.309344 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-3150285f-dbb6-4bf9-a106-cb63164c7c2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:35:47.389037 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-3150285f-dbb6-4bf9-a106-cb63164c7c2a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.136476 Sep 14 19:35:47.389615 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1236 bytes} [Tue Sep 14 19:35:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:35:48.757240 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:48.758601 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001780 Sep 14 19:35:48.759005 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:35:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:35:48.949383 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-f9fa307a-28ec-4367-b316-76916bbc2d54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:35:49.042441 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-f9fa307a-28ec-4367-b316-76916bbc2d54 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.144928 Sep 14 19:35:49.043101 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1236 bytes} [Tue Sep 14 19:35:48 2021] POST /compute/v2.1/flavors => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:50.402347 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:50.403450 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Sep 14 19:35:50.403921 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:35:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:35:50.593820 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-cb50aed1-8fba-4a17-82be-65ea1dce2ef8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:35:50.720443 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-cb50aed1-8fba-4a17-82be-65ea1dce2ef8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.179883 Sep 14 19:35:50.721021 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1236 bytes} [Tue Sep 14 19:35:50 2021] POST /compute/v2.1/flavors => generated 407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:35:52.086179 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:52.087190 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Sep 14 19:35:52.087584 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:35:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:35:52.278550 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-a8b9f449-5c29-4495-8a34-0600dc09e38e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:35:52.380414 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-a8b9f449-5c29-4495-8a34-0600dc09e38e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.154697 Sep 14 19:35:52.380971 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1236 bytes} [Tue Sep 14 19:35:52 2021] POST /compute/v2.1/flavors => generated 409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:35:53.756055 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:53.757062 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 14 19:35:53.757515 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:35:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:35:53.947812 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-f7482981-d5dc-4971-9889-d30b332fd472 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:35:53.967692 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-f7482981-d5dc-4971-9889-d30b332fd472 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071622 Sep 14 19:35:53.968156 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1203 bytes} [Tue Sep 14 19:35:53 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:36:41.405975 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:36:41.406974 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-d6e5a63b-c0f2-439e-b5fd-5578cdc7561f admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 14 19:36:41.407360 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Tue Sep 14 19:36:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:36:41.466554 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-2ec6ced0-7dc4-40ea-b668-27486021da40 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:36:41.486070 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-2ec6ced0-7dc4-40ea-b668-27486021da40 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072077 Sep 14 19:36:41.486668 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Sep 14 19:36:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:36:41.509181 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-6934cc88-139d-4bd8-a68b-ea3ca84fde63 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:36:41.516919 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-6934cc88-139d-4bd8-a68b-ea3ca84fde63 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011474 Sep 14 19:36:41.517433 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Tue Sep 14 19:36:41 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:36:41.529195 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-905f4ac7-e767-41ba-abf4-31e132ffbb2c admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:36:41.537198 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-905f4ac7-e767-41ba-abf4-31e132ffbb2c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011509 Sep 14 19:36:41.537777 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Tue Sep 14 19:36:41 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:36:41.550696 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-37b0fab2-3207-40f5-84b8-71db312d4929 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:36:41.558807 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-37b0fab2-3207-40f5-84b8-71db312d4929 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011646 Sep 14 19:36:41.559930 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Tue Sep 14 19:36:41 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:36:41.572430 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-3f584c5a-2ee3-41f9-b052-80fd52e91240 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:36:41.580224 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-3f584c5a-2ee3-41f9-b052-80fd52e91240 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011433 Sep 14 19:36:41.580750 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Tue Sep 14 19:36:41 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:38:14.560468 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-8e3003a9-0b1d-4e6d-a7a9-9aab02d29c94 tempest-verify_tempest_config-31139935 tempest-verify_tempest_config-31139935-project] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:38:14.562495 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-8e3003a9-0b1d-4e6d-a7a9-9aab02d29c94 tempest-verify_tempest_config-31139935 tempest-verify_tempest_config-31139935-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.119104 Sep 14 19:38:14.563044 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 34/69] 10.222.0.58 () {58 vars in 1134 bytes} [Tue Sep 14 19:38:14 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:39:45.080658 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-3f584c5a-2ee3-41f9-b052-80fd52e91240 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:39:45.081725 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-3f584c5a-2ee3-41f9-b052-80fd52e91240 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 14 19:39:45.082132 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 36/70] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:39:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:39:45.342859 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-00fb0a59-6a81-45c6-828d-aa7eb35807e9 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:39:45.344108 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:39:45.344108 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: warnings.warn(msg) Sep 14 19:39:45.345723 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-00fb0a59-6a81-45c6-828d-aa7eb35807e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:39:45.346462 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-00fb0a59-6a81-45c6-828d-aa7eb35807e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:39:45.347881 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-00fb0a59-6a81-45c6-828d-aa7eb35807e9 admin admin] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:39:45.348647 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-00fb0a59-6a81-45c6-828d-aa7eb35807e9 admin admin] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:39:45.385298 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-00fb0a59-6a81-45c6-828d-aa7eb35807e9 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.156438 Sep 14 19:39:45.385907 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 35/71] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Sep 14 19:39:45 2021] GET /compute/v2.1/os-services => generated 794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:39:46.779835 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-3f584c5a-2ee3-41f9-b052-80fd52e91240 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:39:46.780856 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-3f584c5a-2ee3-41f9-b052-80fd52e91240 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Sep 14 19:39:46.781259 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 37/72] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:39:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:39:46.995319 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-8ff2d6e3-4033-4c06-86dc-e056da4912a1 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:39:46.999728 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:39:46.999728 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: warnings.warn(msg) Sep 14 19:39:46.999728 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-8ff2d6e3-4033-4c06-86dc-e056da4912a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:39:47.000122 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-8ff2d6e3-4033-4c06-86dc-e056da4912a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:39:47.000943 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-8ff2d6e3-4033-4c06-86dc-e056da4912a1 admin admin] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:39:47.001380 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-8ff2d6e3-4033-4c06-86dc-e056da4912a1 admin admin] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:39:47.030001 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-8ff2d6e3-4033-4c06-86dc-e056da4912a1 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.105892 Sep 14 19:39:47.030603 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 36/73] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Sep 14 19:39:46 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:39:58.831633 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-3f584c5a-2ee3-41f9-b052-80fd52e91240 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:39:58.832692 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-3f584c5a-2ee3-41f9-b052-80fd52e91240 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 14 19:39:58.833688 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 38/74] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:39:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:39:59.035647 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-681e7559-e65f-4508-a849-4841e69abec6 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:39:59.036845 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:39:59.036845 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: warnings.warn(msg) Sep 14 19:39:59.038478 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-681e7559-e65f-4508-a849-4841e69abec6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:39:59.038862 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-681e7559-e65f-4508-a849-4841e69abec6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:39:59.039689 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-681e7559-e65f-4508-a849-4841e69abec6 admin admin] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:39:59.040095 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-681e7559-e65f-4508-a849-4841e69abec6 admin admin] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:39:59.061802 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-681e7559-e65f-4508-a849-4841e69abec6 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078324 Sep 14 19:39:59.062370 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 37/75] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Sep 14 19:39:58 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:40:00.446475 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: DEBUG nova.api.openstack.wsgi [None req-3f584c5a-2ee3-41f9-b052-80fd52e91240 admin admin] Calling method '>' {{(pid=100668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:40:00.447381 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: INFO nova.api.openstack.requestlog [None req-3f584c5a-2ee3-41f9-b052-80fd52e91240 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Sep 14 19:40:00.447788 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: [pid: 100668|app: 0|req: 39/76] 10.222.0.58 () {56 vars in 1075 bytes} [Tue Sep 14 19:40:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:40:00.640136 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG nova.api.openstack.wsgi [None req-d55b9ee6-928f-4346-b2dc-fe2435777f68 admin admin] Calling method '>' {{(pid=100669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:40:00.641284 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:40:00.641284 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: warnings.warn(msg) Sep 14 19:40:00.642819 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-d55b9ee6-928f-4346-b2dc-fe2435777f68 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:40:00.643248 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-d55b9ee6-928f-4346-b2dc-fe2435777f68 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:40:00.644015 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-d55b9ee6-928f-4346-b2dc-fe2435777f68 admin admin] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:40:00.644432 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: DEBUG oslo_concurrency.lockutils [None req-d55b9ee6-928f-4346-b2dc-fe2435777f68 admin admin] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:40:00.665965 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: INFO nova.api.openstack.requestlog [None req-d55b9ee6-928f-4346-b2dc-fe2435777f68 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078413 Sep 14 19:40:00.666425 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: [pid: 100669|app: 0|req: 38/77] 10.222.0.58 () {60 vars in 1194 bytes} [Tue Sep 14 19:40:00 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:40:57.633549 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: Tue Sep 14 19:40:57 2021 - graceful shutdown triggered... Sep 14 19:40:57.634141 dv-cinder-805887-12-iscsi devstack@n-api.service[100669]: Gracefully killing worker 2 (pid: 100669)... Sep 14 19:40:57.634567 dv-cinder-805887-12-iscsi devstack@n-api.service[100668]: Gracefully killing worker 1 (pid: 100668)... Sep 14 19:40:57.634347 dv-cinder-805887-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 14 19:40:58.635255 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: worker 1 buried after 1 seconds Sep 14 19:40:58.635255 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: worker 2 buried after 1 seconds Sep 14 19:40:58.635255 dv-cinder-805887-12-iscsi devstack@n-api.service[100667]: goodbye to uWSGI. Sep 14 19:40:58.636843 dv-cinder-805887-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 14 19:40:58.637386 dv-cinder-805887-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 14 19:40:58.640261 dv-cinder-805887-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 19:40:58.649449 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 19:40:58.651578 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 14 19:40:58 2021] *** Sep 14 19:40:58.651736 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 19:40:58.651862 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 19:40:58.651984 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: nodename: dv-cinder-805887-12-iscsi Sep 14 19:40:58.652097 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: machine: x86_64 Sep 14 19:40:58.652216 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: clock source: unix Sep 14 19:40:58.652328 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: pcre jit disabled Sep 14 19:40:58.652437 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: detected number of CPU cores: 4 Sep 14 19:40:58.652546 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: current working directory: / Sep 14 19:40:58.652663 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: detected binary path: /usr/bin/uwsgi-core Sep 14 19:40:58.652771 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: your processes number limit is 47680 Sep 14 19:40:58.652891 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: your memory page size is 4096 bytes Sep 14 19:40:58.653017 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: detected max file descriptor number: 2048 Sep 14 19:40:58.653129 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: lock engine: pthread robust mutexes Sep 14 19:40:58.653403 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: thunder lock: enabled Sep 14 19:40:58.653711 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 19:40:58.653924 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 14 19:40:58.701238 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: Python main interpreter initialized at 0x55f4858bd9c0 Sep 14 19:40:58.701238 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: python threads support enabled Sep 14 19:40:58.701238 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: your server socket listen backlog is limited to 100 connections Sep 14 19:40:58.701238 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: your mercy for graceful operations on workers is 90 seconds Sep 14 19:40:58.701753 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 19:40:58.701753 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: *** Operational MODE: preforking *** Sep 14 19:40:58.702012 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: *** uWSGI is running in multiple interpreter mode *** Sep 14 19:40:58.702012 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: spawned uWSGI master process (pid: 115662) Sep 14 19:40:58.702235 dv-cinder-805887-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 14 19:40:58.703676 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: spawned uWSGI worker 1 (pid: 115678, cores: 1) Sep 14 19:40:58.703676 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: spawned uWSGI worker 2 (pid: 115679, cores: 1) Sep 14 19:40:58.703676 dv-cinder-805887-12-iscsi devstack@n-api.service[115662]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 19:41:00.515190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:41:00.515190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: from cryptography.utils import int_from_bytes Sep 14 19:41:00.515868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:41:00.515868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: from cryptography.utils import int_from_bytes Sep 14 19:41:00.523909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:41:00.523909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: from cryptography.utils import int_from_bytes Sep 14 19:41:00.524431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:41:00.524431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: from cryptography.utils import int_from_bytes Sep 14 19:41:03.191466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 19:41:03.192090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 19:41:03.192199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 19:41:03.192551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 19:41:03.192639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 19:41:03.192724 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 19:41:03.192806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 19:41:03.192892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 19:41:03.193210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 19:41:03.193321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.193397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 19:41:03.193604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.193831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.193954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.194203 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.194305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.194530 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.194639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.194850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.194958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.195179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.195288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.195495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.195611 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.195830 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.195944 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.196240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.196352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.196434 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.196523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.196718 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.196825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-805887-12-iscsi {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.197043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.197370 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-805887-12-iscsi {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.197567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.197752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.197909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.198075 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.198222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.198369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.198525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.198681 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.198839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.198993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.199151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.199297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.199457 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.199634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.199820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.200023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.200559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.200884 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.201310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.201672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.201672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.202110 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.202336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.202568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.202781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.203013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.203232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.203441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.203668 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.203895 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.204105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.204327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.204545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.204766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.204986 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.205215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-805887-12-iscsi {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.205435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.205712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.205947 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-805887-12-iscsi {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.206178 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.206398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.206623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.206847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.207039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.207253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.207448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.207608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.207808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.207965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.208118 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.208279 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.208437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.208618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.208774 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.208928 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.209084 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.209240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.209939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.210101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.210267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.210449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.212043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.212226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.212393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.212611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.212765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.212914 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.213060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.213217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.213373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.213552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.213705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.213705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.214009 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.214171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.214325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.214484 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.214636 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.214782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.215006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.215165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.215312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.215459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.215608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.215761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.215919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.216083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.216233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.216431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.216585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.216790 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.216972 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.217127 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.217274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.217613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.217783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.217939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.218092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.218247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.218404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.218558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.218717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.218865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.219009 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.219153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.219299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.219451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.219607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.219753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.219905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.220058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.220210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.220210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.220520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.220797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.220958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.220958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.221236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.221236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.221645 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.222318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.222489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.222489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.222779 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.222779 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.223090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.223246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.223400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.223557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.223703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.223858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.224004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.224150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.224343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.224499 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.224646 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.224801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.224966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.225635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.225807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.225963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.226130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.226278 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.226278 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.226852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.226852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.227149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.227305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.227453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.227453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.227742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.227888 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.228042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.228198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.228354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.228501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.228654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.228809 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.228966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.229125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.229280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.229441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.229688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.229859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.230021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.230175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.230321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.230477 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.230630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.230800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.231043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.231203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.231350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.231495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.231675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.231926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.232641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.232641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.232931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.233085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.233232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.233398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.233563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.233715 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.233870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.234017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.234164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.234323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.234482 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.234637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.234791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.234936 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.235083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.235241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.235432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.235587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.235742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.235888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.236046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.236204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.236352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.236508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.236665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.236812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.236965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.237129 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.237284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.237430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.237622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.237783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.237945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.238672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.238839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.238997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.239144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.239290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.239435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.239587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.239769 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.240174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.240328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.240474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.240627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.241517 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.241787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.242063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.242886 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.243045 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.243199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.243362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.243525 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.243680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.243835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.243991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.243991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.244284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.244441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.244601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.244796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.244958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.245106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.245106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.245413 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.245582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.245730 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.245887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.246042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.246199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.246353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.246353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.246660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.246818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:41:03.246975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.247130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.247284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.247431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.247578 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.247737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.247894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.248042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.248186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.248186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.248479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.248639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.248795 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.248942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.249088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.249249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.249397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.249662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.249856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.250008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.250163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.250316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.250465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.250632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.250790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.251055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.251209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.251355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.251755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.252034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.252335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253214 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253300 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253769 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.253985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254068 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.254936 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255080 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255751 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255907 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.255978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256214 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256487 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256567 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256790 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.256934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257005 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257082 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.257958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258251 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258559 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.258946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.259916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260110 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260497 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260764 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.260935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261205 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261578 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.261988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.262126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.262219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.262351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.262451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.262534 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.262626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.262773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.262996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263197 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263803 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.263983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.264069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.264239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.264419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.264531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.264689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.264846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.264990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.265128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.265267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.265622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.265782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.265924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.266072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.266211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.266357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.266512 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.266659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.266816 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.266961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.267055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.267232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.267381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.267529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.267631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.267767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.267940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.268080 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.268283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.268384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.268612 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.268764 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.268932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.269041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.269259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.269405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.269606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.269746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.269927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.270077 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.270244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.270398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.270565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.270671 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.270892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.271211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.271436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.271542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.271771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.271864 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.272151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.272302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.272472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.272572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.272808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.272965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.273174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.273349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.273443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.273548 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.273761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.273894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.274086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.274212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.274443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.274583 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.274782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.274921 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.275109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.275240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.275432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.275567 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.275752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.275892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.276072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.276202 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.276388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.276519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.276706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.276836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.277023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.277162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.277343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.277482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.277777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.277912 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.278050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.278186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.278346 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.278477 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.278670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.278803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.279002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.279120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.279331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.279448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.279685 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.279869 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.279990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.280108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.280286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.280405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.280650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.280779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.280938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.281057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.281257 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.281375 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.281601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.281735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.281984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.282121 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.282242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.282361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.282600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.282849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.282978 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.283098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.283313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.283624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.283945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.284267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.284467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.284601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.284807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.284948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.285142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.285279 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.285482 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.285648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.285840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.285969 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.286166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.286287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.286626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.286763 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.286875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.286999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.287289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.287445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.287572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.288357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.288500 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.288767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.288767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.289079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.289218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.289335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.289474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.289648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.289788 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.289918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.290055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.290185 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.290313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.290455 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.290595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.290724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.290859 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.290997 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.291140 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.291271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.291459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.291593 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.291789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.291927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.292106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.292246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.292431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.292569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.292808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.292941 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.293072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.293192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.293395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.293633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.294028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.294150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.294290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.294421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.294592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.294724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.294916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.295062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.295234 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.295364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.295553 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.295690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.295879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.296017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.296197 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.296337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.296517 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.296647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.296836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.296977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.297154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.297286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.297474 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.297684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.297834 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.297980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.298156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.298480 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.298608 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.298804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.298949 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.299123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.299262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.299447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.299589 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.299778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.299918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.300106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.300366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.300505 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.300715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.300854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.301042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.301175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.301372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.301521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.301717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.301958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.302103 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.302230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.302359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.302494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.302622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.302783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.302939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.303072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.303278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.303933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.304130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.304275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.304412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.304541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.304725 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.304858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.305039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.305248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.305387 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.305547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.305679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.305807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.306005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.306146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.306321 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.306452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.306636 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.306775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.306947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.307085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.307266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.307398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.307582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.307714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.307892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.308036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.308203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.308333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.308513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.308660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.308825 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.308964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.309158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.309290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.309476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.309613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.309811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.309947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.310125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.310259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.310436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.310568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.310793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.310934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.311109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.311245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.311426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.311564 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.311742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.311874 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.312056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.312181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.312376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.312507 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.312695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.312827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.313009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.313140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.313332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.313462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.313681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.313822 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.313992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.314138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.314323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.314461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.314600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.314732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.314909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.315043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.315222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.315355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.315539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.315675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.315853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.315984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.316167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.316315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.316475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.316618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.316789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.316919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.317102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.317240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.317414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.317575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.317755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.317892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.318067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.318207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.318375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.318504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.318690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.318820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.319030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.319149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.319340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.319470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.319654 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.319784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.319968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.320101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.320277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.320408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.320590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.320732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.320901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.321041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.321211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.321343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.321559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.321706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.321846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.322143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.322281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.322465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.322597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.322781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.322912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.323093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.323224 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.323408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.323538 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.323718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.323850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.324026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.324158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.324379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.324576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.324716 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.324847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.324965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.325092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.325230 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.325366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.325556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.325690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.325873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.326014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.326179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.326320 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.326488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.326627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.326797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.326935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.327106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.327247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.327416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.327549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.327723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.327854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.328029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.328168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.328337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.328467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.328663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.328794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.328977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.329119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.329289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.329422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.329679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.329812 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.330026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.330167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.330358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.330498 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.330682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.330815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.331004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.331211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.331349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.331479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.331629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.331762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.331964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.332103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.332241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.332370 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.332563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.332695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.332877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.333010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.333187 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.333317 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.333525 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.333661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.333851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.333992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.334168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.334292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.334475 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.334710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.334851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.334981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.335132 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.335266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.335455 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.335596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.335769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.335899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.336090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.336229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.336432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.336576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.336708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.336836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.337013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.337145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.337333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.337472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.337676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.337822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.337992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.338125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.338309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.338447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.338623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.338753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.338933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.339064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.339248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.339380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.339560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.339699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.339875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.340013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.340192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.340331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.340504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.340645 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.340812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.340936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.341123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.341242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.341434 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.341707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.341840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.341978 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.342115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.342244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.342394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.342530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.342710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.342851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.343062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.343192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.343316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.343454 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.343621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.343766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.344032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.344166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.344420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.344567 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.344706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.344915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.345046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.345175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.345303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.345428 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.345621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.345764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.345950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.346083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.346274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.346414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.346589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.346729 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.346932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.347062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.347248 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.347387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.347582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.347722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.347897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.348037 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.348210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.348351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.348519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.348636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.348838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.348965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.349148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.349296 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.349468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.349644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.349800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.349932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.350609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.350770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.350981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.351120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.351297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.351460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.351628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.351772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.352055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.352186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.352375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.352508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.352688 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.352900 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.353030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.353165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.353330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.353453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.353679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.353811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.353998 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.354128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.354331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.354483 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.354665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.354797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.354991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.355131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.355316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.355450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.355627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.355736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.355955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.356056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.356283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.356391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.356600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.356699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.356920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.357031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.357234 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.357349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.357598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.357713 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.357933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.358034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.358256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.358364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.358590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.358682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.358930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.359039 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.359246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.359339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.359567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.359666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.359882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.359984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.360198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.360290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.360535 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.360633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.360851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.360953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.361163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.361254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.361487 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.361678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.361822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.361966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.362125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.362259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.362440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.362580 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.362757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.362889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.363077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.363216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.363392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.363599 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.363739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.363859 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.363987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.364114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.364320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.364445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.364713 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.364847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.364980 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.365123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.365390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.365550 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.365698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.365869 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.366472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.366609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.366745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.366889 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.367104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.367238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.367422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.367555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.367734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.367878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.368049 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.368189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.368362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.368501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.368710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.368854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.369022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.369153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.369349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.369481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.369713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.369870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.370040 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.370172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.370358 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.370489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.370678 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.370817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.370991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.371131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.371306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.371444 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.371654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.371785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.371913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.372041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.372202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.372336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.372517 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.372650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.372922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.373052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.373242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.373374 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.373578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.373717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.373892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.374017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.374210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.374356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.374521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.374662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.374885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.375016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.375152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.375306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.375500 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.375632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.375756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.375885 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.376066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.376208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.376380 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.376513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.376693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.376832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.377006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.377147 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.377317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.377457 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.377693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.377838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.378009 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.378150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.378351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.378483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.378677 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.378810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.379010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.379144 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.379332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.379465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.379649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.379781 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.379971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.380102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.380293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.380424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.380616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.380739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.380935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.381082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.381253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.381401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.381630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.381771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.381954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.382088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.382297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.382556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.382697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.382900 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.383021 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.383225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.383345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.383549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.383675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.383871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.384184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.384304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.384510 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.384628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.384832 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.385111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.385307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.385428 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.385594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.390849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.390988 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.391243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.391243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.391409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.391499 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.391590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.391684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.391767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.391850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.391932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392103 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392458 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392671 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.392932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393205 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393832 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.393916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.394107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.394245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.394382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.394478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.394563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.394645 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.394776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.394882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.394968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.395098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.395222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.395406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.395511 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.395605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.395812 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.395921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.396059 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.396153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.396246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.396331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.396422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.396513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.396646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.396747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.396832 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.396832 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.397080 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.397174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.397266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.397359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.397444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.397581 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.397668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.397751 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.397846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.397846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398021 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398875 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.398997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.399135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.399329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.399616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.399709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.399953 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.400211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.400320 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.400581 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.400682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.401017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.401122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.401465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.401629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.401838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.401991 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.402164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.402469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.402610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.402804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.410061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.410211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.413866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.413990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.414086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.414235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.414336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.414481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.414584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.414672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.414672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.414828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.414912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.415041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.415151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.415240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.415313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.415442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.415537 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.415638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.415726 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.415817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.415907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416509 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.416952 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417045 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417901 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.417975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.418154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.418274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.418363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.418501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.418597 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.418684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.419023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.419152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.419247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.419353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.419463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.419565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.419652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.419736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.419821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.419923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420885 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.420979 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.421989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.422993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423082 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423786 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.423965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.424059 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.424145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.424255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.424390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.424506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.424635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.424740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.424828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.424923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425251 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425969 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.425969 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.426193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.426280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.426280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.426436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.426508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.426508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.426672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.426766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.426968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.427081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.427081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.427274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.427369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.427444 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.427605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.427605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.427764 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.427921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.428265 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.428958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.429134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.429474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.429628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.429826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.430112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.430227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.430472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.430687 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.430823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.431183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.431282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.431528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.431868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.431976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.432185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.432429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.432524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.432802 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.432989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.433121 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.433471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.433605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.433824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.434074 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.434177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.434470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.434657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.434804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.435010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.435111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.435337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.435443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.435812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.436145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.436303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.436469 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.436607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.436812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.436949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.437135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.437274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.437460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.437660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.437795 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.437929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.438120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.438260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.438443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.438588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.438765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.438902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.439087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.439232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.439432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.439568 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.439751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.439902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.440088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.440234 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.440416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.440567 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.440731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.440876 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.441047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.441192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.441365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.441571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.441744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.441901 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.442037 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.442169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.442358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.442506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.442682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.442829 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.443006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.443141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.443330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.443472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.443646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.443783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.444009 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.444146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.444343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.444481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.444673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.444811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.444994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.445132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.445335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.445466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.445696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.445920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.446072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.446199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.446328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.446476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.446610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 19:41:03.446741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.446965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.447284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.447622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.447958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.448272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.448607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.448935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.449262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.449613 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.449936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.450273 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.450594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.450920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.451240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.451559 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.451883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.452204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.452538 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.452873 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.453209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.453568 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.453926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.454250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.454604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.454943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:41:03.455194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 19:41:03.469017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_db.sqlalchemy.engines [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:41:03.477792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_db.sqlalchemy.engines [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:41:03.552308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.context [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29567de0-b844-4d3a-9dfb-4fa25441a86e(cell1) {{(pid=115679) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 19:41:03.556904 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:03.557468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.context [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29567de0-b844-4d3a-9dfb-4fa25441a86e(cell1) {{(pid=115678) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 19:41:03.558549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:03.559372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:03.561365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:03.561861 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:03.563426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:03.564243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:03.566228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:03.572825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_db.sqlalchemy.engines [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:41:03.574370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_db.sqlalchemy.engines [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:41:03.577519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_db.sqlalchemy.engines [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:41:03.578394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_db.sqlalchemy.engines [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:41:03.840624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_db.sqlalchemy.engines [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:41:03.849799 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_db.sqlalchemy.engines [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:41:04.171792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: WARNING keystonemiddleware.auth_token [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:41:04.175976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: WARNING keystonemiddleware.auth_token [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:41:04.178462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: WARNING keystonemiddleware.auth_token [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:41:04.182910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: WARNING keystonemiddleware.auth_token [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:41:04.528708 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: WARNING keystonemiddleware.auth_token [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:41:04.533819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: WARNING keystonemiddleware.auth_token [None req-f92ac84c-8972-4ddf-ab92-0893c25723b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:41:04.534040 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: WARNING keystonemiddleware.auth_token [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:41:04.539401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: WARNING keystonemiddleware.auth_token [None req-258234d8-7ce3-4617-a519-b8a09bcf4177 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:41:04.539978 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f4858bd9c0 pid: 115678 (default app) Sep 14 19:41:04.544944 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f4858bd9c0 pid: 115679 (default app) Sep 14 19:41:39.250353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f82cf526-f7ab-4712-a634-2a17f382ee38 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] Action: 'create', calling method: .version_select at 0x7fd0c9baaaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-402359377", "metadata": {"Type": "work"}}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:41:39.270432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c596d218-11d0-4a12-a876-b09205834fd9 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Action: 'create', calling method: .version_select at 0x7fd0c9bb09d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-432250367"}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:41:41.222481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f82cf526-f7ab-4712-a634-2a17f382ee38 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.786482 Sep 14 19:41:41.223135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Sep 14 19:41:38 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2789 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 14 19:41:41.237329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bb35ca12-ce63-43f6-a798-5adb2257161b tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] Calling method '.version_select at 0x7fd0c9a75670>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:41.359715 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bb35ca12-ce63-43f6-a798-5adb2257161b tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120" status: 200 len: 352 microversion: 2.1 time: 0.126897 Sep 14 19:41:41.360293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 2/2] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:41 2021] GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120 => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:41:41.732938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-804123555", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "networks": [{"uuid": "3392d884-1e4a-45e2-a264-3258a84cacae"}]}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:41:41.840772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] validate_networks() for [('3392d884-1e4a-45e2-a264-3258a84cacae', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:41:42.115710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c596d218-11d0-4a12-a876-b09205834fd9 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.816870 Sep 14 19:41:42.115710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1155 bytes} [Tue Sep 14 19:41:38 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3819 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 14 19:41:42.422563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-631157844", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "networks": [{"uuid": "dadf8579-8fa0-403c-8ccf-ca6def90a163"}]}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:41:42.535970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.network.neutron [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] validate_networks() for [('dadf8579-8fa0-403c-8ccf-ca6def90a163', None, None, None, None, None)] {{(pid=115678) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:41:43.024964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:41:43.027327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:41:43.028308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:41:43.029211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:41:43.036093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:41:43.056750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:43.057305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:43.058291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:43.058799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:43.099027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Getting quotas for project 6083ffb59ddd45e8a1078199ba5e6d06. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:41:43.107622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Getting quotas for user c6e05c21583f423da79461bcbe98a740 and project 6083ffb59ddd45e8a1078199ba5e6d06. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:41:43.124022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:41:43.127725 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:41:43.341471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-84bd8f8e-b2f3-47e1-8e22-14f95933dcb9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815037 Sep 14 19:41:43.342771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 3/4] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:41:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 19:41:43.355494 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b5dd7cb0-0368-4b33-82cc-dc5f7d025216 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c9186dc0>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:43.490694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b5dd7cb0-0368-4b33-82cc-dc5f7d025216 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21" status: 200 len: 345 microversion: 2.1 time: 0.144887 Sep 14 19:41:43.500509 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 4/5] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:43 2021] GET /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21 => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:43.506370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-adb70a26-4604-42c4-ba0d-8b86f388f6ae tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] Calling method '.version_select at 0x7fd0c9186e50>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:43.596551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-adb70a26-4604-42c4-ba0d-8b86f388f6ae tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120" status: 200 len: 353 microversion: 2.1 time: 0.094224 Sep 14 19:41:43.597442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 5/6] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:43 2021] GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:43.603253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2332e195-5cf7-4496-81c0-1e3e7405ab5d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:43.605240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2332e195-5cf7-4496-81c0-1e3e7405ab5d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:43.728866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2332e195-5cf7-4496-81c0-1e3e7405ab5d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:43.749415 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2332e195-5cf7-4496-81c0-1e3e7405ab5d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1214 microversion: 2.1 time: 0.150846 Sep 14 19:41:43.760925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 6/7] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:43 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:43.767227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f847efc4-c4d8-44ab-adee-cb7524b7d08b tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Action: 'create', calling method: .version_select at 0x7fd0c89259d0>, body: {"snapshot": {"volume_id": "fe42b249-0708-4679-87b1-d7695b887c21", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-605991276"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:41:44.236536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Flavor limits 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:41:44.237048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Image limits 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:41:44.237781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Flavor pref 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:41:44.238659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Image pref 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:41:44.239293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:41:44.262383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:44.263177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:44.264519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:44.265137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:44.313450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Getting quotas for project 627619b6d80a4c4ca01e48750b307056. Resources: {'cores', 'ram', 'instances'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:41:44.322400 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Getting quotas for user 8de96771b60a4d658f0e371f6b695bac and project 627619b6d80a4c4ca01e48750b307056. Resources: {'cores', 'ram', 'instances'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:41:44.353849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Going to run 1 instances... {{(pid=115678) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:41:44.362356 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:41:44.400746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f847efc4-c4d8-44ab-adee-cb7524b7d08b tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.638328 Sep 14 19:41:44.401670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 7/8] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Sep 14 19:41:43 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:44.413691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-77359192-4805-4fef-b65c-ae9e44c2a908 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] Calling method '.version_select at 0x7fd0ca452d30>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:44.509637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-77359192-4805-4fef-b65c-ae9e44c2a908 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120" status: 200 len: 353 microversion: 2.1 time: 0.106925 Sep 14 19:41:44.510215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 8/9] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:44 2021] GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:44.526423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f5de2955-9352-48f6-927e-b30d1545a861 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c8947790>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:44.578587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f5de2955-9352-48f6-927e-b30d1545a861 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595" status: 200 len: 286 microversion: 2.1 time: 0.066548 Sep 14 19:41:44.579625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 9/10] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Sep 14 19:41:44 2021] GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:44.586205 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b838a9b0-ae5d-45c1-b28d-b0b5e19e67fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.472636 Sep 14 19:41:44.593546 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 2/11] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:41:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:41:44.595152 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b1c51f6a-0894-44e3-a612-01e33eb87fcf tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] Calling method '.version_select at 0x7fd0c89503a0>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:44.599497 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a11f9389-4b38-4605-be4b-16ff9ebbd0fc tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c9181e50>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:44.700690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a11f9389-4b38-4605-be4b-16ff9ebbd0fc tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.088951 Sep 14 19:41:44.700690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 3/12] 10.222.0.58 () {58 vars in 1140 bytes} [Tue Sep 14 19:41:44 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:44.700690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4eedf4a2-c57d-4d2d-82c7-c8f04bc3d3bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:44.700690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4eedf4a2-c57d-4d2d-82c7-c8f04bc3d3bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:44.942347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b1c51f6a-0894-44e3-a612-01e33eb87fcf tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120" status: 202 len: 0 microversion: 2.1 time: 0.361462 Sep 14 19:41:44.944115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 10/13] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Sep 14 19:41:44 2021] DELETE /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:41:44.951821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-18ea1d5d-d2a3-497d-8bb3-079ebeb242da tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c8947ee0>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:45.012899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4eedf4a2-c57d-4d2d-82c7-c8f04bc3d3bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:45.045539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4eedf4a2-c57d-4d2d-82c7-c8f04bc3d3bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1217 microversion: 2.1 time: 0.356152 Sep 14 19:41:45.061080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 4/14] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:44 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1217 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:45.075061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-20af4438-0ac8-421c-8e5a-366c345768de tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:45.076345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-20af4438-0ac8-421c-8e5a-366c345768de tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:45.080875 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-18ea1d5d-d2a3-497d-8bb3-079ebeb242da tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595" status: 200 len: 286 microversion: 2.1 time: 0.135632 Sep 14 19:41:45.081457 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 11/15] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Sep 14 19:41:44 2021] GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:45.088849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4add70ed-abaf-4823-8de7-5f677d9cd7a8 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] Calling method '.version_select at 0x7fd0ca452ee0>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:45.196769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4add70ed-abaf-4823-8de7-5f677d9cd7a8 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120" status: 200 len: 352 microversion: 2.1 time: 0.114212 Sep 14 19:41:45.197339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 12/16] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:45 2021] GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:45.273881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-20af4438-0ac8-421c-8e5a-366c345768de tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:45.289158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-20af4438-0ac8-421c-8e5a-366c345768de tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1214 microversion: 2.1 time: 0.232939 Sep 14 19:41:45.294508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 5/17] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:45 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:46.076691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-45b5ee2c-3636-47db-b955-9b12d2be9bd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:46.083957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-45b5ee2c-3636-47db-b955-9b12d2be9bd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:46.097412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a3db0425-4dd3-4051-aa2f-ac1c2bd66d85 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c8941ca0>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:46.226387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a3db0425-4dd3-4051-aa2f-ac1c2bd66d85 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595" status: 200 len: 286 microversion: 2.1 time: 0.136728 Sep 14 19:41:46.228052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 6/18] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Sep 14 19:41:46 2021] GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:46.247770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3036926c-b044-4a33-b702-821b972ba073 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] Calling method '.version_select at 0x7fd0c8952670>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:46.284236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-45b5ee2c-3636-47db-b955-9b12d2be9bd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:46.296354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-45b5ee2c-3636-47db-b955-9b12d2be9bd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1217 microversion: 2.1 time: 0.230717 Sep 14 19:41:46.297590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 13/19] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:46 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:46.308800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-504ed897-af40-4a27-99bc-63f402094e3d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:46.310072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-504ed897-af40-4a27-99bc-63f402094e3d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:46.321174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-504ed897-af40-4a27-99bc-63f402094e3d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:46.323056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-504ed897-af40-4a27-99bc-63f402094e3d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:46.324063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-504ed897-af40-4a27-99bc-63f402094e3d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:46.327930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-504ed897-af40-4a27-99bc-63f402094e3d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:46.459384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3036926c-b044-4a33-b702-821b972ba073 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120" status: 200 len: 352 microversion: 2.1 time: 0.228683 Sep 14 19:41:46.460534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 7/20] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:46 2021] GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120 => generated 352 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:46.615358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-504ed897-af40-4a27-99bc-63f402094e3d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:46.635895 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-504ed897-af40-4a27-99bc-63f402094e3d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1218 microversion: 2.1 time: 0.329917 Sep 14 19:41:46.641650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 14/21] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:46 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1218 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:41:47.238931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-71907556-b388-498d-9702-9eaa5120ee0c tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c8941f70>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:47.270293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-71907556-b388-498d-9702-9eaa5120ee0c tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595" status: 200 len: 286 microversion: 2.1 time: 0.034871 Sep 14 19:41:47.271096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 8/22] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Sep 14 19:41:47 2021] GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:47.322493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-54a8bfd5-2f49-4577-9c69-88b3681dc5d7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:47.323914 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-54a8bfd5-2f49-4577-9c69-88b3681dc5d7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:47.330426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54a8bfd5-2f49-4577-9c69-88b3681dc5d7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:47.334542 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54a8bfd5-2f49-4577-9c69-88b3681dc5d7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:47.334542 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54a8bfd5-2f49-4577-9c69-88b3681dc5d7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:47.334542 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54a8bfd5-2f49-4577-9c69-88b3681dc5d7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:47.453478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-54a8bfd5-2f49-4577-9c69-88b3681dc5d7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:47.464739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-54a8bfd5-2f49-4577-9c69-88b3681dc5d7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1221 microversion: 2.1 time: 0.145031 Sep 14 19:41:47.466256 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 15/23] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:47 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1221 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:47.482503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-07c4ba1a-a02f-4423-af43-e133517e6994 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] Calling method '.version_select at 0x7fd0c91a0670>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:47.559761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-07c4ba1a-a02f-4423-af43-e133517e6994 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120" status: 200 len: 352 microversion: 2.1 time: 0.080671 Sep 14 19:41:47.560765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 9/24] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:47 2021] GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120 => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:47.658515 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ecde86ac-3e98-4289-8e96-3f504e0025fd tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:47.659153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ecde86ac-3e98-4289-8e96-3f504e0025fd tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:47.670486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecde86ac-3e98-4289-8e96-3f504e0025fd tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:47.670946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecde86ac-3e98-4289-8e96-3f504e0025fd tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:47.671755 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecde86ac-3e98-4289-8e96-3f504e0025fd tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:47.672198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecde86ac-3e98-4289-8e96-3f504e0025fd tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:47.798608 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ecde86ac-3e98-4289-8e96-3f504e0025fd tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:47.808745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ecde86ac-3e98-4289-8e96-3f504e0025fd tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1218 microversion: 2.1 time: 0.159385 Sep 14 19:41:47.810541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 16/25] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:47 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:48.282756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a8053bd1-25ec-49ba-9832-b4f42584a047 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c8952c10>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:48.345484 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a8053bd1-25ec-49ba-9832-b4f42584a047 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595" status: 200 len: 287 microversion: 2.1 time: 0.066507 Sep 14 19:41:48.346528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 10/26] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Sep 14 19:41:48 2021] GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:48.364523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5ba3723a-ebec-4657-866f-be8a79284c3c tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c887f940>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:48.482945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ea8dc809-5809-4b7a-8dd1-7dddc9939893 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:48.484096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ea8dc809-5809-4b7a-8dd1-7dddc9939893 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:48.493055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea8dc809-5809-4b7a-8dd1-7dddc9939893 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:48.496960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea8dc809-5809-4b7a-8dd1-7dddc9939893 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:48.501593 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea8dc809-5809-4b7a-8dd1-7dddc9939893 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:48.510250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea8dc809-5809-4b7a-8dd1-7dddc9939893 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:48.582846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5ba3723a-ebec-4657-866f-be8a79284c3c tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595" status: 202 len: 0 microversion: 2.1 time: 0.218464 Sep 14 19:41:48.582846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 17/27] 10.222.0.58 () {58 vars in 1254 bytes} [Tue Sep 14 19:41:48 2021] DELETE /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:41:48.585116 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5d5562bc-a1d0-4b2d-9246-7ac644d13d34 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] Calling method '.version_select at 0x7fd0c88c64c0>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:48.639930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-5d5562bc-a1d0-4b2d-9246-7ac644d13d34 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] HTTP exception thrown: Volume e299a27b-4b99-4a96-ac0c-91f64d584120 could not be found. Sep 14 19:41:48.640718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5d5562bc-a1d0-4b2d-9246-7ac644d13d34 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] Returning 404 to user: Volume e299a27b-4b99-4a96-ac0c-91f64d584120 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:41:48.641767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5d5562bc-a1d0-4b2d-9246-7ac644d13d34 tempest-VolumesGetTestJSON-2108679451 tempest-VolumesGetTestJSON-2108679451-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120" status: 404 len: 109 microversion: 2.1 time: 0.061031 Sep 14 19:41:48.645259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 18/28] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:48 2021] GET /compute/v2.1/os-volumes/e299a27b-4b99-4a96-ac0c-91f64d584120 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:41:48.657402 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-caf10735-87b9-4d17-87d8-5fa00f5083d0 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c89258b0>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:48.704667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-caf10735-87b9-4d17-87d8-5fa00f5083d0 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595" status: 200 len: 286 microversion: 2.1 time: 0.057839 Sep 14 19:41:48.705174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 19/29] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Sep 14 19:41:48 2021] GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:48.831527 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c66f14fc-9750-48dd-81df-fb818aef10ba tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:48.834071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c66f14fc-9750-48dd-81df-fb818aef10ba tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:48.846954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c66f14fc-9750-48dd-81df-fb818aef10ba tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:48.851312 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c66f14fc-9750-48dd-81df-fb818aef10ba tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:48.851312 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c66f14fc-9750-48dd-81df-fb818aef10ba tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:48.851312 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c66f14fc-9750-48dd-81df-fb818aef10ba tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:48.934730 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ea8dc809-5809-4b7a-8dd1-7dddc9939893 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:48.951569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ea8dc809-5809-4b7a-8dd1-7dddc9939893 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1221 microversion: 2.1 time: 0.472123 Sep 14 19:41:48.957132 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 11/30] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:48 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1221 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:49.107137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c66f14fc-9750-48dd-81df-fb818aef10ba tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:49.115030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c66f14fc-9750-48dd-81df-fb818aef10ba tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1210 microversion: 2.1 time: 0.292641 Sep 14 19:41:49.115732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 20/31] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:48 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1210 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:41:49.718741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-839d3c6a-1393-4f8c-8a5a-5b8ecab74b1c tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c88c10d0>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:49.780719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-839d3c6a-1393-4f8c-8a5a-5b8ecab74b1c tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] HTTP exception thrown: Snapshot 1270c7f7-ad9e-49a6-979f-2ea954018595 could not be found. Sep 14 19:41:49.782643 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-839d3c6a-1393-4f8c-8a5a-5b8ecab74b1c tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Returning 404 to user: Snapshot 1270c7f7-ad9e-49a6-979f-2ea954018595 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:41:49.789777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-839d3c6a-1393-4f8c-8a5a-5b8ecab74b1c tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595" status: 404 len: 111 microversion: 2.1 time: 0.071000 Sep 14 19:41:49.789777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 12/32] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Sep 14 19:41:49 2021] GET /compute/v2.1/os-snapshots/1270c7f7-ad9e-49a6-979f-2ea954018595 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:41:49.800994 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-07aaef2e-8930-4aee-81d6-766551358a08 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c8887ee0>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:49.982438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4b98f53a-a482-4172-b052-288fd246d6b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:49.983501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4b98f53a-a482-4172-b052-288fd246d6b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:49.993242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b98f53a-a482-4172-b052-288fd246d6b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:49.994240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b98f53a-a482-4172-b052-288fd246d6b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:49.995274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b98f53a-a482-4172-b052-288fd246d6b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:49.996401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b98f53a-a482-4172-b052-288fd246d6b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:50.130123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-07aaef2e-8930-4aee-81d6-766551358a08 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21" status: 202 len: 0 microversion: 2.1 time: 0.338849 Sep 14 19:41:50.131396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 21/33] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Sep 14 19:41:49 2021] DELETE /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:41:50.136390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-baca86d7-c7ed-4eda-8de9-8d8356b91c3b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:50.137739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-baca86d7-c7ed-4eda-8de9-8d8356b91c3b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:50.167970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-baca86d7-c7ed-4eda-8de9-8d8356b91c3b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:50.172834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-baca86d7-c7ed-4eda-8de9-8d8356b91c3b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:50.191458 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-baca86d7-c7ed-4eda-8de9-8d8356b91c3b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:50.194387 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-baca86d7-c7ed-4eda-8de9-8d8356b91c3b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:50.462153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-baca86d7-c7ed-4eda-8de9-8d8356b91c3b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:50.478327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-baca86d7-c7ed-4eda-8de9-8d8356b91c3b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1210 microversion: 2.1 time: 0.345461 Sep 14 19:41:50.479594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 22/34] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:50 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1210 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:50.491437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-93aeb74f-3f6e-44b4-8448-2cd4c94981fa tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c8887e50>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:50.520284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4b98f53a-a482-4172-b052-288fd246d6b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:50.534908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4b98f53a-a482-4172-b052-288fd246d6b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1269 microversion: 2.1 time: 0.564722 Sep 14 19:41:50.548683 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 13/35] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:49 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1269 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:50.580481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-93aeb74f-3f6e-44b4-8448-2cd4c94981fa tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21" status: 200 len: 344 microversion: 2.1 time: 0.099586 Sep 14 19:41:50.581061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 23/36] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:50 2021] GET /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21 => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:41:51.496043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-96fe62f7-17de-467e-99c6-3c8ade0abc36 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:51.497312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-96fe62f7-17de-467e-99c6-3c8ade0abc36 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:51.512604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-96fe62f7-17de-467e-99c6-3c8ade0abc36 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:51.516319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-96fe62f7-17de-467e-99c6-3c8ade0abc36 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:51.516319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-96fe62f7-17de-467e-99c6-3c8ade0abc36 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:51.516319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-96fe62f7-17de-467e-99c6-3c8ade0abc36 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:51.564939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d9b30409-4f81-404c-bb6b-9c897d42a327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:51.566523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d9b30409-4f81-404c-bb6b-9c897d42a327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:51.580149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9b30409-4f81-404c-bb6b-9c897d42a327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:51.583904 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9b30409-4f81-404c-bb6b-9c897d42a327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:51.588616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9b30409-4f81-404c-bb6b-9c897d42a327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:51.595442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9b30409-4f81-404c-bb6b-9c897d42a327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:51.709407 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-96fe62f7-17de-467e-99c6-3c8ade0abc36 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:51.725105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-96fe62f7-17de-467e-99c6-3c8ade0abc36 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1284 microversion: 2.1 time: 0.232698 Sep 14 19:41:51.736157 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 14/37] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:51 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:51.744704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9907a793-114b-4b51-9de7-b4c10a3d4fe6 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c88a08b0>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:51.796688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d9b30409-4f81-404c-bb6b-9c897d42a327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:51.820958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d9b30409-4f81-404c-bb6b-9c897d42a327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1275 microversion: 2.1 time: 0.256186 Sep 14 19:41:51.820958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 24/38] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:51 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:41:51.856431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-9907a793-114b-4b51-9de7-b4c10a3d4fe6 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] HTTP exception thrown: Volume fe42b249-0708-4679-87b1-d7695b887c21 could not be found. Sep 14 19:41:51.856982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9907a793-114b-4b51-9de7-b4c10a3d4fe6 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Returning 404 to user: Volume fe42b249-0708-4679-87b1-d7695b887c21 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:41:51.858523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9907a793-114b-4b51-9de7-b4c10a3d4fe6 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21" status: 404 len: 109 microversion: 2.1 time: 0.121016 Sep 14 19:41:51.859127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 15/39] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:51 2021] GET /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:41:51.869283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-68584122-cd6c-41c6-8865-71be73d009d0 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c8898c10>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:51.931025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-68584122-cd6c-41c6-8865-71be73d009d0 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] HTTP exception thrown: Volume fe42b249-0708-4679-87b1-d7695b887c21 could not be found. Sep 14 19:41:51.932260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-68584122-cd6c-41c6-8865-71be73d009d0 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Returning 404 to user: Volume fe42b249-0708-4679-87b1-d7695b887c21 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:41:51.933105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-68584122-cd6c-41c6-8865-71be73d009d0 tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21" status: 404 len: 109 microversion: 2.1 time: 0.067896 Sep 14 19:41:51.934795 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 25/40] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Sep 14 19:41:51 2021] DELETE /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:41:51.944065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0390fa7e-ee12-40ef-aaa6-b4d86b85c8bd tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Calling method '.version_select at 0x7fd0c88cb430>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:52.011382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-0390fa7e-ee12-40ef-aaa6-b4d86b85c8bd tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] HTTP exception thrown: Volume fe42b249-0708-4679-87b1-d7695b887c21 could not be found. Sep 14 19:41:52.015167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0390fa7e-ee12-40ef-aaa6-b4d86b85c8bd tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] Returning 404 to user: Volume fe42b249-0708-4679-87b1-d7695b887c21 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:41:52.015167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0390fa7e-ee12-40ef-aaa6-b4d86b85c8bd tempest-VolumesSnapshotsTestJSON-89922596 tempest-VolumesSnapshotsTestJSON-89922596-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21" status: 404 len: 109 microversion: 2.1 time: 0.073721 Sep 14 19:41:52.018426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 16/41] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:41:51 2021] GET /compute/v2.1/os-volumes/fe42b249-0708-4679-87b1-d7695b887c21 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:41:52.747575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-49cc235e-3339-4dc3-b0f1-01f17750699e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:52.748215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-49cc235e-3339-4dc3-b0f1-01f17750699e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:52.763357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49cc235e-3339-4dc3-b0f1-01f17750699e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:52.764080 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49cc235e-3339-4dc3-b0f1-01f17750699e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:52.765227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49cc235e-3339-4dc3-b0f1-01f17750699e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:52.765879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49cc235e-3339-4dc3-b0f1-01f17750699e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:52.836302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8f30bfba-b925-45fc-8d34-ae590b1eeb0b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:52.837601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8f30bfba-b925-45fc-8d34-ae590b1eeb0b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:52.848069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f30bfba-b925-45fc-8d34-ae590b1eeb0b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:52.851584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f30bfba-b925-45fc-8d34-ae590b1eeb0b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:52.852703 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f30bfba-b925-45fc-8d34-ae590b1eeb0b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:52.854444 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f30bfba-b925-45fc-8d34-ae590b1eeb0b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:52.976769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-49cc235e-3339-4dc3-b0f1-01f17750699e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:52.988646 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-49cc235e-3339-4dc3-b0f1-01f17750699e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1272 microversion: 2.1 time: 0.249583 Sep 14 19:41:52.989832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 26/42] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:52 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:53.272169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8f30bfba-b925-45fc-8d34-ae590b1eeb0b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:53.288513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8f30bfba-b925-45fc-8d34-ae590b1eeb0b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.456032 Sep 14 19:41:53.304737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 17/43] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:52 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:41:53.948636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1496055422", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c509c564-72a4-4d6c-9c18-d366d0b4f420"}]}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:41:54.045721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8df99436-4a34-4965-9346-8a3b600fe020 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'create', calling method: .version_select at 0x7fd0c9194d30>, body: {"keypair": {"name": "tempest-keypair-316047328"}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:41:54.091016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] validate_networks() for [('c509c564-72a4-4d6c-9c18-d366d0b4f420', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:41:54.176438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-8df99436-4a34-4965-9346-8a3b600fe020 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for project bbba3e0792bf41beb30a9f910ff28269. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:41:54.189743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-8df99436-4a34-4965-9346-8a3b600fe020 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for user 732d822c6c8141c8a51dd509cf560da0 and project bbba3e0792bf41beb30a9f910ff28269. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:41:54.781107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-8df99436-4a34-4965-9346-8a3b600fe020 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for project bbba3e0792bf41beb30a9f910ff28269. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:41:54.786827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-8df99436-4a34-4965-9346-8a3b600fe020 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for user 732d822c6c8141c8a51dd509cf560da0 and project bbba3e0792bf41beb30a9f910ff28269. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:41:54.804256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8df99436-4a34-4965-9346-8a3b600fe020 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.387936 Sep 14 19:41:54.814143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 18/44] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Sep 14 19:41:53 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1399 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Sep 14 19:41:54.820395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f50369df-8f65-46d5-a662-e32b5b806196 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:54.821235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f50369df-8f65-46d5-a662-e32b5b806196 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:54.829384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f50369df-8f65-46d5-a662-e32b5b806196 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:54.832149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f50369df-8f65-46d5-a662-e32b5b806196 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:54.832149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f50369df-8f65-46d5-a662-e32b5b806196 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:54.832149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f50369df-8f65-46d5-a662-e32b5b806196 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:55.315195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f50369df-8f65-46d5-a662-e32b5b806196 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:55.332316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f50369df-8f65-46d5-a662-e32b5b806196 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.516800 Sep 14 19:41:55.336696 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 19/45] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:54 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:55.346350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-eaa91fe1-dd77-4783-8dbb-dcc3b4184650 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:55.355351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-eaa91fe1-dd77-4783-8dbb-dcc3b4184650 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:55.370856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaa91fe1-dd77-4783-8dbb-dcc3b4184650 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:55.371557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaa91fe1-dd77-4783-8dbb-dcc3b4184650 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:55.372534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaa91fe1-dd77-4783-8dbb-dcc3b4184650 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:55.373170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaa91fe1-dd77-4783-8dbb-dcc3b4184650 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:55.583562 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-eaa91fe1-dd77-4783-8dbb-dcc3b4184650 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:55.594774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-eaa91fe1-dd77-4783-8dbb-dcc3b4184650 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.255302 Sep 14 19:41:55.596041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 20/46] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:55 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:56.357679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-19300aac-3ec7-4a3d-81f8-65b4c2390091 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:56.360066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-19300aac-3ec7-4a3d-81f8-65b4c2390091 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:56.382207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-19300aac-3ec7-4a3d-81f8-65b4c2390091 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:56.385460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-19300aac-3ec7-4a3d-81f8-65b4c2390091 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:56.392716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-19300aac-3ec7-4a3d-81f8-65b4c2390091 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:56.396227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-19300aac-3ec7-4a3d-81f8-65b4c2390091 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:56.884454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-19300aac-3ec7-4a3d-81f8-65b4c2390091 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:56.901966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-19300aac-3ec7-4a3d-81f8-65b4c2390091 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.552106 Sep 14 19:41:56.913469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 21/47] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:56 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:56.923219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5294e95f-f8a4-4b51-b217-3a5293b6ca17 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:56.926112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5294e95f-f8a4-4b51-b217-3a5293b6ca17 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:56.943408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5294e95f-f8a4-4b51-b217-3a5293b6ca17 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:56.944109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5294e95f-f8a4-4b51-b217-3a5293b6ca17 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:56.946859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5294e95f-f8a4-4b51-b217-3a5293b6ca17 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:56.948808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5294e95f-f8a4-4b51-b217-3a5293b6ca17 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:57.194128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5294e95f-f8a4-4b51-b217-3a5293b6ca17 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:57.203405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5294e95f-f8a4-4b51-b217-3a5293b6ca17 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.288394 Sep 14 19:41:57.204254 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 22/48] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:56 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:57.924814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:41:57.925436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:41:57.926446 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:41:57.926881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:41:57.927342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:41:57.928558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-73f1e3c9-49c3-414c-b06e-2c772d3c1119 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:57.934964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-73f1e3c9-49c3-414c-b06e-2c772d3c1119 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:57.961327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-73f1e3c9-49c3-414c-b06e-2c772d3c1119 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:57.962632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-73f1e3c9-49c3-414c-b06e-2c772d3c1119 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:57.964547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:57.965242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-73f1e3c9-49c3-414c-b06e-2c772d3c1119 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:57.970456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-73f1e3c9-49c3-414c-b06e-2c772d3c1119 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:57.971769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:57.976867 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:57.979411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:58.052748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Getting quotas for project 8bbe7998841742abab1d80b084f6be1c. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:41:58.069324 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Getting quotas for user 1a700c999f2d4e79a1172c08f2cd49a9 and project 8bbe7998841742abab1d80b084f6be1c. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:41:58.110943 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:41:58.113159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:41:58.451275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-73f1e3c9-49c3-414c-b06e-2c772d3c1119 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:58.466061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-73f1e3c9-49c3-414c-b06e-2c772d3c1119 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.547186 Sep 14 19:41:58.478230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 23/49] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:57 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:41:58.487896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7e91a43c-96f1-4e95-b608-5536ea1c46c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:58.490158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7e91a43c-96f1-4e95-b608-5536ea1c46c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:58.511582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e91a43c-96f1-4e95-b608-5536ea1c46c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:58.516327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e91a43c-96f1-4e95-b608-5536ea1c46c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:58.519094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e91a43c-96f1-4e95-b608-5536ea1c46c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:58.520115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e91a43c-96f1-4e95-b608-5536ea1c46c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:58.608213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-12bb3cd2-5785-4184-937d-0fb22e88c559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.404812 Sep 14 19:41:58.611434 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 27/50] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:41:53 2021] POST /compute/v2.1/servers => generated 383 bytes in 5412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:41:58.624698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4519eb27-41de-4030-877d-57efecf5f947 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:58.625725 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4519eb27-41de-4030-877d-57efecf5f947 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:58.751890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4519eb27-41de-4030-877d-57efecf5f947 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:58.761781 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4519eb27-41de-4030-877d-57efecf5f947 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1222 microversion: 2.1 time: 0.140876 Sep 14 19:41:58.762355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 28/51] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:58 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:41:59.031993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1658211876", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c509c564-72a4-4d6c-9c18-d366d0b4f420"}]}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:41:59.141060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] validate_networks() for [('c509c564-72a4-4d6c-9c18-d366d0b4f420', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:41:59.222915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7e91a43c-96f1-4e95-b608-5536ea1c46c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:59.246062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7e91a43c-96f1-4e95-b608-5536ea1c46c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.764971 Sep 14 19:41:59.249483 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 24/52] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:58 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:41:59.488503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ce26c250-871b-4ec8-9a9a-b7481243c15c tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:41:59.489777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ce26c250-871b-4ec8-9a9a-b7481243c15c tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:41:59.513958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce26c250-871b-4ec8-9a9a-b7481243c15c tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:59.514581 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce26c250-871b-4ec8-9a9a-b7481243c15c tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:59.523389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce26c250-871b-4ec8-9a9a-b7481243c15c tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:41:59.524123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce26c250-871b-4ec8-9a9a-b7481243c15c tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:41:59.887763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ce26c250-871b-4ec8-9a9a-b7481243c15c tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:41:59.897777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ce26c250-871b-4ec8-9a9a-b7481243c15c tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.416507 Sep 14 19:41:59.901439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 25/53] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:41:59 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:00.205372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-7ea4cd3e-5b9e-4e07-936a-d85644c8895d req-01663b98-5702-4484-a794-a796fec14e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d23b109a-dab1-48fd-b306-2d1c00fdeb0d", "tag": "d7f50ba9-6855-4fe4-865c-864b6863e673"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:00.210576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:00.210576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:42:00.241659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:42:00.242150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:42:00.242567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:42:00.243015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:42:00.243440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:42:00.243693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-7ea4cd3e-5b9e-4e07-936a-d85644c8895d req-01663b98-5702-4484-a794-a796fec14e0e service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:00.244110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-7ea4cd3e-5b9e-4e07-936a-d85644c8895d req-01663b98-5702-4484-a794-a796fec14e0e service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:00.258865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:00.259323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:00.260145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:00.260590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:00.285060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Getting quotas for project 8bbe7998841742abab1d80b084f6be1c. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:42:00.290206 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Getting quotas for user 1a700c999f2d4e79a1172c08f2cd49a9 and project 8bbe7998841742abab1d80b084f6be1c. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:42:00.307523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:42:00.310349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:42:00.317281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-7ea4cd3e-5b9e-4e07-936a-d85644c8895d req-01663b98-5702-4484-a794-a796fec14e0e service nova] Creating event network-changed:d7f50ba9-6855-4fe4-865c-864b6863e673 for instance d23b109a-dab1-48fd-b306-2d1c00fdeb0d on hv-cinder-80588 Sep 14 19:42:00.321511 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-7ea4cd3e-5b9e-4e07-936a-d85644c8895d req-01663b98-5702-4484-a794-a796fec14e0e service nova] Acquired lock "compute-rpcapi-router" {{(pid=115678) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 14 19:42:00.322706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0eb7675-b7e8-49c1-8a61-cdac22e4d142 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:00.323162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0eb7675-b7e8-49c1-8a61-cdac22e4d142 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:00.328327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0eb7675-b7e8-49c1-8a61-cdac22e4d142 None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:00.329990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0eb7675-b7e8-49c1-8a61-cdac22e4d142 None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:00.352883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.compute.rpcapi [None req-f0eb7675-b7e8-49c1-8a61-cdac22e4d142 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 14 19:42:00.357081 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0eb7675-b7e8-49c1-8a61-cdac22e4d142 None None] Releasing lock "compute-rpcapi-router" {{(pid=115678) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 14 19:42:00.390747 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f0eb7675-b7e8-49c1-8a61-cdac22e4d142 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490520 Sep 14 19:42:00.391281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 26/54] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:41:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:42:00.399946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-350fd1d2-1e23-423a-9753-22595a9b28d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:00.405314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-350fd1d2-1e23-423a-9753-22595a9b28d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:00.421468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-350fd1d2-1e23-423a-9753-22595a9b28d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:00.422281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-350fd1d2-1e23-423a-9753-22595a9b28d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:00.423377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-350fd1d2-1e23-423a-9753-22595a9b28d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:00.424579 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-350fd1d2-1e23-423a-9753-22595a9b28d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:00.493046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f6776b9d-6ced-4817-b0ab-2a69dc1c21d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.464690 Sep 14 19:42:00.499506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 29/55] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:41:59 2021] POST /compute/v2.1/servers => generated 383 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:42:00.510455 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dd978a85-1c7c-4f89-9b95-ebe3525f0a28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:00.511335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dd978a85-1c7c-4f89-9b95-ebe3525f0a28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:00.619443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dd978a85-1c7c-4f89-9b95-ebe3525f0a28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:00.627772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dd978a85-1c7c-4f89-9b95-ebe3525f0a28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1222 microversion: 2.1 time: 0.125384 Sep 14 19:42:00.628796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 30/56] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:00 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:00.681156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-350fd1d2-1e23-423a-9753-22595a9b28d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:00.700578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-350fd1d2-1e23-423a-9753-22595a9b28d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.308056 Sep 14 19:42:00.702425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 27/57] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:00 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:00.865341 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6b76ce8a-ac2b-4f0f-9088-a6c5652d923e tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Action: 'create', calling method: .version_select at 0x7fd0c88a25e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1739794678", "metadata": {"Type": "work"}}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:00.867195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6b76ce8a-ac2b-4f0f-9088-a6c5652d923e tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:42:00.867821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6b76ce8a-ac2b-4f0f-9088-a6c5652d923e tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.129584 Sep 14 19:42:00.868379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 31/58] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Sep 14 19:42:00 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 19:42:00.881430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-683b891d-ed5c-406f-9fba-a2652c55a855 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Action: 'create', calling method: .version_select at 0x7fd0c88cbee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-6789556", "metadata": {"Type": "work"}}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:00.882939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-683b891d-ed5c-406f-9fba-a2652c55a855 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:42:00.883900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-683b891d-ed5c-406f-9fba-a2652c55a855 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007271 Sep 14 19:42:00.889648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 28/59] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Sep 14 19:42:00 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 19:42:00.898814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-39019d53-d571-4471-a0f1-acff3a6cc68d tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Action: 'create', calling method: .version_select at 0x7fd0c9a033a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-413772938", "metadata": {"Type": "work"}}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:00.899923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-39019d53-d571-4471-a0f1-acff3a6cc68d tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:42:00.900751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-39019d53-d571-4471-a0f1-acff3a6cc68d tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007415 Sep 14 19:42:00.901271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 32/60] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Sep 14 19:42:00 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 19:42:00.910001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2559d198-724f-47f2-9c4b-51c7420381f8 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Calling method '.version_select at 0x7fd0c88a0160>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:00.920098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d558cc10-a19a-47ae-a2f2-98022106a3ca tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:00.920657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d558cc10-a19a-47ae-a2f2-98022106a3ca tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:00.927292 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d558cc10-a19a-47ae-a2f2-98022106a3ca tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:00.927998 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d558cc10-a19a-47ae-a2f2-98022106a3ca tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:00.928920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d558cc10-a19a-47ae-a2f2-98022106a3ca tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:00.929515 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d558cc10-a19a-47ae-a2f2-98022106a3ca tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:00.965805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-2559d198-724f-47f2-9c4b-51c7420381f8 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] HTTP exception thrown: Volume tempest-invalid-1538511851 could not be found. Sep 14 19:42:00.966673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2559d198-724f-47f2-9c4b-51c7420381f8 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Returning 404 to user: Volume tempest-invalid-1538511851 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:42:00.967728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2559d198-724f-47f2-9c4b-51c7420381f8 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1538511851" status: 404 len: 99 microversion: 2.1 time: 0.061307 Sep 14 19:42:00.968755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 29/61] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Sep 14 19:42:00 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1538511851 => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 19:42:00.978665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bdafba83-03a4-478f-bb41-ca2aa31b4c5c tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003881 Sep 14 19:42:00.980022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 30/62] 10.222.0.58 () {58 vars in 1140 bytes} [Tue Sep 14 19:42:00 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 14 19:42:01.012149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5b651a57-0337-4cba-ade5-386c34443e90 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008021 Sep 14 19:42:01.016383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 31/63] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Sep 14 19:42:01 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 19:42:01.033111 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-413652de-19f5-4256-a7cf-0219f5148b92 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Calling method '.version_select at 0x7fd0c91a0670>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:01.078448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-413652de-19f5-4256-a7cf-0219f5148b92 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] HTTP exception thrown: Volume 834a56dd-8376-493d-8fd5-0f53c39a4126 could not be found. Sep 14 19:42:01.079489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-413652de-19f5-4256-a7cf-0219f5148b92 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Returning 404 to user: Volume 834a56dd-8376-493d-8fd5-0f53c39a4126 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:42:01.080844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-413652de-19f5-4256-a7cf-0219f5148b92 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/834a56dd-8376-493d-8fd5-0f53c39a4126" status: 404 len: 109 microversion: 2.1 time: 0.058820 Sep 14 19:42:01.081644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 32/64] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Sep 14 19:42:01 2021] DELETE /compute/v2.1/os-volumes/834a56dd-8376-493d-8fd5-0f53c39a4126 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 19:42:01.094608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d16ca0b9-f133-4d9b-98b2-67dc33cbaa34 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Calling method '.version_select at 0x7fd0c91a0670>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:01.139985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-d16ca0b9-f133-4d9b-98b2-67dc33cbaa34 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] HTTP exception thrown: Volume f4af77af-65f7-4a72-b5c1-72cacc9e78df could not be found. Sep 14 19:42:01.140831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d16ca0b9-f133-4d9b-98b2-67dc33cbaa34 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] Returning 404 to user: Volume f4af77af-65f7-4a72-b5c1-72cacc9e78df could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:42:01.141870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d16ca0b9-f133-4d9b-98b2-67dc33cbaa34 tempest-VolumesNegativeTest-1300663122 tempest-VolumesNegativeTest-1300663122-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/f4af77af-65f7-4a72-b5c1-72cacc9e78df" status: 404 len: 109 microversion: 2.1 time: 0.054664 Sep 14 19:42:01.142702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 33/65] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 19:42:01 2021] GET /compute/v2.1/os-volumes/f4af77af-65f7-4a72-b5c1-72cacc9e78df => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 19:42:01.214728 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d558cc10-a19a-47ae-a2f2-98022106a3ca tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:01.231605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d558cc10-a19a-47ae-a2f2-98022106a3ca tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.306803 Sep 14 19:42:01.231605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 33/66] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:00 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:01.646425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cbc5b3a9-5ed8-44ca-a02d-c3f29e6a827c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:01.647816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cbc5b3a9-5ed8-44ca-a02d-c3f29e6a827c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:01.716672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-79eb2f4e-b311-4104-abb6-1f956b1932d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:01.717276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-79eb2f4e-b311-4104-abb6-1f956b1932d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:01.719777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cbc5b3a9-5ed8-44ca-a02d-c3f29e6a827c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:01.727256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cbc5b3a9-5ed8-44ca-a02d-c3f29e6a827c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1222 microversion: 2.1 time: 0.085414 Sep 14 19:42:01.732939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79eb2f4e-b311-4104-abb6-1f956b1932d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:01.732939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79eb2f4e-b311-4104-abb6-1f956b1932d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:01.733131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 34/67] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:01 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:01.733216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79eb2f4e-b311-4104-abb6-1f956b1932d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:01.733216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79eb2f4e-b311-4104-abb6-1f956b1932d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:01.870949 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-79eb2f4e-b311-4104-abb6-1f956b1932d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:01.878916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-79eb2f4e-b311-4104-abb6-1f956b1932d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.165757 Sep 14 19:42:01.880294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 34/68] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:01 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:02.252443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c921f3ae-fad8-45cc-a5e7-b569f9d0f131 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:02.253362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c921f3ae-fad8-45cc-a5e7-b569f9d0f131 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:02.260581 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c921f3ae-fad8-45cc-a5e7-b569f9d0f131 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:02.264667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c921f3ae-fad8-45cc-a5e7-b569f9d0f131 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:02.266543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c921f3ae-fad8-45cc-a5e7-b569f9d0f131 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:02.270199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c921f3ae-fad8-45cc-a5e7-b569f9d0f131 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:02.401846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-685176903", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6be650c3-02d9-4d68-9d35-6f57841ba148"}], "security_groups": [{"name": "tempest-securitygroup--229379741"}], "key_name": "tempest-keypair-316047328", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:02.504468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c921f3ae-fad8-45cc-a5e7-b569f9d0f131 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:02.518741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] validate_networks() for [('6be650c3-02d9-4d68-9d35-6f57841ba148', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:42:02.526803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c921f3ae-fad8-45cc-a5e7-b569f9d0f131 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.282455 Sep 14 19:42:02.527391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 35/69] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:02 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:02.532899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-3f4bc70f-3253-4f62-b365-5321670963cb req-bbb5bedf-3d20-41f5-84c6-4167aae86eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea", "tag": "7b992f7d-a9b4-4b25-b967-bcf20c9cd38a"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:02.539327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:02.539327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:42:02.548244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-3f4bc70f-3253-4f62-b365-5321670963cb req-bbb5bedf-3d20-41f5-84c6-4167aae86eb2 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:02.548792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-3f4bc70f-3253-4f62-b365-5321670963cb req-bbb5bedf-3d20-41f5-84c6-4167aae86eb2 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:02.564666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-3f4bc70f-3253-4f62-b365-5321670963cb req-bbb5bedf-3d20-41f5-84c6-4167aae86eb2 service nova] Creating event network-changed:7b992f7d-a9b4-4b25-b967-bcf20c9cd38a for instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea on hv-cinder-80588 Sep 14 19:42:02.579651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-3f4bc70f-3253-4f62-b365-5321670963cb req-bbb5bedf-3d20-41f5-84c6-4167aae86eb2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049902 Sep 14 19:42:02.584173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 36/70] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:42:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:42:02.747747 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9fc5abae-21cc-454d-971f-91f603aa905e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:02.748630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9fc5abae-21cc-454d-971f-91f603aa905e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:02.755577 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fc5abae-21cc-454d-971f-91f603aa905e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:02.755971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fc5abae-21cc-454d-971f-91f603aa905e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:02.759802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fc5abae-21cc-454d-971f-91f603aa905e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:02.759802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fc5abae-21cc-454d-971f-91f603aa905e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:02.906833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9fc5abae-21cc-454d-971f-91f603aa905e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:02.922918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9fc5abae-21cc-454d-971f-91f603aa905e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1226 microversion: 2.1 time: 0.172852 Sep 14 19:42:02.922918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 37/71] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:02 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:02.947038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0035062f-f8a3-4607-b2cd-eedc9813d6c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:02.957293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0035062f-f8a3-4607-b2cd-eedc9813d6c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:03.100449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0035062f-f8a3-4607-b2cd-eedc9813d6c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:03.100449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0035062f-f8a3-4607-b2cd-eedc9813d6c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:03.100449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0035062f-f8a3-4607-b2cd-eedc9813d6c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:03.100449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0035062f-f8a3-4607-b2cd-eedc9813d6c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:03.129309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0035062f-f8a3-4607-b2cd-eedc9813d6c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:03.146583 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:42:03.149471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:42:03.150983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:42:03.151871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:42:03.152380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:42:03.161857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0035062f-f8a3-4607-b2cd-eedc9813d6c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.233360 Sep 14 19:42:03.163221 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 38/72] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:02 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:03.164688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:03.165141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:03.165995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:03.166478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:03.185223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for project bbba3e0792bf41beb30a9f910ff28269. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:42:03.189191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for user 732d822c6c8141c8a51dd509cf560da0 and project bbba3e0792bf41beb30a9f910ff28269. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:42:03.201058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:42:03.203374 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:42:03.544174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-68104a4b-7512-410b-8e5d-8066db5470b4 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:03.545747 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-68104a4b-7512-410b-8e5d-8066db5470b4 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:03.557807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0c8131b2-396f-41b3-a198-901d9a99584a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.160780 Sep 14 19:42:03.561211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68104a4b-7512-410b-8e5d-8066db5470b4 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:03.562473 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 35/73] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Sep 14 19:42:02 2021] POST /compute/v2.1/servers => generated 401 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 14 19:42:03.565603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68104a4b-7512-410b-8e5d-8066db5470b4 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:03.565603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68104a4b-7512-410b-8e5d-8066db5470b4 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:03.565603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68104a4b-7512-410b-8e5d-8066db5470b4 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:03.586149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5af89795-a74a-4fd2-8570-1dc837a5e0e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:03.586831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5af89795-a74a-4fd2-8570-1dc837a5e0e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:03.687673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5af89795-a74a-4fd2-8570-1dc837a5e0e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:03.702706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5af89795-a74a-4fd2-8570-1dc837a5e0e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:03.704029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5af89795-a74a-4fd2-8570-1dc837a5e0e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:03.705151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5af89795-a74a-4fd2-8570-1dc837a5e0e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1280 microversion: 2.20 time: 0.134693 Sep 14 19:42:03.720178 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 36/74] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1280 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:42:03.887521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-68104a4b-7512-410b-8e5d-8066db5470b4 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:03.957294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-68104a4b-7512-410b-8e5d-8066db5470b4 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.356581 Sep 14 19:42:03.957294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 39/75] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:03 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:03.957864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fa304865-a737-4311-a713-2464e034d551 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:03.957864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fa304865-a737-4311-a713-2464e034d551 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:03.957864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa304865-a737-4311-a713-2464e034d551 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:03.957864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa304865-a737-4311-a713-2464e034d551 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:03.958150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa304865-a737-4311-a713-2464e034d551 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:03.958150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa304865-a737-4311-a713-2464e034d551 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:04.014271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fa304865-a737-4311-a713-2464e034d551 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:04.022841 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fa304865-a737-4311-a713-2464e034d551 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1226 microversion: 2.1 time: 0.087951 Sep 14 19:42:04.023450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 37/76] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:03 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:04.181369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-12a2d9f9-36b7-4ef7-9545-38818e1b62c7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:04.182145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-12a2d9f9-36b7-4ef7-9545-38818e1b62c7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:04.189160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-12a2d9f9-36b7-4ef7-9545-38818e1b62c7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:04.189725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-12a2d9f9-36b7-4ef7-9545-38818e1b62c7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:04.190729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-12a2d9f9-36b7-4ef7-9545-38818e1b62c7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:04.191570 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-12a2d9f9-36b7-4ef7-9545-38818e1b62c7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:04.359270 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-12a2d9f9-36b7-4ef7-9545-38818e1b62c7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:04.368950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-12a2d9f9-36b7-4ef7-9545-38818e1b62c7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.192516 Sep 14 19:42:04.371681 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 40/77] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:04 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:04.726356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1998170b-38c9-4bd0-8301-545858b44943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:04.727664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1998170b-38c9-4bd0-8301-545858b44943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:04.823438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1998170b-38c9-4bd0-8301-545858b44943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:04.823438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1998170b-38c9-4bd0-8301-545858b44943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:04.823626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1998170b-38c9-4bd0-8301-545858b44943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:04.823626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1998170b-38c9-4bd0-8301-545858b44943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1280 microversion: 2.20 time: 0.069296 Sep 14 19:42:04.823626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 38/78] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:04 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:04.949325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-11a2d566-2c66-4f6c-b7f1-3561257dd3a7 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:04.949996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-11a2d566-2c66-4f6c-b7f1-3561257dd3a7 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:04.956379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11a2d566-2c66-4f6c-b7f1-3561257dd3a7 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:04.956844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11a2d566-2c66-4f6c-b7f1-3561257dd3a7 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:04.958296 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11a2d566-2c66-4f6c-b7f1-3561257dd3a7 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:04.960539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11a2d566-2c66-4f6c-b7f1-3561257dd3a7 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:05.043504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-678b6769-84a0-42f5-a198-8d53068757fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:05.044392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-678b6769-84a0-42f5-a198-8d53068757fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:05.054946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-678b6769-84a0-42f5-a198-8d53068757fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:05.055396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-678b6769-84a0-42f5-a198-8d53068757fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:05.056687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-678b6769-84a0-42f5-a198-8d53068757fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:05.058167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-678b6769-84a0-42f5-a198-8d53068757fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:05.164232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-11a2d566-2c66-4f6c-b7f1-3561257dd3a7 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:05.174239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-11a2d566-2c66-4f6c-b7f1-3561257dd3a7 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.228945 Sep 14 19:42:05.178682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 41/79] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:04 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:05.194270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-678b6769-84a0-42f5-a198-8d53068757fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:05.203956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-678b6769-84a0-42f5-a198-8d53068757fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1226 microversion: 2.1 time: 0.164011 Sep 14 19:42:05.207227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 39/80] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:05 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1226 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:05.386685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6af80556-6734-4a9a-af05-09659e15c5a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:05.387298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6af80556-6734-4a9a-af05-09659e15c5a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:05.393396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6af80556-6734-4a9a-af05-09659e15c5a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:05.393899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6af80556-6734-4a9a-af05-09659e15c5a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:05.394782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6af80556-6734-4a9a-af05-09659e15c5a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:05.395266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6af80556-6734-4a9a-af05-09659e15c5a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:05.523002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6af80556-6734-4a9a-af05-09659e15c5a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:05.530628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6af80556-6734-4a9a-af05-09659e15c5a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.147730 Sep 14 19:42:05.531430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 42/81] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:05 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:05.810421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7029f182-7be8-45f5-9e64-4e4f66712121 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:05.811031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7029f182-7be8-45f5-9e64-4e4f66712121 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:05.865845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7029f182-7be8-45f5-9e64-4e4f66712121 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:05.872797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7029f182-7be8-45f5-9e64-4e4f66712121 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:05.874336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7029f182-7be8-45f5-9e64-4e4f66712121 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:05.875447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7029f182-7be8-45f5-9e64-4e4f66712121 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1280 microversion: 2.20 time: 0.068732 Sep 14 19:42:05.876028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 40/82] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:05 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:06.251814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-085e19c4-a6f1-4e2d-b663-c82df1a69136 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:06.252260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a5f94e4f-bcdc-47e6-a80b-e318ef7b8cf3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:06.252913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a5f94e4f-bcdc-47e6-a80b-e318ef7b8cf3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:06.253416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-085e19c4-a6f1-4e2d-b663-c82df1a69136 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:06.260006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5f94e4f-bcdc-47e6-a80b-e318ef7b8cf3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:06.260465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5f94e4f-bcdc-47e6-a80b-e318ef7b8cf3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:06.261267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5f94e4f-bcdc-47e6-a80b-e318ef7b8cf3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:06.261567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-085e19c4-a6f1-4e2d-b663-c82df1a69136 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:06.261798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5f94e4f-bcdc-47e6-a80b-e318ef7b8cf3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:06.262501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-085e19c4-a6f1-4e2d-b663-c82df1a69136 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:06.263767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-085e19c4-a6f1-4e2d-b663-c82df1a69136 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:06.264405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-085e19c4-a6f1-4e2d-b663-c82df1a69136 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:06.338900 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-085e19c4-a6f1-4e2d-b663-c82df1a69136 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:06.349394 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-085e19c4-a6f1-4e2d-b663-c82df1a69136 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1226 microversion: 2.1 time: 0.100850 Sep 14 19:42:06.350629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 41/83] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:06 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:06.423969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a5f94e4f-bcdc-47e6-a80b-e318ef7b8cf3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:06.433868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a5f94e4f-bcdc-47e6-a80b-e318ef7b8cf3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.185435 Sep 14 19:42:06.434453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 43/84] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:06 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:06.548374 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-83bb3c45-9710-477f-b9fc-72347dd3fb4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:06.549301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-83bb3c45-9710-477f-b9fc-72347dd3fb4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:06.555913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83bb3c45-9710-477f-b9fc-72347dd3fb4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:06.556444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83bb3c45-9710-477f-b9fc-72347dd3fb4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:06.557525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83bb3c45-9710-477f-b9fc-72347dd3fb4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:06.558243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83bb3c45-9710-477f-b9fc-72347dd3fb4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:06.893825 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a8bd99a4-a0d9-4e3e-a4a3-4a811552adb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:06.894432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a8bd99a4-a0d9-4e3e-a4a3-4a811552adb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:06.938310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a8bd99a4-a0d9-4e3e-a4a3-4a811552adb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:06.938757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a8bd99a4-a0d9-4e3e-a4a3-4a811552adb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:06.939545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a8bd99a4-a0d9-4e3e-a4a3-4a811552adb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:06.939984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a8bd99a4-a0d9-4e3e-a4a3-4a811552adb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:07.039759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a8bd99a4-a0d9-4e3e-a4a3-4a811552adb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:07.050242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a8bd99a4-a0d9-4e3e-a4a3-4a811552adb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:07.051282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-83bb3c45-9710-477f-b9fc-72347dd3fb4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:07.053188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a8bd99a4-a0d9-4e3e-a4a3-4a811552adb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:07.055064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a8bd99a4-a0d9-4e3e-a4a3-4a811552adb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1276 microversion: 2.20 time: 0.164743 Sep 14 19:42:07.056328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 44/85] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:06 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:07.063626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-83bb3c45-9710-477f-b9fc-72347dd3fb4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.519318 Sep 14 19:42:07.075256 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 42/86] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:06 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:07.366945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0bcbf134-a046-41e7-81d3-9605bd6f2088 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:07.368248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0bcbf134-a046-41e7-81d3-9605bd6f2088 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:07.376128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bcbf134-a046-41e7-81d3-9605bd6f2088 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:07.376968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bcbf134-a046-41e7-81d3-9605bd6f2088 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:07.378302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bcbf134-a046-41e7-81d3-9605bd6f2088 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:07.378954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bcbf134-a046-41e7-81d3-9605bd6f2088 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:07.451965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-65db35b8-4809-45a7-bf57-adebbc30f348 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:07.452881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-65db35b8-4809-45a7-bf57-adebbc30f348 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:07.465672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65db35b8-4809-45a7-bf57-adebbc30f348 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:07.466586 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65db35b8-4809-45a7-bf57-adebbc30f348 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:07.466717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0bcbf134-a046-41e7-81d3-9605bd6f2088 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:07.467769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65db35b8-4809-45a7-bf57-adebbc30f348 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:07.469743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65db35b8-4809-45a7-bf57-adebbc30f348 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:07.477934 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0bcbf134-a046-41e7-81d3-9605bd6f2088 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1218 microversion: 2.1 time: 0.114708 Sep 14 19:42:07.491203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 45/87] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:07 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:07.665767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-65db35b8-4809-45a7-bf57-adebbc30f348 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:07.668958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-65db35b8-4809-45a7-bf57-adebbc30f348 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.221320 Sep 14 19:42:07.669835 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 43/88] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:07 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:08.083099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e65b2e83-f1d3-4bcf-9ca5-3e70a8e78cde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:08.083728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a2db958c-4e3b-4d1e-bde7-aa238583dfd3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:08.084422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a2db958c-4e3b-4d1e-bde7-aa238583dfd3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:08.084822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e65b2e83-f1d3-4bcf-9ca5-3e70a8e78cde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:08.096489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2db958c-4e3b-4d1e-bde7-aa238583dfd3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:08.096489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2db958c-4e3b-4d1e-bde7-aa238583dfd3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:08.096489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2db958c-4e3b-4d1e-bde7-aa238583dfd3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:08.096489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2db958c-4e3b-4d1e-bde7-aa238583dfd3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:08.102810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e65b2e83-f1d3-4bcf-9ca5-3e70a8e78cde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:08.102810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e65b2e83-f1d3-4bcf-9ca5-3e70a8e78cde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:08.102810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e65b2e83-f1d3-4bcf-9ca5-3e70a8e78cde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:08.102810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e65b2e83-f1d3-4bcf-9ca5-3e70a8e78cde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:08.230595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a2db958c-4e3b-4d1e-bde7-aa238583dfd3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:08.243169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a2db958c-4e3b-4d1e-bde7-aa238583dfd3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:08.245281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a2db958c-4e3b-4d1e-bde7-aa238583dfd3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:08.246859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a2db958c-4e3b-4d1e-bde7-aa238583dfd3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1350 microversion: 2.20 time: 0.167830 Sep 14 19:42:08.247925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 46/89] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:08 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:08.509680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-305c443b-577b-41ba-ac48-21b88b3fe0ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:08.512276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-305c443b-577b-41ba-ac48-21b88b3fe0ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:08.522892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-305c443b-577b-41ba-ac48-21b88b3fe0ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:08.523340 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-305c443b-577b-41ba-ac48-21b88b3fe0ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:08.524115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-305c443b-577b-41ba-ac48-21b88b3fe0ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:08.526326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-305c443b-577b-41ba-ac48-21b88b3fe0ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:08.584099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e65b2e83-f1d3-4bcf-9ca5-3e70a8e78cde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:08.593106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e65b2e83-f1d3-4bcf-9ca5-3e70a8e78cde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.514116 Sep 14 19:42:08.603724 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 44/90] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:08 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:08.669765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-305c443b-577b-41ba-ac48-21b88b3fe0ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:08.681156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-305c443b-577b-41ba-ac48-21b88b3fe0ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1274 microversion: 2.1 time: 0.177013 Sep 14 19:42:08.687869 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-396299a7-32f1-4ff3-8074-dc44cc95ddcf tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:08.690623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-396299a7-32f1-4ff3-8074-dc44cc95ddcf tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:08.693600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 47/91] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:08 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:08.699792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-396299a7-32f1-4ff3-8074-dc44cc95ddcf tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:08.700947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-396299a7-32f1-4ff3-8074-dc44cc95ddcf tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:08.702368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-396299a7-32f1-4ff3-8074-dc44cc95ddcf tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:08.703034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-396299a7-32f1-4ff3-8074-dc44cc95ddcf tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:09.058384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-396299a7-32f1-4ff3-8074-dc44cc95ddcf tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:09.071060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-396299a7-32f1-4ff3-8074-dc44cc95ddcf tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.387658 Sep 14 19:42:09.071912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 45/92] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:08 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:09.267566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-45b0d764-2d09-42f8-8260-568257b076a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:09.268198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-45b0d764-2d09-42f8-8260-568257b076a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:09.275357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45b0d764-2d09-42f8-8260-568257b076a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:09.284878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45b0d764-2d09-42f8-8260-568257b076a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:09.284878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45b0d764-2d09-42f8-8260-568257b076a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:09.284878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45b0d764-2d09-42f8-8260-568257b076a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:09.510454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-45b0d764-2d09-42f8-8260-568257b076a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:09.532850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-45b0d764-2d09-42f8-8260-568257b076a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:09.539595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-45b0d764-2d09-42f8-8260-568257b076a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:09.541086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-45b0d764-2d09-42f8-8260-568257b076a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1338 microversion: 2.20 time: 0.278589 Sep 14 19:42:09.557876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 48/93] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1338 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:09.610491 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-19a2159a-0353-487a-873c-21be8dbd97c3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:09.611092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-19a2159a-0353-487a-873c-21be8dbd97c3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:09.617661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19a2159a-0353-487a-873c-21be8dbd97c3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:09.618101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19a2159a-0353-487a-873c-21be8dbd97c3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:09.618869 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19a2159a-0353-487a-873c-21be8dbd97c3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:09.619297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19a2159a-0353-487a-873c-21be8dbd97c3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:09.698745 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1862b7fc-f965-471e-a5dc-9b9d6bc7e944 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:09.699928 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1862b7fc-f965-471e-a5dc-9b9d6bc7e944 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:09.706311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1862b7fc-f965-471e-a5dc-9b9d6bc7e944 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:09.707044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1862b7fc-f965-471e-a5dc-9b9d6bc7e944 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:09.708360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1862b7fc-f965-471e-a5dc-9b9d6bc7e944 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:09.715150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1862b7fc-f965-471e-a5dc-9b9d6bc7e944 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:09.870094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1862b7fc-f965-471e-a5dc-9b9d6bc7e944 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:09.870094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1862b7fc-f965-471e-a5dc-9b9d6bc7e944 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1292 microversion: 2.1 time: 0.143700 Sep 14 19:42:09.870094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 49/94] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:09 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1292 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:10.016372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-19a2159a-0353-487a-873c-21be8dbd97c3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:10.027967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-19a2159a-0353-487a-873c-21be8dbd97c3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.421316 Sep 14 19:42:10.029083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 46/95] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:09 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:10.088838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a75fb8b9-dcd6-4581-80fe-44e56670b434 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:10.089876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a75fb8b9-dcd6-4581-80fe-44e56670b434 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:10.113345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a75fb8b9-dcd6-4581-80fe-44e56670b434 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:10.114293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a75fb8b9-dcd6-4581-80fe-44e56670b434 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:10.115226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a75fb8b9-dcd6-4581-80fe-44e56670b434 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:10.116274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a75fb8b9-dcd6-4581-80fe-44e56670b434 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:10.525317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a75fb8b9-dcd6-4581-80fe-44e56670b434 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:10.533959 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a75fb8b9-dcd6-4581-80fe-44e56670b434 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.450176 Sep 14 19:42:10.534913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 50/96] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:10 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:10.578638 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6acf556f-7f54-4771-b0ad-7f8794f4b216 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:10.578638 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6acf556f-7f54-4771-b0ad-7f8794f4b216 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:10.594207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6acf556f-7f54-4771-b0ad-7f8794f4b216 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:10.596547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6acf556f-7f54-4771-b0ad-7f8794f4b216 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:10.602322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6acf556f-7f54-4771-b0ad-7f8794f4b216 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:10.603192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6acf556f-7f54-4771-b0ad-7f8794f4b216 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:10.856975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a587a7c7-55e9-411e-9772-cef49fd419b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:10.857613 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a587a7c7-55e9-411e-9772-cef49fd419b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:10.864341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a587a7c7-55e9-411e-9772-cef49fd419b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:10.868188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a587a7c7-55e9-411e-9772-cef49fd419b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:10.868188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a587a7c7-55e9-411e-9772-cef49fd419b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:10.868188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a587a7c7-55e9-411e-9772-cef49fd419b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:10.925995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6acf556f-7f54-4771-b0ad-7f8794f4b216 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:10.937829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6acf556f-7f54-4771-b0ad-7f8794f4b216 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:10.939931 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6acf556f-7f54-4771-b0ad-7f8794f4b216 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:10.941224 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6acf556f-7f54-4771-b0ad-7f8794f4b216 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.379384 Sep 14 19:42:10.952982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 47/97] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:11.049805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c7971b90-b565-444e-a3b5-acf1b93a8e37 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:11.052658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c7971b90-b565-444e-a3b5-acf1b93a8e37 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:11.062913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c7971b90-b565-444e-a3b5-acf1b93a8e37 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:11.064800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c7971b90-b565-444e-a3b5-acf1b93a8e37 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:11.067642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c7971b90-b565-444e-a3b5-acf1b93a8e37 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:11.068423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c7971b90-b565-444e-a3b5-acf1b93a8e37 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:11.231866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a587a7c7-55e9-411e-9772-cef49fd419b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:11.246011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a587a7c7-55e9-411e-9772-cef49fd419b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.391367 Sep 14 19:42:11.254154 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 51/98] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:10 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:11.257807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c7971b90-b565-444e-a3b5-acf1b93a8e37 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:11.275532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c7971b90-b565-444e-a3b5-acf1b93a8e37 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.231219 Sep 14 19:42:11.286285 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 48/99] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:11 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:11.551270 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-10640461-c220-44bf-af26-258c06c23b9e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:11.552727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-10640461-c220-44bf-af26-258c06c23b9e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:11.559514 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10640461-c220-44bf-af26-258c06c23b9e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:11.560313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10640461-c220-44bf-af26-258c06c23b9e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:11.561341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10640461-c220-44bf-af26-258c06c23b9e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:11.562002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10640461-c220-44bf-af26-258c06c23b9e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:11.962629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4550fbba-7700-4a71-bfae-d26f05dc4d5c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:11.967455 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4550fbba-7700-4a71-bfae-d26f05dc4d5c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:11.994778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4550fbba-7700-4a71-bfae-d26f05dc4d5c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:11.996608 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4550fbba-7700-4a71-bfae-d26f05dc4d5c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:11.998220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4550fbba-7700-4a71-bfae-d26f05dc4d5c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:11.998684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4550fbba-7700-4a71-bfae-d26f05dc4d5c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:12.340970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4550fbba-7700-4a71-bfae-d26f05dc4d5c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:12.361565 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4550fbba-7700-4a71-bfae-d26f05dc4d5c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:12.366500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4550fbba-7700-4a71-bfae-d26f05dc4d5c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:12.370543 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4550fbba-7700-4a71-bfae-d26f05dc4d5c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.412981 Sep 14 19:42:12.372297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 49/100] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:11 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:12.454777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-10640461-c220-44bf-af26-258c06c23b9e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:12.465005 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-10640461-c220-44bf-af26-258c06c23b9e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.917383 Sep 14 19:42:12.477200 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 52/101] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:11 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:12.482503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3cafb106-3c25-4edb-a2a4-7d57ff6ffc5c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:12.483339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3cafb106-3c25-4edb-a2a4-7d57ff6ffc5c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:12.491025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3cafb106-3c25-4edb-a2a4-7d57ff6ffc5c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:12.491727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3cafb106-3c25-4edb-a2a4-7d57ff6ffc5c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:12.492801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3cafb106-3c25-4edb-a2a4-7d57ff6ffc5c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:12.493382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3cafb106-3c25-4edb-a2a4-7d57ff6ffc5c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:12.623173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-c1457760-4e5f-493e-9fc8-0db286288519 req-a11c1bf8-d83b-445d-8498-974e78fd12be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a26129-f7fb-4755-979a-968cdf0c7d34", "tag": "f0babfc4-e4f0-41d5-9206-dc7125b0b10e"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:12.625673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:12.625673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:42:12.644385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-c1457760-4e5f-493e-9fc8-0db286288519 req-a11c1bf8-d83b-445d-8498-974e78fd12be service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:12.652435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-c1457760-4e5f-493e-9fc8-0db286288519 req-a11c1bf8-d83b-445d-8498-974e78fd12be service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:12.703480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-c1457760-4e5f-493e-9fc8-0db286288519 req-a11c1bf8-d83b-445d-8498-974e78fd12be service nova] Creating event network-changed:f0babfc4-e4f0-41d5-9206-dc7125b0b10e for instance 72a26129-f7fb-4755-979a-968cdf0c7d34 on hv-cinder-80588 Sep 14 19:42:12.704649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-c1457760-4e5f-493e-9fc8-0db286288519 req-a11c1bf8-d83b-445d-8498-974e78fd12be service nova] Acquired lock "compute-rpcapi-router" {{(pid=115679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 14 19:42:12.708405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40b11bab-5280-4e94-8cab-d854a426cdea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:12.710032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40b11bab-5280-4e94-8cab-d854a426cdea None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:12.711061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40b11bab-5280-4e94-8cab-d854a426cdea None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:12.713047 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40b11bab-5280-4e94-8cab-d854a426cdea None None] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:12.734702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.compute.rpcapi [None req-40b11bab-5280-4e94-8cab-d854a426cdea None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 14 19:42:12.736376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40b11bab-5280-4e94-8cab-d854a426cdea None None] Releasing lock "compute-rpcapi-router" {{(pid=115679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 14 19:42:12.767087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-40b11bab-5280-4e94-8cab-d854a426cdea None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391988 Sep 14 19:42:12.768583 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 50/102] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:42:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:42:12.774807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d389ef21-3eb2-4fde-8fa6-3281992f446a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:12.776232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d389ef21-3eb2-4fde-8fa6-3281992f446a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:12.784039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d389ef21-3eb2-4fde-8fa6-3281992f446a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:12.784625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d389ef21-3eb2-4fde-8fa6-3281992f446a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:12.786210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d389ef21-3eb2-4fde-8fa6-3281992f446a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:12.786820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d389ef21-3eb2-4fde-8fa6-3281992f446a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:12.968626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3cafb106-3c25-4edb-a2a4-7d57ff6ffc5c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:12.978033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3cafb106-3c25-4edb-a2a4-7d57ff6ffc5c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.499337 Sep 14 19:42:12.988600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 53/103] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:12 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:12.994441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-353c0b19-d59a-45d6-9bd1-01ad10a83f19 req-b0ade966-311e-4cbe-9a7e-b3fb4a7c909f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be387eb-e7de-4f9f-b3ee-23068e618bf4", "tag": "aed2c83a-d427-4091-9962-b9bcc094af29"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:12.996028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:12.996028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:42:13.003667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-353c0b19-d59a-45d6-9bd1-01ad10a83f19 req-b0ade966-311e-4cbe-9a7e-b3fb4a7c909f service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:13.004674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-353c0b19-d59a-45d6-9bd1-01ad10a83f19 req-b0ade966-311e-4cbe-9a7e-b3fb4a7c909f service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:13.015884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-353c0b19-d59a-45d6-9bd1-01ad10a83f19 req-b0ade966-311e-4cbe-9a7e-b3fb4a7c909f service nova] Creating event network-changed:aed2c83a-d427-4091-9962-b9bcc094af29 for instance 0be387eb-e7de-4f9f-b3ee-23068e618bf4 on hv-cinder-80588 Sep 14 19:42:13.024411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d389ef21-3eb2-4fde-8fa6-3281992f446a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:13.032282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d389ef21-3eb2-4fde-8fa6-3281992f446a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.262336 Sep 14 19:42:13.033715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-353c0b19-d59a-45d6-9bd1-01ad10a83f19 req-b0ade966-311e-4cbe-9a7e-b3fb4a7c909f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031258 Sep 14 19:42:13.043352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 54/104] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:42:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:42:13.055038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 51/105] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:12 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:13.396185 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-184968db-8a2b-419f-8559-a63ab9bc1b10 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:13.396964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-184968db-8a2b-419f-8559-a63ab9bc1b10 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:13.403242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-184968db-8a2b-419f-8559-a63ab9bc1b10 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:13.403697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-184968db-8a2b-419f-8559-a63ab9bc1b10 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:13.404478 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-184968db-8a2b-419f-8559-a63ab9bc1b10 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:13.417158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-184968db-8a2b-419f-8559-a63ab9bc1b10 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:13.485051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3da03b56-9eee-4574-9d6b-db57f0e91634 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:13.487353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3da03b56-9eee-4574-9d6b-db57f0e91634 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:13.498505 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3da03b56-9eee-4574-9d6b-db57f0e91634 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:13.499058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3da03b56-9eee-4574-9d6b-db57f0e91634 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:13.502114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3da03b56-9eee-4574-9d6b-db57f0e91634 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:13.502571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3da03b56-9eee-4574-9d6b-db57f0e91634 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:13.638817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3da03b56-9eee-4574-9d6b-db57f0e91634 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:13.647384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3da03b56-9eee-4574-9d6b-db57f0e91634 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.166876 Sep 14 19:42:13.648087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 52/106] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:13 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:13.979655 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-184968db-8a2b-419f-8559-a63ab9bc1b10 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:13.989058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-184968db-8a2b-419f-8559-a63ab9bc1b10 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:13.991262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-184968db-8a2b-419f-8559-a63ab9bc1b10 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:13.992722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-184968db-8a2b-419f-8559-a63ab9bc1b10 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.600999 Sep 14 19:42:13.993451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 55/107] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:13.995200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4574eb8a-29a0-4f80-94ca-d549ec1bb725 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:13.995808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4574eb8a-29a0-4f80-94ca-d549ec1bb725 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:14.001640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4574eb8a-29a0-4f80-94ca-d549ec1bb725 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:14.002087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4574eb8a-29a0-4f80-94ca-d549ec1bb725 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:14.003158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4574eb8a-29a0-4f80-94ca-d549ec1bb725 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:14.003644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4574eb8a-29a0-4f80-94ca-d549ec1bb725 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:14.053023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3b45f3ac-bc50-4983-8353-6da301511af2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:14.053892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3b45f3ac-bc50-4983-8353-6da301511af2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:14.060082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b45f3ac-bc50-4983-8353-6da301511af2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:14.060983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b45f3ac-bc50-4983-8353-6da301511af2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:14.062385 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b45f3ac-bc50-4983-8353-6da301511af2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:14.062833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b45f3ac-bc50-4983-8353-6da301511af2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:14.182154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4574eb8a-29a0-4f80-94ca-d549ec1bb725 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:14.201799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4574eb8a-29a0-4f80-94ca-d549ec1bb725 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.200264 Sep 14 19:42:14.201799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 53/108] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:13 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:14.407553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3b45f3ac-bc50-4983-8353-6da301511af2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:14.414866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3b45f3ac-bc50-4983-8353-6da301511af2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.368063 Sep 14 19:42:14.415462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 56/109] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:14 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:14.665342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d79016a6-9470-468c-8184-96945e89c586 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:14.665993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d79016a6-9470-468c-8184-96945e89c586 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:14.672104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d79016a6-9470-468c-8184-96945e89c586 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:14.673376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d79016a6-9470-468c-8184-96945e89c586 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:14.673376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d79016a6-9470-468c-8184-96945e89c586 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:14.673755 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d79016a6-9470-468c-8184-96945e89c586 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:14.797783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d79016a6-9470-468c-8184-96945e89c586 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:14.811919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d79016a6-9470-468c-8184-96945e89c586 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.144735 Sep 14 19:42:14.811919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 54/110] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:14 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:14.815208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-1b3d9e36-ebe9-4919-9f52-f14e1dba1773 req-7326a39f-d490-42db-8993-853c078de3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9185a2-5afd-4c39-bb28-beb531d58eb0", "tag": "45334afa-e55a-4177-a70b-0d423fb28ae1"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:14.817393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:14.817393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:42:14.824222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-1b3d9e36-ebe9-4919-9f52-f14e1dba1773 req-7326a39f-d490-42db-8993-853c078de3ed service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:14.824662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-1b3d9e36-ebe9-4919-9f52-f14e1dba1773 req-7326a39f-d490-42db-8993-853c078de3ed service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:14.848127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-1b3d9e36-ebe9-4919-9f52-f14e1dba1773 req-7326a39f-d490-42db-8993-853c078de3ed service nova] Creating event network-changed:45334afa-e55a-4177-a70b-0d423fb28ae1 for instance 0b9185a2-5afd-4c39-bb28-beb531d58eb0 on hv-cinder-80588 Sep 14 19:42:14.853035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-1b3d9e36-ebe9-4919-9f52-f14e1dba1773 req-7326a39f-d490-42db-8993-853c078de3ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041460 Sep 14 19:42:14.853669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 57/111] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:42:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:42:15.016543 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-efea8944-a554-435f-a835-ab088a5d815e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:15.016776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-efea8944-a554-435f-a835-ab088a5d815e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:15.023197 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efea8944-a554-435f-a835-ab088a5d815e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:15.023855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efea8944-a554-435f-a835-ab088a5d815e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:15.024782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efea8944-a554-435f-a835-ab088a5d815e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:15.025352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efea8944-a554-435f-a835-ab088a5d815e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:15.203019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-efea8944-a554-435f-a835-ab088a5d815e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:15.213245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-efea8944-a554-435f-a835-ab088a5d815e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:15.221650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-efea8944-a554-435f-a835-ab088a5d815e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:15.221650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-efea8944-a554-435f-a835-ab088a5d815e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.204015 Sep 14 19:42:15.221650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 55/112] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:15 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:15.229306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3999f757-1936-46df-8746-cc781d40c666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:15.230203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3999f757-1936-46df-8746-cc781d40c666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:15.236821 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3999f757-1936-46df-8746-cc781d40c666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:15.237411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3999f757-1936-46df-8746-cc781d40c666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:15.238833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3999f757-1936-46df-8746-cc781d40c666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:15.239372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3999f757-1936-46df-8746-cc781d40c666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:15.431702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-099020f3-9f66-49f0-88a4-6ef084c970ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:15.432232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-099020f3-9f66-49f0-88a4-6ef084c970ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:15.438319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-099020f3-9f66-49f0-88a4-6ef084c970ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:15.439031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-099020f3-9f66-49f0-88a4-6ef084c970ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:15.439863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-099020f3-9f66-49f0-88a4-6ef084c970ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:15.440295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-099020f3-9f66-49f0-88a4-6ef084c970ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:15.474143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3999f757-1936-46df-8746-cc781d40c666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:15.482404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3999f757-1936-46df-8746-cc781d40c666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.267761 Sep 14 19:42:15.483853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 58/113] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:15 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:15.584979 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-099020f3-9f66-49f0-88a4-6ef084c970ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:15.592635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-099020f3-9f66-49f0-88a4-6ef084c970ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.164680 Sep 14 19:42:15.594400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 56/114] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:15 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:15.720813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-5ed1e43d-856c-4385-9fd8-59e26c7db399 req-57b7816a-aef3-4bc8-9880-4c7339de950c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d23b109a-dab1-48fd-b306-2d1c00fdeb0d", "name": "network-vif-plugged", "status": "completed", "tag": "d7f50ba9-6855-4fe4-865c-864b6863e673"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:15.722382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:15.722382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:42:15.729098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-5ed1e43d-856c-4385-9fd8-59e26c7db399 req-57b7816a-aef3-4bc8-9880-4c7339de950c service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:15.729552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-5ed1e43d-856c-4385-9fd8-59e26c7db399 req-57b7816a-aef3-4bc8-9880-4c7339de950c service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:15.743754 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-5ed1e43d-856c-4385-9fd8-59e26c7db399 req-57b7816a-aef3-4bc8-9880-4c7339de950c service nova] Creating event network-vif-plugged:d7f50ba9-6855-4fe4-865c-864b6863e673 for instance d23b109a-dab1-48fd-b306-2d1c00fdeb0d on hv-cinder-80588 Sep 14 19:42:15.755453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-5ed1e43d-856c-4385-9fd8-59e26c7db399 req-57b7816a-aef3-4bc8-9880-4c7339de950c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098542 Sep 14 19:42:15.759904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 59/115] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:42:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:42:15.822533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a070212e-da4c-4677-a141-6f0a1950e43d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:15.823141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a070212e-da4c-4677-a141-6f0a1950e43d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:15.829481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a070212e-da4c-4677-a141-6f0a1950e43d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:15.829964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a070212e-da4c-4677-a141-6f0a1950e43d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:15.830742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a070212e-da4c-4677-a141-6f0a1950e43d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:15.831175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a070212e-da4c-4677-a141-6f0a1950e43d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:15.969889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a070212e-da4c-4677-a141-6f0a1950e43d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:15.977997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a070212e-da4c-4677-a141-6f0a1950e43d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.159027 Sep 14 19:42:15.978563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 57/116] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:15 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:16.235280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8ef69393-c0aa-4c8b-a3ea-c544b72ca1f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:16.236640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8ef69393-c0aa-4c8b-a3ea-c544b72ca1f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:16.244938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ef69393-c0aa-4c8b-a3ea-c544b72ca1f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:16.246701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ef69393-c0aa-4c8b-a3ea-c544b72ca1f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:16.267510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ef69393-c0aa-4c8b-a3ea-c544b72ca1f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:16.267510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ef69393-c0aa-4c8b-a3ea-c544b72ca1f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:16.415224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8ef69393-c0aa-4c8b-a3ea-c544b72ca1f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:16.423070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8ef69393-c0aa-4c8b-a3ea-c544b72ca1f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:16.424558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8ef69393-c0aa-4c8b-a3ea-c544b72ca1f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:16.425774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8ef69393-c0aa-4c8b-a3ea-c544b72ca1f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.194501 Sep 14 19:42:16.426324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 60/117] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:16 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:16.500806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-befa1891-2ef4-476c-b896-1de79f1dc7d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:16.501425 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-befa1891-2ef4-476c-b896-1de79f1dc7d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:16.507764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-befa1891-2ef4-476c-b896-1de79f1dc7d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:16.508214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-befa1891-2ef4-476c-b896-1de79f1dc7d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:16.508998 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-befa1891-2ef4-476c-b896-1de79f1dc7d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:16.509432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-befa1891-2ef4-476c-b896-1de79f1dc7d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:16.610152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-436f9b6f-ab63-48f4-9b42-fb9db5f1ea68 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:16.610765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-436f9b6f-ab63-48f4-9b42-fb9db5f1ea68 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:16.617114 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-436f9b6f-ab63-48f4-9b42-fb9db5f1ea68 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:16.618079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-436f9b6f-ab63-48f4-9b42-fb9db5f1ea68 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:16.623937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-436f9b6f-ab63-48f4-9b42-fb9db5f1ea68 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:16.623937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-436f9b6f-ab63-48f4-9b42-fb9db5f1ea68 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:16.647164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-befa1891-2ef4-476c-b896-1de79f1dc7d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:16.654686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-befa1891-2ef4-476c-b896-1de79f1dc7d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.157550 Sep 14 19:42:16.655260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 58/118] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:16 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:16.758304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-436f9b6f-ab63-48f4-9b42-fb9db5f1ea68 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:16.765626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-436f9b6f-ab63-48f4-9b42-fb9db5f1ea68 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.159208 Sep 14 19:42:16.766240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 61/119] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:16 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:16.995621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-174eecbb-659f-4410-a577-6658ce009f40 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:16.996336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-174eecbb-659f-4410-a577-6658ce009f40 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:17.002612 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-174eecbb-659f-4410-a577-6658ce009f40 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:17.003317 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-174eecbb-659f-4410-a577-6658ce009f40 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:17.004428 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-174eecbb-659f-4410-a577-6658ce009f40 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:17.005366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-174eecbb-659f-4410-a577-6658ce009f40 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:17.130233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-174eecbb-659f-4410-a577-6658ce009f40 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:17.141840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-174eecbb-659f-4410-a577-6658ce009f40 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.147357 Sep 14 19:42:17.141840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 59/120] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:16 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:17.444767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2db3a8df-817b-4601-99a6-9c992ba01bda tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:17.445457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2db3a8df-817b-4601-99a6-9c992ba01bda tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:17.452569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2db3a8df-817b-4601-99a6-9c992ba01bda tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:17.453022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2db3a8df-817b-4601-99a6-9c992ba01bda tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:17.453892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2db3a8df-817b-4601-99a6-9c992ba01bda tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:17.454327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2db3a8df-817b-4601-99a6-9c992ba01bda tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:17.575244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2db3a8df-817b-4601-99a6-9c992ba01bda tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:17.583678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2db3a8df-817b-4601-99a6-9c992ba01bda tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:17.585134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2db3a8df-817b-4601-99a6-9c992ba01bda tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:17.586262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2db3a8df-817b-4601-99a6-9c992ba01bda tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.146524 Sep 14 19:42:17.586816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 62/121] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:17 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:17.670660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-02b9b3d4-4d52-482b-9b3f-6cd4e939f6aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:17.671267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-02b9b3d4-4d52-482b-9b3f-6cd4e939f6aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:17.680924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02b9b3d4-4d52-482b-9b3f-6cd4e939f6aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:17.680924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02b9b3d4-4d52-482b-9b3f-6cd4e939f6aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:17.680924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02b9b3d4-4d52-482b-9b3f-6cd4e939f6aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:17.680924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02b9b3d4-4d52-482b-9b3f-6cd4e939f6aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:17.773119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-00fd9a59-ea60-4012-b427-82b4820e2279 req-ce9d8d3a-484a-4cc6-8c7b-f6a59b8a16fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea", "name": "network-vif-plugged", "status": "completed", "tag": "7b992f7d-a9b4-4b25-b967-bcf20c9cd38a"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:17.775006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:17.775006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:42:17.783869 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-00fd9a59-ea60-4012-b427-82b4820e2279 req-ce9d8d3a-484a-4cc6-8c7b-f6a59b8a16fc service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:17.784388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-00fd9a59-ea60-4012-b427-82b4820e2279 req-ce9d8d3a-484a-4cc6-8c7b-f6a59b8a16fc service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:17.800383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-00fd9a59-ea60-4012-b427-82b4820e2279 req-ce9d8d3a-484a-4cc6-8c7b-f6a59b8a16fc service nova] Creating event network-vif-plugged:7b992f7d-a9b4-4b25-b967-bcf20c9cd38a for instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea on hv-cinder-80588 Sep 14 19:42:17.808964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-02b9b3d4-4d52-482b-9b3f-6cd4e939f6aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:17.813851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-00fd9a59-ea60-4012-b427-82b4820e2279 req-ce9d8d3a-484a-4cc6-8c7b-f6a59b8a16fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036737 Sep 14 19:42:17.815126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 63/122] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:42:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:42:17.817028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-02b9b3d4-4d52-482b-9b3f-6cd4e939f6aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.149927 Sep 14 19:42:17.817810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 60/123] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:17 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:17.820653 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b550df23-82e4-4656-872e-db1736ea8361 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:17.821385 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b550df23-82e4-4656-872e-db1736ea8361 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:17.828008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b550df23-82e4-4656-872e-db1736ea8361 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:17.828512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b550df23-82e4-4656-872e-db1736ea8361 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:17.829419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b550df23-82e4-4656-872e-db1736ea8361 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:17.829800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b550df23-82e4-4656-872e-db1736ea8361 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:17.967617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b550df23-82e4-4656-872e-db1736ea8361 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:17.975868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b550df23-82e4-4656-872e-db1736ea8361 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.159605 Sep 14 19:42:17.976533 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 64/124] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:17 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:18.155519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-89ca4b0e-db71-4fe9-9912-b2f70ebfeb76 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:18.156123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-89ca4b0e-db71-4fe9-9912-b2f70ebfeb76 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:18.161845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-89ca4b0e-db71-4fe9-9912-b2f70ebfeb76 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:18.162288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-89ca4b0e-db71-4fe9-9912-b2f70ebfeb76 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:18.163053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-89ca4b0e-db71-4fe9-9912-b2f70ebfeb76 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:18.163479 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-89ca4b0e-db71-4fe9-9912-b2f70ebfeb76 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:18.291796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-89ca4b0e-db71-4fe9-9912-b2f70ebfeb76 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:18.300599 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-89ca4b0e-db71-4fe9-9912-b2f70ebfeb76 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.148638 Sep 14 19:42:18.301182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 61/125] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:18 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:18.603192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-634f901e-8d9e-44d3-89c7-7b0c5b36e5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:18.603806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-634f901e-8d9e-44d3-89c7-7b0c5b36e5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:18.610242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-634f901e-8d9e-44d3-89c7-7b0c5b36e5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:18.610726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-634f901e-8d9e-44d3-89c7-7b0c5b36e5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:18.611532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-634f901e-8d9e-44d3-89c7-7b0c5b36e5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:18.611966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-634f901e-8d9e-44d3-89c7-7b0c5b36e5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:18.732086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-634f901e-8d9e-44d3-89c7-7b0c5b36e5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:18.739938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-634f901e-8d9e-44d3-89c7-7b0c5b36e5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:18.741557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-634f901e-8d9e-44d3-89c7-7b0c5b36e5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:18.742659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-634f901e-8d9e-44d3-89c7-7b0c5b36e5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.143173 Sep 14 19:42:18.743218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 65/126] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:18 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:18.834857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-00fb2ce3-fca0-4ce4-b54d-9a10e8b01f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:18.835391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-00fb2ce3-fca0-4ce4-b54d-9a10e8b01f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:18.841325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00fb2ce3-fca0-4ce4-b54d-9a10e8b01f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:18.841811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00fb2ce3-fca0-4ce4-b54d-9a10e8b01f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:18.842587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00fb2ce3-fca0-4ce4-b54d-9a10e8b01f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:18.843021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00fb2ce3-fca0-4ce4-b54d-9a10e8b01f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:18.965224 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-00fb2ce3-fca0-4ce4-b54d-9a10e8b01f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:18.973067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-00fb2ce3-fca0-4ce4-b54d-9a10e8b01f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.142086 Sep 14 19:42:18.973685 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 62/127] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:18 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:18.996584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-78a3b260-8044-4c15-912b-870922671b36 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:18.997248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-78a3b260-8044-4c15-912b-870922671b36 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:19.003582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78a3b260-8044-4c15-912b-870922671b36 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:19.004553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78a3b260-8044-4c15-912b-870922671b36 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:19.005336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78a3b260-8044-4c15-912b-870922671b36 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:19.005817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78a3b260-8044-4c15-912b-870922671b36 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:19.135014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-78a3b260-8044-4c15-912b-870922671b36 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:19.142823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-78a3b260-8044-4c15-912b-870922671b36 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.150068 Sep 14 19:42:19.143424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 66/128] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:18 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:19.316922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ff88f58d-4bd6-45f9-ab0b-ffa23b21d07e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:19.317541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ff88f58d-4bd6-45f9-ab0b-ffa23b21d07e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:19.324094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff88f58d-4bd6-45f9-ab0b-ffa23b21d07e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:19.324549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff88f58d-4bd6-45f9-ab0b-ffa23b21d07e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:19.325321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff88f58d-4bd6-45f9-ab0b-ffa23b21d07e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:19.326088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff88f58d-4bd6-45f9-ab0b-ffa23b21d07e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:19.469360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ff88f58d-4bd6-45f9-ab0b-ffa23b21d07e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:19.478060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ff88f58d-4bd6-45f9-ab0b-ffa23b21d07e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.164537 Sep 14 19:42:19.478740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 63/129] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:19 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:19.759926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cfae1843-8631-4486-80ae-776c4a061f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:19.760686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cfae1843-8631-4486-80ae-776c4a061f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:19.766475 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfae1843-8631-4486-80ae-776c4a061f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:19.766932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfae1843-8631-4486-80ae-776c4a061f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:19.767685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfae1843-8631-4486-80ae-776c4a061f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:19.768114 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfae1843-8631-4486-80ae-776c4a061f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:19.887668 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cfae1843-8631-4486-80ae-776c4a061f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:19.901634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cfae1843-8631-4486-80ae-776c4a061f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:19.901634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cfae1843-8631-4486-80ae-776c4a061f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:19.901634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cfae1843-8631-4486-80ae-776c4a061f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.142621 Sep 14 19:42:19.901868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 67/130] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:19.989902 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-07c1b16d-16a3-4b02-96ca-01439ce68f24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:19.990514 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-07c1b16d-16a3-4b02-96ca-01439ce68f24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:19.996782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-07c1b16d-16a3-4b02-96ca-01439ce68f24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:19.997233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-07c1b16d-16a3-4b02-96ca-01439ce68f24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:19.998106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-07c1b16d-16a3-4b02-96ca-01439ce68f24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:19.998970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-07c1b16d-16a3-4b02-96ca-01439ce68f24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:20.135804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-07c1b16d-16a3-4b02-96ca-01439ce68f24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:20.147089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-07c1b16d-16a3-4b02-96ca-01439ce68f24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.160482 Sep 14 19:42:20.148829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 64/131] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:19 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:20.164319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4f4919c1-d613-4a24-8da8-5a7f83fa313a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:20.164917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4f4919c1-d613-4a24-8da8-5a7f83fa313a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:20.171998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f4919c1-d613-4a24-8da8-5a7f83fa313a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:20.172440 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f4919c1-d613-4a24-8da8-5a7f83fa313a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:20.173206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f4919c1-d613-4a24-8da8-5a7f83fa313a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:20.173685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f4919c1-d613-4a24-8da8-5a7f83fa313a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:20.307133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4f4919c1-d613-4a24-8da8-5a7f83fa313a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:20.322617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4f4919c1-d613-4a24-8da8-5a7f83fa313a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1317 microversion: 2.1 time: 0.159620 Sep 14 19:42:20.322617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 68/132] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:20 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:20.494927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3a23a6fe-b1ce-499a-84d1-9399995c2e05 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:20.495825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3a23a6fe-b1ce-499a-84d1-9399995c2e05 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:20.502035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a23a6fe-b1ce-499a-84d1-9399995c2e05 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:20.510064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a23a6fe-b1ce-499a-84d1-9399995c2e05 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:20.510064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a23a6fe-b1ce-499a-84d1-9399995c2e05 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:20.510064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a23a6fe-b1ce-499a-84d1-9399995c2e05 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:20.624871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3a23a6fe-b1ce-499a-84d1-9399995c2e05 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:20.632384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3a23a6fe-b1ce-499a-84d1-9399995c2e05 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1314 microversion: 2.1 time: 0.141001 Sep 14 19:42:20.632964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 65/133] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:20 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:20.916524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-98f29c73-8416-41de-a59c-436fe17132cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:20.917130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-98f29c73-8416-41de-a59c-436fe17132cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:20.924106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98f29c73-8416-41de-a59c-436fe17132cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:20.924564 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98f29c73-8416-41de-a59c-436fe17132cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:20.925345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98f29c73-8416-41de-a59c-436fe17132cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:20.926341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98f29c73-8416-41de-a59c-436fe17132cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:21.068727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-98f29c73-8416-41de-a59c-436fe17132cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:21.078172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-98f29c73-8416-41de-a59c-436fe17132cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:21.080107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-98f29c73-8416-41de-a59c-436fe17132cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:21.081224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-98f29c73-8416-41de-a59c-436fe17132cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.168645 Sep 14 19:42:21.090179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 69/134] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:21.165254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-08b8b001-e645-453e-b61b-587ff754f39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:21.166859 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-08b8b001-e645-453e-b61b-587ff754f39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:21.174785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08b8b001-e645-453e-b61b-587ff754f39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:21.175511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08b8b001-e645-453e-b61b-587ff754f39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:21.176993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08b8b001-e645-453e-b61b-587ff754f39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:21.177828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08b8b001-e645-453e-b61b-587ff754f39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:21.259649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-4296f54a-ad66-42e0-a836-74b402e69962 req-8eb3a3a7-71fb-42a0-8990-7b1b894f56dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a26129-f7fb-4755-979a-968cdf0c7d34", "name": "network-vif-plugged", "status": "completed", "tag": "f0babfc4-e4f0-41d5-9206-dc7125b0b10e"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:21.261246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:21.261246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:42:21.271108 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-4296f54a-ad66-42e0-a836-74b402e69962 req-8eb3a3a7-71fb-42a0-8990-7b1b894f56dd service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:21.271546 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-4296f54a-ad66-42e0-a836-74b402e69962 req-8eb3a3a7-71fb-42a0-8990-7b1b894f56dd service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:21.284660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-4296f54a-ad66-42e0-a836-74b402e69962 req-8eb3a3a7-71fb-42a0-8990-7b1b894f56dd service nova] Creating event network-vif-plugged:f0babfc4-e4f0-41d5-9206-dc7125b0b10e for instance 72a26129-f7fb-4755-979a-968cdf0c7d34 on hv-cinder-80588 Sep 14 19:42:21.292366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-4296f54a-ad66-42e0-a836-74b402e69962 req-8eb3a3a7-71fb-42a0-8990-7b1b894f56dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036374 Sep 14 19:42:21.292982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 70/135] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:42:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:42:21.336561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-143f7880-847e-4420-81a0-358fb50d443a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:21.337766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-143f7880-847e-4420-81a0-358fb50d443a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:21.347248 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-08b8b001-e645-453e-b61b-587ff754f39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:21.350842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-143f7880-847e-4420-81a0-358fb50d443a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:21.355330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-143f7880-847e-4420-81a0-358fb50d443a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:21.356216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-143f7880-847e-4420-81a0-358fb50d443a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:21.356993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-143f7880-847e-4420-81a0-358fb50d443a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:21.358910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-08b8b001-e645-453e-b61b-587ff754f39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.194739 Sep 14 19:42:21.359508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 66/136] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:21 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:21.500824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-143f7880-847e-4420-81a0-358fb50d443a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:21.508318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-143f7880-847e-4420-81a0-358fb50d443a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1507 microversion: 2.1 time: 0.175699 Sep 14 19:42:21.508880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 71/137] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:21 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:21.649694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3c9f9b4f-e79a-49cd-8463-ef9feb1b922d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:21.650301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3c9f9b4f-e79a-49cd-8463-ef9feb1b922d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:21.657046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3c9f9b4f-e79a-49cd-8463-ef9feb1b922d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:21.657559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3c9f9b4f-e79a-49cd-8463-ef9feb1b922d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:21.658968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3c9f9b4f-e79a-49cd-8463-ef9feb1b922d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:21.658968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3c9f9b4f-e79a-49cd-8463-ef9feb1b922d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:21.810250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3c9f9b4f-e79a-49cd-8463-ef9feb1b922d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:21.817524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3c9f9b4f-e79a-49cd-8463-ef9feb1b922d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1501 microversion: 2.1 time: 0.171903 Sep 14 19:42:21.822610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 67/138] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:21 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:22.106592 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d342da4e-3e81-4ed3-90b8-bd8bd8f2047b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:22.107726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d342da4e-3e81-4ed3-90b8-bd8bd8f2047b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:22.122576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d342da4e-3e81-4ed3-90b8-bd8bd8f2047b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:22.123486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d342da4e-3e81-4ed3-90b8-bd8bd8f2047b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:22.124366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d342da4e-3e81-4ed3-90b8-bd8bd8f2047b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:22.125451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d342da4e-3e81-4ed3-90b8-bd8bd8f2047b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:22.255274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d342da4e-3e81-4ed3-90b8-bd8bd8f2047b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:22.267442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d342da4e-3e81-4ed3-90b8-bd8bd8f2047b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:22.269054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d342da4e-3e81-4ed3-90b8-bd8bd8f2047b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:22.271061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d342da4e-3e81-4ed3-90b8-bd8bd8f2047b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.168850 Sep 14 19:42:22.271605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 72/139] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:22 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:22.374923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dbce0cdd-498b-4873-9b87-5a20861a3528 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:22.375528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dbce0cdd-498b-4873-9b87-5a20861a3528 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:22.381291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbce0cdd-498b-4873-9b87-5a20861a3528 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:22.381768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbce0cdd-498b-4873-9b87-5a20861a3528 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:22.382537 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbce0cdd-498b-4873-9b87-5a20861a3528 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:22.383140 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbce0cdd-498b-4873-9b87-5a20861a3528 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:22.501282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dbce0cdd-498b-4873-9b87-5a20861a3528 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:22.508843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dbce0cdd-498b-4873-9b87-5a20861a3528 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.137544 Sep 14 19:42:22.509412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 68/140] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:22 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:23.288002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-aa5e8966-5069-4547-a88e-4d988352c186 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:23.288602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-aa5e8966-5069-4547-a88e-4d988352c186 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:23.294553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa5e8966-5069-4547-a88e-4d988352c186 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:23.297612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa5e8966-5069-4547-a88e-4d988352c186 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:23.297612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa5e8966-5069-4547-a88e-4d988352c186 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:23.297612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa5e8966-5069-4547-a88e-4d988352c186 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:23.310761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-797e8105-f1ab-47b1-acab-4da91e894f99 req-974488af-f38e-4e9d-b06e-c22692ff45c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9185a2-5afd-4c39-bb28-beb531d58eb0", "name": "network-vif-plugged", "status": "completed", "tag": "45334afa-e55a-4177-a70b-0d423fb28ae1"}, {"server_uuid": "0be387eb-e7de-4f9f-b3ee-23068e618bf4", "name": "network-vif-plugged", "status": "completed", "tag": "aed2c83a-d427-4091-9962-b9bcc094af29"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:23.312817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:23.312817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:42:23.322809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-797e8105-f1ab-47b1-acab-4da91e894f99 req-974488af-f38e-4e9d-b06e-c22692ff45c2 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:23.326390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-797e8105-f1ab-47b1-acab-4da91e894f99 req-974488af-f38e-4e9d-b06e-c22692ff45c2 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:23.337674 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-797e8105-f1ab-47b1-acab-4da91e894f99 req-974488af-f38e-4e9d-b06e-c22692ff45c2 service nova] Creating event network-vif-plugged:45334afa-e55a-4177-a70b-0d423fb28ae1 for instance 0b9185a2-5afd-4c39-bb28-beb531d58eb0 on hv-cinder-80588 Sep 14 19:42:23.338187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-797e8105-f1ab-47b1-acab-4da91e894f99 req-974488af-f38e-4e9d-b06e-c22692ff45c2 service nova] Creating event network-vif-plugged:aed2c83a-d427-4091-9962-b9bcc094af29 for instance 0be387eb-e7de-4f9f-b3ee-23068e618bf4 on hv-cinder-80588 Sep 14 19:42:23.345068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-797e8105-f1ab-47b1-acab-4da91e894f99 req-974488af-f38e-4e9d-b06e-c22692ff45c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038013 Sep 14 19:42:23.345723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 69/141] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:42:23 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:42:23.427875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-aa5e8966-5069-4547-a88e-4d988352c186 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:23.436088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-aa5e8966-5069-4547-a88e-4d988352c186 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:23.437612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-aa5e8966-5069-4547-a88e-4d988352c186 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:23.438802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-aa5e8966-5069-4547-a88e-4d988352c186 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.154492 Sep 14 19:42:23.439365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 73/142] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:23.525564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2dbb0dcd-1a6a-4109-8bdb-4cf3ec0ec80c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:23.526257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2dbb0dcd-1a6a-4109-8bdb-4cf3ec0ec80c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:23.532294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2dbb0dcd-1a6a-4109-8bdb-4cf3ec0ec80c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:23.532731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2dbb0dcd-1a6a-4109-8bdb-4cf3ec0ec80c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:23.533481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2dbb0dcd-1a6a-4109-8bdb-4cf3ec0ec80c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:23.533965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2dbb0dcd-1a6a-4109-8bdb-4cf3ec0ec80c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:23.653176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2dbb0dcd-1a6a-4109-8bdb-4cf3ec0ec80c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:23.660787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2dbb0dcd-1a6a-4109-8bdb-4cf3ec0ec80c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.139270 Sep 14 19:42:23.661345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 70/143] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:23 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:24.456275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-db891ba3-8805-4d01-b208-a02e4aa339b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:24.457449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-db891ba3-8805-4d01-b208-a02e4aa339b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:24.464126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-db891ba3-8805-4d01-b208-a02e4aa339b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:24.464620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-db891ba3-8805-4d01-b208-a02e4aa339b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:24.465742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-db891ba3-8805-4d01-b208-a02e4aa339b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:24.466768 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-db891ba3-8805-4d01-b208-a02e4aa339b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:24.591945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-db891ba3-8805-4d01-b208-a02e4aa339b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:24.599753 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-db891ba3-8805-4d01-b208-a02e4aa339b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:24.601373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-db891ba3-8805-4d01-b208-a02e4aa339b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:24.602497 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-db891ba3-8805-4d01-b208-a02e4aa339b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.149949 Sep 14 19:42:24.603065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 74/144] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:24.678260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-20346208-e358-429c-94d9-b2dd9c7bfd10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:24.678864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-20346208-e358-429c-94d9-b2dd9c7bfd10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:24.684752 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20346208-e358-429c-94d9-b2dd9c7bfd10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:24.685201 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20346208-e358-429c-94d9-b2dd9c7bfd10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:24.690537 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20346208-e358-429c-94d9-b2dd9c7bfd10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:24.690537 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20346208-e358-429c-94d9-b2dd9c7bfd10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:24.830506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-20346208-e358-429c-94d9-b2dd9c7bfd10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:24.838695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-20346208-e358-429c-94d9-b2dd9c7bfd10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.164448 Sep 14 19:42:24.840303 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 71/145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:24 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:25.178153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-079c1072-7df8-443c-8efc-55d712f3370d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57e673f4-d81a-4708-916f-25349cf4ec0d"}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:25.179201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-079c1072-7df8-443c-8efc-55d712f3370d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:25.184868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-079c1072-7df8-443c-8efc-55d712f3370d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:25.185315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-079c1072-7df8-443c-8efc-55d712f3370d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:25.186187 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-079c1072-7df8-443c-8efc-55d712f3370d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:25.186619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-079c1072-7df8-443c-8efc-55d712f3370d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:25.620280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-08339d6c-c80e-449b-977a-ab10f59be74a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:25.620886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-08339d6c-c80e-449b-977a-ab10f59be74a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:25.627083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08339d6c-c80e-449b-977a-ab10f59be74a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:25.627532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08339d6c-c80e-449b-977a-ab10f59be74a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:25.628387 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08339d6c-c80e-449b-977a-ab10f59be74a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:25.629279 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08339d6c-c80e-449b-977a-ab10f59be74a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:25.760944 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-08339d6c-c80e-449b-977a-ab10f59be74a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:25.766041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-08339d6c-c80e-449b-977a-ab10f59be74a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:25.767688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-08339d6c-c80e-449b-977a-ab10f59be74a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:25.768828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-08339d6c-c80e-449b-977a-ab10f59be74a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1405 microversion: 2.20 time: 0.152529 Sep 14 19:42:25.769543 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 72/146] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:42:25.861993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f01d5250-b5f0-47a2-b160-e5bfda26d0b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:25.862598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f01d5250-b5f0-47a2-b160-e5bfda26d0b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:25.868845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f01d5250-b5f0-47a2-b160-e5bfda26d0b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:25.869539 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f01d5250-b5f0-47a2-b160-e5bfda26d0b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:25.870475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f01d5250-b5f0-47a2-b160-e5bfda26d0b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:25.870912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f01d5250-b5f0-47a2-b160-e5bfda26d0b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:26.000432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f01d5250-b5f0-47a2-b160-e5bfda26d0b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:26.008305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f01d5250-b5f0-47a2-b160-e5bfda26d0b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1322 microversion: 2.1 time: 0.149835 Sep 14 19:42:26.008874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 73/147] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:25 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:26.013739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f746554e-1a12-448e-832e-af0b6f645015 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c80f692-a341-42ea-bc02-86fcfb059420"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:26.015200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f746554e-1a12-448e-832e-af0b6f645015 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:26.022773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f746554e-1a12-448e-832e-af0b6f645015 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:26.023528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f746554e-1a12-448e-832e-af0b6f645015 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:26.024790 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f746554e-1a12-448e-832e-af0b6f645015 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:26.025378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f746554e-1a12-448e-832e-af0b6f645015 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:26.588920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-079c1072-7df8-443c-8efc-55d712f3370d tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "POST /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.414704 Sep 14 19:42:26.594066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 75/148] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Sep 14 19:42:25 2021] POST /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea/os-volume_attachments => generated 194 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:42:26.796295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-eaa0eea6-7ecc-4ce7-b701-4974da99d8b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:26.797560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-eaa0eea6-7ecc-4ce7-b701-4974da99d8b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:26.805837 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaa0eea6-7ecc-4ce7-b701-4974da99d8b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:26.806303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaa0eea6-7ecc-4ce7-b701-4974da99d8b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:26.807201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaa0eea6-7ecc-4ce7-b701-4974da99d8b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:26.807650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaa0eea6-7ecc-4ce7-b701-4974da99d8b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:26.940541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-eaa0eea6-7ecc-4ce7-b701-4974da99d8b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:26.949045 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-eaa0eea6-7ecc-4ce7-b701-4974da99d8b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:26.950650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-eaa0eea6-7ecc-4ce7-b701-4974da99d8b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:26.951872 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-eaa0eea6-7ecc-4ce7-b701-4974da99d8b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1597 microversion: 2.20 time: 0.169240 Sep 14 19:42:26.952434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 76/149] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:42:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1597 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:42:26.970518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cedd6f76-310c-4e36-8631-436f40b1d6aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:26.972024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cedd6f76-310c-4e36-8631-436f40b1d6aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:26.977279 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cedd6f76-310c-4e36-8631-436f40b1d6aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:26.977854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cedd6f76-310c-4e36-8631-436f40b1d6aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:26.978706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cedd6f76-310c-4e36-8631-436f40b1d6aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:26.979204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cedd6f76-310c-4e36-8631-436f40b1d6aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:27.087634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cedd6f76-310c-4e36-8631-436f40b1d6aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.117603 Sep 14 19:42:27.087634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 77/150] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Sep 14 19:42:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:42:27.089438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a1a00bea-ef8d-4008-8ac7-2c8f0af2b258 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:27.090078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a1a00bea-ef8d-4008-8ac7-2c8f0af2b258 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:27.096736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1a00bea-ef8d-4008-8ac7-2c8f0af2b258 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:27.097207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1a00bea-ef8d-4008-8ac7-2c8f0af2b258 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:27.098032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1a00bea-ef8d-4008-8ac7-2c8f0af2b258 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:27.098619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1a00bea-ef8d-4008-8ac7-2c8f0af2b258 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:27.194810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f746554e-1a12-448e-832e-af0b6f645015 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "POST /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.184203 Sep 14 19:42:27.204578 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 74/151] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Sep 14 19:42:26 2021] POST /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d/os-volume_attachments => generated 194 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:42:27.250564 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a1a00bea-ef8d-4008-8ac7-2c8f0af2b258 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:27.255373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a1a00bea-ef8d-4008-8ac7-2c8f0af2b258 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1515 microversion: 2.1 time: 0.169415 Sep 14 19:42:27.255957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 78/152] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:27 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:27.279401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e4cf336e-6ab8-4f33-9d65-0fcbabd5e281 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:27.281481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e4cf336e-6ab8-4f33-9d65-0fcbabd5e281 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:27.293685 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4cf336e-6ab8-4f33-9d65-0fcbabd5e281 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:27.294942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4cf336e-6ab8-4f33-9d65-0fcbabd5e281 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:27.296888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4cf336e-6ab8-4f33-9d65-0fcbabd5e281 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:27.297857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4cf336e-6ab8-4f33-9d65-0fcbabd5e281 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:27.332808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-e4cf336e-6ab8-4f33-9d65-0fcbabd5e281 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lazy-loading 'flavor' on Instance uuid 0be387eb-e7de-4f9f-b3ee-23068e618bf4 {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:42:27.676357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e4cf336e-6ab8-4f33-9d65-0fcbabd5e281 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "POST /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4/action" status: 200 len: 32 microversion: 2.1 time: 0.406079 Sep 14 19:42:27.677313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 75/153] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:42:27 2021] POST /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:42:27.687430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-964a8ddb-137a-4181-8e45-c20570274485 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:27.688159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-964a8ddb-137a-4181-8e45-c20570274485 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:27.694191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-964a8ddb-137a-4181-8e45-c20570274485 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:27.694644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-964a8ddb-137a-4181-8e45-c20570274485 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:27.695438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-964a8ddb-137a-4181-8e45-c20570274485 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:27.696065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-964a8ddb-137a-4181-8e45-c20570274485 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:27.872023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-964a8ddb-137a-4181-8e45-c20570274485 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:27.887762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-964a8ddb-137a-4181-8e45-c20570274485 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.198220 Sep 14 19:42:27.887762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 79/154] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:27 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:28.605398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-809accd8-352c-4838-b611-da06e3191a0f req-88ae50f6-e0b1-4e2a-b29c-63d6f5837327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a26129-f7fb-4755-979a-968cdf0c7d34", "tag": "f0babfc4-e4f0-41d5-9206-dc7125b0b10e"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:28.609185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f103af58-db61-49ef-ae36-5ab096c86456 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:28.610316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:28.610316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:42:28.614229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f103af58-db61-49ef-ae36-5ab096c86456 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:28.627120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f103af58-db61-49ef-ae36-5ab096c86456 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:28.627603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f103af58-db61-49ef-ae36-5ab096c86456 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:28.628977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f103af58-db61-49ef-ae36-5ab096c86456 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:28.629411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f103af58-db61-49ef-ae36-5ab096c86456 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:28.634700 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-809accd8-352c-4838-b611-da06e3191a0f req-88ae50f6-e0b1-4e2a-b29c-63d6f5837327 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:28.635140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-809accd8-352c-4838-b611-da06e3191a0f req-88ae50f6-e0b1-4e2a-b29c-63d6f5837327 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:28.649128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-809accd8-352c-4838-b611-da06e3191a0f req-88ae50f6-e0b1-4e2a-b29c-63d6f5837327 service nova] Creating event network-changed:f0babfc4-e4f0-41d5-9206-dc7125b0b10e for instance 72a26129-f7fb-4755-979a-968cdf0c7d34 on hv-cinder-80588 Sep 14 19:42:28.656247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-809accd8-352c-4838-b611-da06e3191a0f req-88ae50f6-e0b1-4e2a-b29c-63d6f5837327 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054275 Sep 14 19:42:28.657083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 80/155] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:42:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:42:28.901218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f31d060a-2b45-4638-9b0e-97d05b0c647c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:28.902609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f31d060a-2b45-4638-9b0e-97d05b0c647c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:28.912156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f31d060a-2b45-4638-9b0e-97d05b0c647c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:28.913403 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f31d060a-2b45-4638-9b0e-97d05b0c647c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:28.913622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f31d060a-2b45-4638-9b0e-97d05b0c647c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:28.914131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f31d060a-2b45-4638-9b0e-97d05b0c647c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:29.062604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f31d060a-2b45-4638-9b0e-97d05b0c647c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:29.069367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f31d060a-2b45-4638-9b0e-97d05b0c647c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.173287 Sep 14 19:42:29.078984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 81/156] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:28 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:30.085840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cd71d7e3-3e93-41cc-a0c4-ca2246d4b9a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:30.086648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cd71d7e3-3e93-41cc-a0c4-ca2246d4b9a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:30.092443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd71d7e3-3e93-41cc-a0c4-ca2246d4b9a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:30.092924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd71d7e3-3e93-41cc-a0c4-ca2246d4b9a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:30.093731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd71d7e3-3e93-41cc-a0c4-ca2246d4b9a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:30.094171 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd71d7e3-3e93-41cc-a0c4-ca2246d4b9a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:30.221813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cd71d7e3-3e93-41cc-a0c4-ca2246d4b9a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:30.231316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cd71d7e3-3e93-41cc-a0c4-ca2246d4b9a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.149220 Sep 14 19:42:30.231885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 82/157] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:30 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:31.248274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f2771b4c-2a2d-4680-bff3-b6211d277c17 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:31.248936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f2771b4c-2a2d-4680-bff3-b6211d277c17 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:31.256007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f2771b4c-2a2d-4680-bff3-b6211d277c17 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:31.256457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f2771b4c-2a2d-4680-bff3-b6211d277c17 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:31.257240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f2771b4c-2a2d-4680-bff3-b6211d277c17 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:31.257895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f2771b4c-2a2d-4680-bff3-b6211d277c17 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:31.265596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f103af58-db61-49ef-ae36-5ab096c86456 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 14 microversion: 2.20 time: 2.666449 Sep 14 19:42:31.271144 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 76/158] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:28 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 14 bytes in 2674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:31.745963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f2771b4c-2a2d-4680-bff3-b6211d277c17 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:31.755480 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f2771b4c-2a2d-4680-bff3-b6211d277c17 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.510463 Sep 14 19:42:31.756164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 83/159] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:31 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:32.278293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c9f4f734-6634-489e-ad04-d278ab555063 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:32.279351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c9f4f734-6634-489e-ad04-d278ab555063 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:32.285919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9f4f734-6634-489e-ad04-d278ab555063 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:32.286471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9f4f734-6634-489e-ad04-d278ab555063 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:32.287249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9f4f734-6634-489e-ad04-d278ab555063 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:32.287687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9f4f734-6634-489e-ad04-d278ab555063 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:32.772619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bcc6493a-0db9-4b31-a746-f237c7bcbbd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:32.773230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bcc6493a-0db9-4b31-a746-f237c7bcbbd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:32.779202 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bcc6493a-0db9-4b31-a746-f237c7bcbbd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:32.779653 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bcc6493a-0db9-4b31-a746-f237c7bcbbd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:32.780426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bcc6493a-0db9-4b31-a746-f237c7bcbbd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:32.780909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bcc6493a-0db9-4b31-a746-f237c7bcbbd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:32.921743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bcc6493a-0db9-4b31-a746-f237c7bcbbd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:32.928941 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bcc6493a-0db9-4b31-a746-f237c7bcbbd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.160650 Sep 14 19:42:32.929595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 84/160] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:32 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:33.945151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9731158e-6749-428a-8425-0b42d70adafb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:33.945808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9731158e-6749-428a-8425-0b42d70adafb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:33.951446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9731158e-6749-428a-8425-0b42d70adafb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:33.951898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9731158e-6749-428a-8425-0b42d70adafb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:33.952681 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9731158e-6749-428a-8425-0b42d70adafb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:33.953139 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9731158e-6749-428a-8425-0b42d70adafb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:34.070847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9731158e-6749-428a-8425-0b42d70adafb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:34.078041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9731158e-6749-428a-8425-0b42d70adafb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.136486 Sep 14 19:42:34.078606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 85/161] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:33 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:34.970240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c9f4f734-6634-489e-ad04-d278ab555063 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 14 microversion: 2.20 time: 2.695709 Sep 14 19:42:34.970888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 77/162] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:32 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 14 bytes in 2697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:35.094455 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d2ebb916-7511-4050-9695-28c3461c3edc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:35.095023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d2ebb916-7511-4050-9695-28c3461c3edc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:35.101660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d2ebb916-7511-4050-9695-28c3461c3edc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:35.102310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d2ebb916-7511-4050-9695-28c3461c3edc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:35.103093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d2ebb916-7511-4050-9695-28c3461c3edc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:35.103531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d2ebb916-7511-4050-9695-28c3461c3edc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:35.300119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d2ebb916-7511-4050-9695-28c3461c3edc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:35.307434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d2ebb916-7511-4050-9695-28c3461c3edc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.216866 Sep 14 19:42:35.308010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 86/163] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:35 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:35.981615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4c72505a-dd16-412a-84f5-76b0cb90f983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:35.982635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4c72505a-dd16-412a-84f5-76b0cb90f983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:35.989538 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c72505a-dd16-412a-84f5-76b0cb90f983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:35.989996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c72505a-dd16-412a-84f5-76b0cb90f983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:35.990772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c72505a-dd16-412a-84f5-76b0cb90f983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:35.991209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c72505a-dd16-412a-84f5-76b0cb90f983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:36.331664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-097ec5e6-1b58-4b9e-8d7a-6142197fd7a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:36.332358 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-097ec5e6-1b58-4b9e-8d7a-6142197fd7a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:36.338191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-097ec5e6-1b58-4b9e-8d7a-6142197fd7a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:36.338636 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-097ec5e6-1b58-4b9e-8d7a-6142197fd7a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:36.339399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-097ec5e6-1b58-4b9e-8d7a-6142197fd7a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:36.339838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-097ec5e6-1b58-4b9e-8d7a-6142197fd7a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:36.458225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-097ec5e6-1b58-4b9e-8d7a-6142197fd7a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:36.465616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-097ec5e6-1b58-4b9e-8d7a-6142197fd7a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.137745 Sep 14 19:42:36.466191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 87/164] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:36 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:37.482814 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-107321cf-5513-4923-9dd9-6d3ca7bc627d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:37.483479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-107321cf-5513-4923-9dd9-6d3ca7bc627d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:37.489787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-107321cf-5513-4923-9dd9-6d3ca7bc627d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:37.490246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-107321cf-5513-4923-9dd9-6d3ca7bc627d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:37.491017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-107321cf-5513-4923-9dd9-6d3ca7bc627d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:37.491458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-107321cf-5513-4923-9dd9-6d3ca7bc627d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:37.609627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-107321cf-5513-4923-9dd9-6d3ca7bc627d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:37.617562 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-107321cf-5513-4923-9dd9-6d3ca7bc627d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.138309 Sep 14 19:42:37.618152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 88/165] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:37 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:38.385060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4c72505a-dd16-412a-84f5-76b0cb90f983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 14 microversion: 2.20 time: 2.407235 Sep 14 19:42:38.385735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 78/166] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:35 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 14 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:38.634106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f003961a-d3cb-4863-98da-9a492b659a0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:38.634689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f003961a-d3cb-4863-98da-9a492b659a0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:38.640337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f003961a-d3cb-4863-98da-9a492b659a0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:38.640713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f003961a-d3cb-4863-98da-9a492b659a0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:38.641465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f003961a-d3cb-4863-98da-9a492b659a0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:38.641919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f003961a-d3cb-4863-98da-9a492b659a0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:38.766130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f003961a-d3cb-4863-98da-9a492b659a0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:38.774100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f003961a-d3cb-4863-98da-9a492b659a0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.143602 Sep 14 19:42:38.783686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 89/167] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:38 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:39.397183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f839f91e-3097-47b2-8516-0379ef7bf68f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:39.398134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f839f91e-3097-47b2-8516-0379ef7bf68f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:39.404536 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f839f91e-3097-47b2-8516-0379ef7bf68f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:39.404975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f839f91e-3097-47b2-8516-0379ef7bf68f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:39.405756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f839f91e-3097-47b2-8516-0379ef7bf68f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:39.406187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f839f91e-3097-47b2-8516-0379ef7bf68f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:39.483636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f839f91e-3097-47b2-8516-0379ef7bf68f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 14 microversion: 2.20 time: 0.091014 Sep 14 19:42:39.484278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 79/168] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:39 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:39.790984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c5a3269f-7b05-4429-bccb-438f22e51187 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:39.791596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c5a3269f-7b05-4429-bccb-438f22e51187 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:39.797962 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5a3269f-7b05-4429-bccb-438f22e51187 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:39.798445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5a3269f-7b05-4429-bccb-438f22e51187 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:39.799222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5a3269f-7b05-4429-bccb-438f22e51187 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:39.799665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5a3269f-7b05-4429-bccb-438f22e51187 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:39.928029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c5a3269f-7b05-4429-bccb-438f22e51187 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:39.936147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c5a3269f-7b05-4429-bccb-438f22e51187 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.148661 Sep 14 19:42:39.936875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 90/169] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:39 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:40.494779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9a17e43e-05f1-47cf-9da6-760cddbbd4c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:40.500489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9a17e43e-05f1-47cf-9da6-760cddbbd4c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:40.507954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9a17e43e-05f1-47cf-9da6-760cddbbd4c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:40.508396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9a17e43e-05f1-47cf-9da6-760cddbbd4c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:40.509162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9a17e43e-05f1-47cf-9da6-760cddbbd4c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:40.509616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9a17e43e-05f1-47cf-9da6-760cddbbd4c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:40.952934 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-06cc07c4-17c6-49db-9929-6b5f3d2f2e91 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:40.953464 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-06cc07c4-17c6-49db-9929-6b5f3d2f2e91 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:40.959860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06cc07c4-17c6-49db-9929-6b5f3d2f2e91 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:40.960306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06cc07c4-17c6-49db-9929-6b5f3d2f2e91 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:40.961077 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06cc07c4-17c6-49db-9929-6b5f3d2f2e91 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:40.961535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06cc07c4-17c6-49db-9929-6b5f3d2f2e91 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:41.089946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-06cc07c4-17c6-49db-9929-6b5f3d2f2e91 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:41.097880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-06cc07c4-17c6-49db-9929-6b5f3d2f2e91 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.148170 Sep 14 19:42:41.098457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 91/170] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:40 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:42.114557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-87d4f0b7-a0da-494e-bef0-86e7494ec429 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:42.115163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-87d4f0b7-a0da-494e-bef0-86e7494ec429 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:42.122289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87d4f0b7-a0da-494e-bef0-86e7494ec429 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:42.122830 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87d4f0b7-a0da-494e-bef0-86e7494ec429 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:42.123700 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87d4f0b7-a0da-494e-bef0-86e7494ec429 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:42.124292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87d4f0b7-a0da-494e-bef0-86e7494ec429 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:42.252302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-87d4f0b7-a0da-494e-bef0-86e7494ec429 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:42.260498 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-87d4f0b7-a0da-494e-bef0-86e7494ec429 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.149563 Sep 14 19:42:42.261085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 92/171] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:42 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:43.277641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-016e3195-3e17-4d83-8eb3-243a90e94f53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:43.282563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-016e3195-3e17-4d83-8eb3-243a90e94f53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:43.284536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-016e3195-3e17-4d83-8eb3-243a90e94f53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:43.284993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-016e3195-3e17-4d83-8eb3-243a90e94f53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:43.285834 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-016e3195-3e17-4d83-8eb3-243a90e94f53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:43.286274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-016e3195-3e17-4d83-8eb3-243a90e94f53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:43.334164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9a17e43e-05f1-47cf-9da6-760cddbbd4c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 6451 microversion: 2.20 time: 2.843235 Sep 14 19:42:43.335126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 80/172] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:40 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 6451 bytes in 2845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:42:43.409973 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-016e3195-3e17-4d83-8eb3-243a90e94f53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:43.417004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-016e3195-3e17-4d83-8eb3-243a90e94f53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.143120 Sep 14 19:42:43.417546 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 93/173] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:43 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:44.345275 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-38f0aa83-7002-4d9e-8982-2a8e0a6fd999 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:44.347445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-38f0aa83-7002-4d9e-8982-2a8e0a6fd999 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:44.353932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-38f0aa83-7002-4d9e-8982-2a8e0a6fd999 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:44.354376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-38f0aa83-7002-4d9e-8982-2a8e0a6fd999 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:44.355149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-38f0aa83-7002-4d9e-8982-2a8e0a6fd999 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:44.355590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-38f0aa83-7002-4d9e-8982-2a8e0a6fd999 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:44.434908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e1640a8f-1b3a-4ae7-b5b2-8edcf60dc656 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:44.435519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e1640a8f-1b3a-4ae7-b5b2-8edcf60dc656 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:44.441911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1640a8f-1b3a-4ae7-b5b2-8edcf60dc656 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:44.442251 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1640a8f-1b3a-4ae7-b5b2-8edcf60dc656 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:44.443034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1640a8f-1b3a-4ae7-b5b2-8edcf60dc656 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:44.443461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1640a8f-1b3a-4ae7-b5b2-8edcf60dc656 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:44.459068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-38f0aa83-7002-4d9e-8982-2a8e0a6fd999 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 10893 microversion: 2.20 time: 0.117805 Sep 14 19:42:44.459750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 81/174] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:44 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 10893 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:42:44.571254 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e1640a8f-1b3a-4ae7-b5b2-8edcf60dc656 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:44.579631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e1640a8f-1b3a-4ae7-b5b2-8edcf60dc656 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.148394 Sep 14 19:42:44.592788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 94/175] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:44 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:45.470891 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c72bf25f-c26d-442a-a796-60d07fb86761 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:45.471917 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c72bf25f-c26d-442a-a796-60d07fb86761 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:45.479162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c72bf25f-c26d-442a-a796-60d07fb86761 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:45.479594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c72bf25f-c26d-442a-a796-60d07fb86761 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:45.480363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c72bf25f-c26d-442a-a796-60d07fb86761 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:45.480782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c72bf25f-c26d-442a-a796-60d07fb86761 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:45.570159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c72bf25f-c26d-442a-a796-60d07fb86761 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 15025 microversion: 2.20 time: 0.103015 Sep 14 19:42:45.571695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 82/176] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:45 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 15025 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:42:45.613004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a42616b8-1bd6-40a4-9d65-69f5e7428260 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:45.613004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a42616b8-1bd6-40a4-9d65-69f5e7428260 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:45.613004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a42616b8-1bd6-40a4-9d65-69f5e7428260 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:45.613004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a42616b8-1bd6-40a4-9d65-69f5e7428260 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:45.613650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a42616b8-1bd6-40a4-9d65-69f5e7428260 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:45.613650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a42616b8-1bd6-40a4-9d65-69f5e7428260 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:45.765142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a42616b8-1bd6-40a4-9d65-69f5e7428260 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:45.778722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a42616b8-1bd6-40a4-9d65-69f5e7428260 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.182065 Sep 14 19:42:45.778722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 95/177] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:45 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:46.582754 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-98cb107e-c31e-4e6a-9b82-2e22f5c6f3d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:46.583736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-98cb107e-c31e-4e6a-9b82-2e22f5c6f3d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:46.591482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98cb107e-c31e-4e6a-9b82-2e22f5c6f3d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:46.592223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98cb107e-c31e-4e6a-9b82-2e22f5c6f3d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:46.593088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98cb107e-c31e-4e6a-9b82-2e22f5c6f3d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:46.593659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98cb107e-c31e-4e6a-9b82-2e22f5c6f3d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:46.795226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-82c84935-0633-492c-bb7d-b15cf92f9549 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:46.795226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-82c84935-0633-492c-bb7d-b15cf92f9549 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:46.809419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-82c84935-0633-492c-bb7d-b15cf92f9549 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:46.809419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-82c84935-0633-492c-bb7d-b15cf92f9549 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:46.809419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-82c84935-0633-492c-bb7d-b15cf92f9549 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:46.809419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-82c84935-0633-492c-bb7d-b15cf92f9549 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:46.931573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-82c84935-0633-492c-bb7d-b15cf92f9549 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:46.939159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-82c84935-0633-492c-bb7d-b15cf92f9549 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.150225 Sep 14 19:42:46.939660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 96/178] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:46 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:47.957122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ed8bcb55-c88c-49ab-bcb0-8a5e4a5cf89f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:47.957753 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ed8bcb55-c88c-49ab-bcb0-8a5e4a5cf89f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:47.963625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed8bcb55-c88c-49ab-bcb0-8a5e4a5cf89f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:47.964065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed8bcb55-c88c-49ab-bcb0-8a5e4a5cf89f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:47.964853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed8bcb55-c88c-49ab-bcb0-8a5e4a5cf89f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:47.965299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed8bcb55-c88c-49ab-bcb0-8a5e4a5cf89f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:48.089851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ed8bcb55-c88c-49ab-bcb0-8a5e4a5cf89f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:48.097340 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ed8bcb55-c88c-49ab-bcb0-8a5e4a5cf89f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.144422 Sep 14 19:42:48.097948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 97/179] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:47 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:48.756873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-98cb107e-c31e-4e6a-9b82-2e22f5c6f3d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 17263 microversion: 2.20 time: 2.178466 Sep 14 19:42:48.757519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 83/180] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:46 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 17263 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:42:49.113680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-361c6c2f-241d-4eaf-847c-805394666689 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:49.114327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-361c6c2f-241d-4eaf-847c-805394666689 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:49.120507 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-361c6c2f-241d-4eaf-847c-805394666689 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:49.120959 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-361c6c2f-241d-4eaf-847c-805394666689 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:49.121767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-361c6c2f-241d-4eaf-847c-805394666689 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:49.122206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-361c6c2f-241d-4eaf-847c-805394666689 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:49.244875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-361c6c2f-241d-4eaf-847c-805394666689 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:49.253400 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-361c6c2f-241d-4eaf-847c-805394666689 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.143226 Sep 14 19:42:49.254490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 98/181] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:49 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:49.603775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-489c1fc9-6ae7-411b-a679-6100c2dd68cb tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:49.604352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-489c1fc9-6ae7-411b-a679-6100c2dd68cb tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:49.610890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-489c1fc9-6ae7-411b-a679-6100c2dd68cb tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:49.611345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-489c1fc9-6ae7-411b-a679-6100c2dd68cb tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:49.612119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-489c1fc9-6ae7-411b-a679-6100c2dd68cb tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:49.612596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-489c1fc9-6ae7-411b-a679-6100c2dd68cb tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:49.638398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-489c1fc9-6ae7-411b-a679-6100c2dd68cb tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Going to try to terminate instance {{(pid=115679) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 19:42:49.768121 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-788eb328-960d-403e-9cd1-3748c11217b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:49.769604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-788eb328-960d-403e-9cd1-3748c11217b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:49.775520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-788eb328-960d-403e-9cd1-3748c11217b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:49.775971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-788eb328-960d-403e-9cd1-3748c11217b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:49.776750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-788eb328-960d-403e-9cd1-3748c11217b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:49.777189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-788eb328-960d-403e-9cd1-3748c11217b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:49.892992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-788eb328-960d-403e-9cd1-3748c11217b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 19342 microversion: 2.20 time: 0.128414 Sep 14 19:42:49.894278 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 99/182] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:49 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 19342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:42:49.979587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-489c1fc9-6ae7-411b-a679-6100c2dd68cb tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 204 len: 0 microversion: 2.1 time: 0.379642 Sep 14 19:42:49.980188 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 84/183] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 19:42:49 2021] DELETE /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:42:49.990002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6f7b6faf-f60e-41d5-945e-dc8a968dbf42 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:49.990699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6f7b6faf-f60e-41d5-945e-dc8a968dbf42 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:49.997443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6f7b6faf-f60e-41d5-945e-dc8a968dbf42 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:49.997940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6f7b6faf-f60e-41d5-945e-dc8a968dbf42 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:49.998801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6f7b6faf-f60e-41d5-945e-dc8a968dbf42 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:49.999293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6f7b6faf-f60e-41d5-945e-dc8a968dbf42 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:50.187470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6f7b6faf-f60e-41d5-945e-dc8a968dbf42 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:50.195510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6f7b6faf-f60e-41d5-945e-dc8a968dbf42 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1553 microversion: 2.1 time: 0.210279 Sep 14 19:42:50.196368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 100/184] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:49 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:50.272597 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-25cd0bc9-a4d1-4ef8-ab80-668b8d870866 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:50.273394 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-25cd0bc9-a4d1-4ef8-ab80-668b8d870866 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:50.279928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25cd0bc9-a4d1-4ef8-ab80-668b8d870866 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:50.280489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25cd0bc9-a4d1-4ef8-ab80-668b8d870866 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:50.281350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25cd0bc9-a4d1-4ef8-ab80-668b8d870866 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:50.281812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25cd0bc9-a4d1-4ef8-ab80-668b8d870866 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:50.415036 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-25cd0bc9-a4d1-4ef8-ab80-668b8d870866 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:50.422998 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-25cd0bc9-a4d1-4ef8-ab80-668b8d870866 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.154795 Sep 14 19:42:50.423578 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 85/185] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:50 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:50.905591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f84be88e-4d5f-4d37-b163-f98bade6dce5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:50.906790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f84be88e-4d5f-4d37-b163-f98bade6dce5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:50.913327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f84be88e-4d5f-4d37-b163-f98bade6dce5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:50.913817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f84be88e-4d5f-4d37-b163-f98bade6dce5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:50.916106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f84be88e-4d5f-4d37-b163-f98bade6dce5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:50.916106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f84be88e-4d5f-4d37-b163-f98bade6dce5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:51.027904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f84be88e-4d5f-4d37-b163-f98bade6dce5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 21211 microversion: 2.20 time: 0.126681 Sep 14 19:42:51.028550 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 101/186] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:50 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 21211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:42:51.213214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e234ce20-b76c-48c4-83e1-2c5af06571e8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:51.213863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e234ce20-b76c-48c4-83e1-2c5af06571e8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:51.220818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e234ce20-b76c-48c4-83e1-2c5af06571e8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:51.221840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e234ce20-b76c-48c4-83e1-2c5af06571e8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:51.222627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e234ce20-b76c-48c4-83e1-2c5af06571e8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:51.223323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e234ce20-b76c-48c4-83e1-2c5af06571e8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:51.368658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e234ce20-b76c-48c4-83e1-2c5af06571e8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:51.378503 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e234ce20-b76c-48c4-83e1-2c5af06571e8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1553 microversion: 2.1 time: 0.168880 Sep 14 19:42:51.379097 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 86/187] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:51 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:51.445878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2f4979a6-5ff8-46cb-9183-848b6e5f19b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:51.445878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2f4979a6-5ff8-46cb-9183-848b6e5f19b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:51.448445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f4979a6-5ff8-46cb-9183-848b6e5f19b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:51.448899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f4979a6-5ff8-46cb-9183-848b6e5f19b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:51.449835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f4979a6-5ff8-46cb-9183-848b6e5f19b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:51.450278 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f4979a6-5ff8-46cb-9183-848b6e5f19b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:51.583143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2f4979a6-5ff8-46cb-9183-848b6e5f19b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:51.590816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2f4979a6-5ff8-46cb-9183-848b6e5f19b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.154660 Sep 14 19:42:51.591592 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 102/188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:51 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:52.045250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2646332c-81ea-4fc6-98c1-b36d057165e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:52.046298 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2646332c-81ea-4fc6-98c1-b36d057165e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:52.053441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2646332c-81ea-4fc6-98c1-b36d057165e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:52.053935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2646332c-81ea-4fc6-98c1-b36d057165e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:52.054740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2646332c-81ea-4fc6-98c1-b36d057165e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:52.055184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2646332c-81ea-4fc6-98c1-b36d057165e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:52.148609 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2646332c-81ea-4fc6-98c1-b36d057165e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 22587 microversion: 2.20 time: 0.107949 Sep 14 19:42:52.152737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 87/189] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:52 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 22587 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:42:52.398198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-87d1ae45-7835-48dd-804d-361ce5980fc9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:52.398802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-87d1ae45-7835-48dd-804d-361ce5980fc9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:52.404761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87d1ae45-7835-48dd-804d-361ce5980fc9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:52.405211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87d1ae45-7835-48dd-804d-361ce5980fc9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:52.406150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87d1ae45-7835-48dd-804d-361ce5980fc9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:52.406602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87d1ae45-7835-48dd-804d-361ce5980fc9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:52.534597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-87d1ae45-7835-48dd-804d-361ce5980fc9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:52.543935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-87d1ae45-7835-48dd-804d-361ce5980fc9 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1553 microversion: 2.1 time: 0.150955 Sep 14 19:42:52.544504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 103/190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:52 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:52.613273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c4aeb8af-dddb-4d0a-94a3-2b897e364621 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:52.616054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c4aeb8af-dddb-4d0a-94a3-2b897e364621 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:52.624978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c4aeb8af-dddb-4d0a-94a3-2b897e364621 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:52.624978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c4aeb8af-dddb-4d0a-94a3-2b897e364621 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:52.625271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c4aeb8af-dddb-4d0a-94a3-2b897e364621 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:52.625819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c4aeb8af-dddb-4d0a-94a3-2b897e364621 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:52.770676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c4aeb8af-dddb-4d0a-94a3-2b897e364621 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:52.779026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c4aeb8af-dddb-4d0a-94a3-2b897e364621 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.174849 Sep 14 19:42:52.779644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 88/191] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:52 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:53.161110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-55abdbc4-4ad9-4b97-b0b9-83851ca3f070 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:53.162210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-55abdbc4-4ad9-4b97-b0b9-83851ca3f070 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:53.169247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55abdbc4-4ad9-4b97-b0b9-83851ca3f070 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:53.169939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55abdbc4-4ad9-4b97-b0b9-83851ca3f070 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:53.171645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55abdbc4-4ad9-4b97-b0b9-83851ca3f070 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:53.172323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55abdbc4-4ad9-4b97-b0b9-83851ca3f070 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:53.264377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-55abdbc4-4ad9-4b97-b0b9-83851ca3f070 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 23792 microversion: 2.20 time: 0.106812 Sep 14 19:42:53.265219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 104/192] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:53 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 23792 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:42:53.481679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-7df060db-09e0-42c7-aedc-0e67643c7fe5 req-fda52c44-5560-406e-9daf-6214222d68b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea", "name": "network-vif-deleted", "tag": "7b992f7d-a9b4-4b25-b967-bcf20c9cd38a"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:53.483348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:42:53.483348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:42:53.490893 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-7df060db-09e0-42c7-aedc-0e67643c7fe5 req-fda52c44-5560-406e-9daf-6214222d68b6 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:53.491361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-7df060db-09e0-42c7-aedc-0e67643c7fe5 req-fda52c44-5560-406e-9daf-6214222d68b6 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:53.502504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-7df060db-09e0-42c7-aedc-0e67643c7fe5 req-fda52c44-5560-406e-9daf-6214222d68b6 service nova] Creating event network-vif-deleted:7b992f7d-a9b4-4b25-b967-bcf20c9cd38a for instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea on hv-cinder-80588 Sep 14 19:42:53.507577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-7df060db-09e0-42c7-aedc-0e67643c7fe5 req-fda52c44-5560-406e-9daf-6214222d68b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029478 Sep 14 19:42:53.508439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 89/193] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:42:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:42:53.562989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1b5c525b-ec00-4c4f-96b7-ab5799af35e3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:53.564153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1b5c525b-ec00-4c4f-96b7-ab5799af35e3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:53.575008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b5c525b-ec00-4c4f-96b7-ab5799af35e3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:53.575672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b5c525b-ec00-4c4f-96b7-ab5799af35e3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:53.577355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b5c525b-ec00-4c4f-96b7-ab5799af35e3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:53.578116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b5c525b-ec00-4c4f-96b7-ab5799af35e3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:53.667729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1b5c525b-ec00-4c4f-96b7-ab5799af35e3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:53.676650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1b5c525b-ec00-4c4f-96b7-ab5799af35e3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1511 microversion: 2.1 time: 0.118721 Sep 14 19:42:53.677434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 105/194] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:53 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1511 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:53.802438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-86506455-a424-4c7a-9440-8acf893c79aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:53.803282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-86506455-a424-4c7a-9440-8acf893c79aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:53.809838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86506455-a424-4c7a-9440-8acf893c79aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:53.810105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86506455-a424-4c7a-9440-8acf893c79aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:53.810933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86506455-a424-4c7a-9440-8acf893c79aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:53.811472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86506455-a424-4c7a-9440-8acf893c79aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:53.945198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-86506455-a424-4c7a-9440-8acf893c79aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:53.953438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-86506455-a424-4c7a-9440-8acf893c79aa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.160651 Sep 14 19:42:53.954046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 90/195] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:53 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:54.276863 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-69813a6e-b89d-44a4-9767-59a4fa504bdd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:54.277820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-69813a6e-b89d-44a4-9767-59a4fa504bdd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:54.283834 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-69813a6e-b89d-44a4-9767-59a4fa504bdd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:54.284319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-69813a6e-b89d-44a4-9767-59a4fa504bdd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:54.285144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-69813a6e-b89d-44a4-9767-59a4fa504bdd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:54.285671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-69813a6e-b89d-44a4-9767-59a4fa504bdd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:54.385438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-69813a6e-b89d-44a4-9767-59a4fa504bdd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 24463 microversion: 2.20 time: 0.112547 Sep 14 19:42:54.389235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 106/196] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:54 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 24463 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:42:54.694431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:54.695228 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:54.701350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:54.702002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:54.702966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:54.703470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:54.733700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:54.734142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:54.734584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lazy-loading 'fault' on Instance uuid fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:42:54.780563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:54.790554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0bcd54cd-5b4b-4027-9127-db994621eec3 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1350 microversion: 2.1 time: 0.099022 Sep 14 19:42:54.790554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 91/197] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:54 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:54.972188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7834e089-31c8-403c-a503-8662ba4e1a83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:54.973435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7834e089-31c8-403c-a503-8662ba4e1a83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:54.981664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7834e089-31c8-403c-a503-8662ba4e1a83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:54.982150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7834e089-31c8-403c-a503-8662ba4e1a83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:54.982963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7834e089-31c8-403c-a503-8662ba4e1a83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:54.983399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7834e089-31c8-403c-a503-8662ba4e1a83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:55.120214 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7834e089-31c8-403c-a503-8662ba4e1a83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:55.127521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7834e089-31c8-403c-a503-8662ba4e1a83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.160146 Sep 14 19:42:55.127995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 107/198] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:54 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:55.397657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7b412e64-c536-4608-94d2-11d63d6ea930 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:55.398567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7b412e64-c536-4608-94d2-11d63d6ea930 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:55.404532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b412e64-c536-4608-94d2-11d63d6ea930 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:55.404984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b412e64-c536-4608-94d2-11d63d6ea930 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:55.405825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b412e64-c536-4608-94d2-11d63d6ea930 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:55.406262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b412e64-c536-4608-94d2-11d63d6ea930 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:55.807248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:55.807857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:55.813950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:55.814397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:55.815742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:55.816176 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:55.847446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:55.857729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:55.858258 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lazy-loading 'fault' on Instance uuid fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:42:55.905041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:55.913545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7df7ca34-aa0c-4568-bde3-a30f4bded38b tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1350 microversion: 2.1 time: 0.109989 Sep 14 19:42:55.914362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 108/199] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:55 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:56.143942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-146f2bea-b33b-4288-8690-d7648aaba5fe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:56.144553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-146f2bea-b33b-4288-8690-d7648aaba5fe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:56.151105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-146f2bea-b33b-4288-8690-d7648aaba5fe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:56.151555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-146f2bea-b33b-4288-8690-d7648aaba5fe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:56.152366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-146f2bea-b33b-4288-8690-d7648aaba5fe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:56.152805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-146f2bea-b33b-4288-8690-d7648aaba5fe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:56.291878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-146f2bea-b33b-4288-8690-d7648aaba5fe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:56.300519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-146f2bea-b33b-4288-8690-d7648aaba5fe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.160189 Sep 14 19:42:56.301105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 109/200] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:56 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:56.934295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:56.934901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:56.941384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:56.942297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:56.942760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:56.943058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:56.978249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:56.978710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:56.979331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lazy-loading 'fault' on Instance uuid fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:42:57.022063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:57.038750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bbe8a260-6ebe-4cdb-9c43-18ee1cf50875 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1350 microversion: 2.1 time: 0.100490 Sep 14 19:42:57.038750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 110/201] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:56 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:57.318346 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0d754e00-7d77-461d-9b39-3bdc8108d24e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:57.320128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0d754e00-7d77-461d-9b39-3bdc8108d24e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:57.326458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d754e00-7d77-461d-9b39-3bdc8108d24e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:57.326954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d754e00-7d77-461d-9b39-3bdc8108d24e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:57.327839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d754e00-7d77-461d-9b39-3bdc8108d24e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:57.328280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d754e00-7d77-461d-9b39-3bdc8108d24e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:57.463484 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0d754e00-7d77-461d-9b39-3bdc8108d24e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:57.466715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0d754e00-7d77-461d-9b39-3bdc8108d24e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.153216 Sep 14 19:42:57.467297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 111/202] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:57 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:57.646766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7b412e64-c536-4608-94d2-11d63d6ea930 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 26937 microversion: 2.20 time: 2.253326 Sep 14 19:42:57.647427 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 92/203] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:55 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 26937 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:42:58.048240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:58.048861 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:58.055925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:58.056383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:58.057207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:58.058010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:58.103827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:58.104267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:58.104943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lazy-loading 'fault' on Instance uuid fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:42:58.148125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6e05c21583f423da79461bcbe98a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6083ffb59ddd45e8a1078199ba5e6d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:58.156282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d36563fe-f1e1-4707-a807-c9f22ff8e548 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 200 len: 1350 microversion: 2.1 time: 0.111964 Sep 14 19:42:58.159535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 112/204] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:58 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 1350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:58.484271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e815a39b-725f-43eb-b22f-20e644b35194 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:58.484894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e815a39b-725f-43eb-b22f-20e644b35194 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:58.491470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e815a39b-725f-43eb-b22f-20e644b35194 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:58.491908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e815a39b-725f-43eb-b22f-20e644b35194 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:58.492727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e815a39b-725f-43eb-b22f-20e644b35194 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:58.493165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e815a39b-725f-43eb-b22f-20e644b35194 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:58.638055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e815a39b-725f-43eb-b22f-20e644b35194 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:58.646451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e815a39b-725f-43eb-b22f-20e644b35194 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.166302 Sep 14 19:42:58.647022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 93/205] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:58 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:42:58.660281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6c30a212-9fbb-414e-a978-4d818569b563 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:58.661199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6c30a212-9fbb-414e-a978-4d818569b563 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:58.666955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c30a212-9fbb-414e-a978-4d818569b563 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:58.667390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c30a212-9fbb-414e-a978-4d818569b563 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:58.668156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c30a212-9fbb-414e-a978-4d818569b563 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:58.668584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c30a212-9fbb-414e-a978-4d818569b563 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:58.780711 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6c30a212-9fbb-414e-a978-4d818569b563 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 27311 microversion: 2.20 time: 0.124047 Sep 14 19:42:58.781366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 113/206] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:58 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 27311 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:42:59.175858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-aa0d213d-6287-4cd8-9621-4974615e0fdc tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:59.175858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-aa0d213d-6287-4cd8-9621-4974615e0fdc tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:59.182669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa0d213d-6287-4cd8-9621-4974615e0fdc tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:59.183105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa0d213d-6287-4cd8-9621-4974615e0fdc tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:59.184022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa0d213d-6287-4cd8-9621-4974615e0fdc tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:59.184698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa0d213d-6287-4cd8-9621-4974615e0fdc tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:59.213608 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-aa0d213d-6287-4cd8-9621-4974615e0fdc tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] HTTP exception thrown: Instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea could not be found. Sep 14 19:42:59.214532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-aa0d213d-6287-4cd8-9621-4974615e0fdc tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Returning 404 to user: Instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:42:59.215378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-aa0d213d-6287-4cd8-9621-4974615e0fdc tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 404 len: 111 microversion: 2.1 time: 0.044302 Sep 14 19:42:59.215936 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 94/207] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:59 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:42:59.397741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fd2bcc2e-1ea0-4026-b50b-922d41344ab6 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:59.398486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fd2bcc2e-1ea0-4026-b50b-922d41344ab6 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:59.409657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fd2bcc2e-1ea0-4026-b50b-922d41344ab6 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:59.409657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fd2bcc2e-1ea0-4026-b50b-922d41344ab6 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:59.409877 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fd2bcc2e-1ea0-4026-b50b-922d41344ab6 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:59.411127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fd2bcc2e-1ea0-4026-b50b-922d41344ab6 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:59.434552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-fd2bcc2e-1ea0-4026-b50b-922d41344ab6 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] HTTP exception thrown: Instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea could not be found. Sep 14 19:42:59.435252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fd2bcc2e-1ea0-4026-b50b-922d41344ab6 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Returning 404 to user: Instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:42:59.436096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fd2bcc2e-1ea0-4026-b50b-922d41344ab6 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044579 Sep 14 19:42:59.436945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 114/208] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:42:59 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:42:59.440327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1993046883", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "networks": [{"uuid": "dadf8579-8fa0-403c-8ccf-ca6def90a163"}]}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:59.508339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] validate_networks() for [('dadf8579-8fa0-403c-8ccf-ca6def90a163', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:42:59.662717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0ae884e3-1eec-4a3e-a63d-4197c1714ad5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:42:59.663407 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0ae884e3-1eec-4a3e-a63d-4197c1714ad5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:59.670291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ae884e3-1eec-4a3e-a63d-4197c1714ad5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:59.684147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ae884e3-1eec-4a3e-a63d-4197c1714ad5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:59.684147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ae884e3-1eec-4a3e-a63d-4197c1714ad5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:59.684147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ae884e3-1eec-4a3e-a63d-4197c1714ad5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:59.856856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0ae884e3-1eec-4a3e-a63d-4197c1714ad5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:42:59.873260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0ae884e3-1eec-4a3e-a63d-4197c1714ad5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.213722 Sep 14 19:42:59.874392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 115/209] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:42:59 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:42:59.887179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f24dbd97-0edd-4d83-95ed-d6a3fde688bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:42:59.888918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f24dbd97-0edd-4d83-95ed-d6a3fde688bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:42:59.900417 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f24dbd97-0edd-4d83-95ed-d6a3fde688bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:59.901700 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f24dbd97-0edd-4d83-95ed-d6a3fde688bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:59.903163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f24dbd97-0edd-4d83-95ed-d6a3fde688bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:59.903969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f24dbd97-0edd-4d83-95ed-d6a3fde688bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:59.969621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:42:59.971116 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:42:59.971655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:42:59.972008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:42:59.972575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:42:59.982585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:59.983019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:42:59.984001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:42:59.984669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:00.004212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Getting quotas for project 627619b6d80a4c4ca01e48750b307056. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:43:00.021787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Getting quotas for user 8de96771b60a4d658f0e371f6b695bac and project 627619b6d80a4c4ca01e48750b307056. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:43:00.022748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:43:00.024571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:43:00.049915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f24dbd97-0edd-4d83-95ed-d6a3fde688bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 27634 microversion: 2.20 time: 0.172640 Sep 14 19:43:00.050866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 116/210] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:42:59 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 27634 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:00.173051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1c50cf16-1256-4847-8762-ed1be24c458d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738715 Sep 14 19:43:00.173760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 95/211] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:42:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 19:43:00.184709 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ea12e391-7e7e-40d8-b17a-5527d80d1559 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:00.185406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ea12e391-7e7e-40d8-b17a-5527d80d1559 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:00.253413 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ea12e391-7e7e-40d8-b17a-5527d80d1559 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:00.265443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ea12e391-7e7e-40d8-b17a-5527d80d1559 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1218 microversion: 2.1 time: 0.084581 Sep 14 19:43:00.267062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 117/212] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:00 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:00.894527 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6b3505cd-b560-4d00-bc43-8c7bde72a5b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:00.895274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6b3505cd-b560-4d00-bc43-8c7bde72a5b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:00.903823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b3505cd-b560-4d00-bc43-8c7bde72a5b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:00.906600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b3505cd-b560-4d00-bc43-8c7bde72a5b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:00.906600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b3505cd-b560-4d00-bc43-8c7bde72a5b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:00.906600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b3505cd-b560-4d00-bc43-8c7bde72a5b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:01.062931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0235ebe8-8859-4b73-be7b-e98f954240da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:01.063869 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0235ebe8-8859-4b73-be7b-e98f954240da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:01.073392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0235ebe8-8859-4b73-be7b-e98f954240da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:01.073597 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6b3505cd-b560-4d00-bc43-8c7bde72a5b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:01.078833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0235ebe8-8859-4b73-be7b-e98f954240da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:01.078833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0235ebe8-8859-4b73-be7b-e98f954240da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:01.078833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0235ebe8-8859-4b73-be7b-e98f954240da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:01.081163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6b3505cd-b560-4d00-bc43-8c7bde72a5b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.193391 Sep 14 19:43:01.090999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 96/213] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:00 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:01.284525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-48784393-4f38-4395-9ff6-6776c980921c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:01.285239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-48784393-4f38-4395-9ff6-6776c980921c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:01.291261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48784393-4f38-4395-9ff6-6776c980921c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:01.292430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48784393-4f38-4395-9ff6-6776c980921c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:01.294033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48784393-4f38-4395-9ff6-6776c980921c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:01.294473 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48784393-4f38-4395-9ff6-6776c980921c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:01.375918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-48784393-4f38-4395-9ff6-6776c980921c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:01.384106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-48784393-4f38-4395-9ff6-6776c980921c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1222 microversion: 2.1 time: 0.103562 Sep 14 19:43:01.384823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 97/214] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:01 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:02.098705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3e7f8ece-82f1-4d9c-9651-29b01e8035d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:02.099453 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3e7f8ece-82f1-4d9c-9651-29b01e8035d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:02.105881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e7f8ece-82f1-4d9c-9651-29b01e8035d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:02.106334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e7f8ece-82f1-4d9c-9651-29b01e8035d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:02.107126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e7f8ece-82f1-4d9c-9651-29b01e8035d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:02.107564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e7f8ece-82f1-4d9c-9651-29b01e8035d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:02.436318 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3e7f8ece-82f1-4d9c-9651-29b01e8035d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:02.444311 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3e7f8ece-82f1-4d9c-9651-29b01e8035d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.350048 Sep 14 19:43:02.445922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 98/215] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:02 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:02.449787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-35f5fce1-22ea-4497-bd1d-09ad4d9d7d04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:02.449939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-35f5fce1-22ea-4497-bd1d-09ad4d9d7d04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:02.457171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-35f5fce1-22ea-4497-bd1d-09ad4d9d7d04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:02.457729 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-35f5fce1-22ea-4497-bd1d-09ad4d9d7d04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:02.458512 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-35f5fce1-22ea-4497-bd1d-09ad4d9d7d04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:02.458944 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-35f5fce1-22ea-4497-bd1d-09ad4d9d7d04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:02.518775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-35f5fce1-22ea-4497-bd1d-09ad4d9d7d04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:02.532005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-35f5fce1-22ea-4497-bd1d-09ad4d9d7d04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1222 microversion: 2.1 time: 0.085127 Sep 14 19:43:02.532005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 99/216] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:02 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:03.373094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0235ebe8-8859-4b73-be7b-e98f954240da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28163 microversion: 2.20 time: 2.313959 Sep 14 19:43:03.374386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 118/217] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:01 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28163 bytes in 2316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:43:03.461356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fe1edd89-712e-4723-9038-608242a5521a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:03.461972 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fe1edd89-712e-4723-9038-608242a5521a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:03.467860 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe1edd89-712e-4723-9038-608242a5521a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:03.468301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe1edd89-712e-4723-9038-608242a5521a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:03.469234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe1edd89-712e-4723-9038-608242a5521a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:03.469513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe1edd89-712e-4723-9038-608242a5521a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:03.554791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ae3bd515-0f83-471f-b688-cd3a2b5a74cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:03.554791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ae3bd515-0f83-471f-b688-cd3a2b5a74cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:03.561674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae3bd515-0f83-471f-b688-cd3a2b5a74cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:03.562927 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae3bd515-0f83-471f-b688-cd3a2b5a74cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:03.564151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae3bd515-0f83-471f-b688-cd3a2b5a74cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:03.564841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae3bd515-0f83-471f-b688-cd3a2b5a74cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:03.606488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fe1edd89-712e-4723-9038-608242a5521a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:03.614873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fe1edd89-712e-4723-9038-608242a5521a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.157205 Sep 14 19:43:03.617287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 100/218] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:03 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:03.640728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ae3bd515-0f83-471f-b688-cd3a2b5a74cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:03.650319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ae3bd515-0f83-471f-b688-cd3a2b5a74cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1222 microversion: 2.1 time: 0.103658 Sep 14 19:43:03.651486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 119/219] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:03 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:04.385190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7faf7340-5b0f-4f78-919b-5ce8ae9ca184 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:04.386316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7faf7340-5b0f-4f78-919b-5ce8ae9ca184 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:04.392340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7faf7340-5b0f-4f78-919b-5ce8ae9ca184 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:04.392863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7faf7340-5b0f-4f78-919b-5ce8ae9ca184 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:04.393737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7faf7340-5b0f-4f78-919b-5ce8ae9ca184 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:04.394230 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7faf7340-5b0f-4f78-919b-5ce8ae9ca184 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:04.488793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7faf7340-5b0f-4f78-919b-5ce8ae9ca184 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28163 microversion: 2.20 time: 0.107384 Sep 14 19:43:04.489852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 101/220] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:04 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28163 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:04.633031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3e67102d-31dd-468f-a0f6-ecb3cf7b76b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:04.639033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3e67102d-31dd-468f-a0f6-ecb3cf7b76b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:04.642017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3e67102d-31dd-468f-a0f6-ecb3cf7b76b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:04.642466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3e67102d-31dd-468f-a0f6-ecb3cf7b76b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:04.643334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3e67102d-31dd-468f-a0f6-ecb3cf7b76b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:04.643782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3e67102d-31dd-468f-a0f6-ecb3cf7b76b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:04.672853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b14bc5d7-b349-45ce-b170-8493901e14ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:04.678627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b14bc5d7-b349-45ce-b170-8493901e14ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:04.692749 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b14bc5d7-b349-45ce-b170-8493901e14ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:04.695385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b14bc5d7-b349-45ce-b170-8493901e14ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:04.696194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b14bc5d7-b349-45ce-b170-8493901e14ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:04.696636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b14bc5d7-b349-45ce-b170-8493901e14ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:04.790838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b14bc5d7-b349-45ce-b170-8493901e14ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:04.804403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b14bc5d7-b349-45ce-b170-8493901e14ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1270 microversion: 2.1 time: 0.136845 Sep 14 19:43:04.804907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 102/221] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:04 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:04.809786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5b864b05-3f56-452d-a6d5-c204b750de6e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:04.810522 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5b864b05-3f56-452d-a6d5-c204b750de6e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:04.817427 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b864b05-3f56-452d-a6d5-c204b750de6e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:04.818193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b864b05-3f56-452d-a6d5-c204b750de6e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:04.825872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b864b05-3f56-452d-a6d5-c204b750de6e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:04.825872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b864b05-3f56-452d-a6d5-c204b750de6e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:04.826051 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3e67102d-31dd-468f-a0f6-ecb3cf7b76b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:04.837662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3e67102d-31dd-468f-a0f6-ecb3cf7b76b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.207946 Sep 14 19:43:04.842470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 120/222] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:04 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:04.861258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-5b864b05-3f56-452d-a6d5-c204b750de6e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] HTTP exception thrown: Instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea could not be found. Sep 14 19:43:04.861952 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5b864b05-3f56-452d-a6d5-c204b750de6e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Returning 404 to user: Instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:43:04.862803 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5b864b05-3f56-452d-a6d5-c204b750de6e tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 404 len: 111 microversion: 2.1 time: 0.056988 Sep 14 19:43:04.863538 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 103/223] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 19:43:04 2021] DELETE /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:43:04.872173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c248ab33-76ec-46f3-be72-5323ba0ab1b8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:04.873141 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c248ab33-76ec-46f3-be72-5323ba0ab1b8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] [instance: fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:04.890402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c248ab33-76ec-46f3-be72-5323ba0ab1b8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:04.891536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c248ab33-76ec-46f3-be72-5323ba0ab1b8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:04.893885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c248ab33-76ec-46f3-be72-5323ba0ab1b8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:04.894773 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c248ab33-76ec-46f3-be72-5323ba0ab1b8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:04.926556 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-c248ab33-76ec-46f3-be72-5323ba0ab1b8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] HTTP exception thrown: Instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea could not be found. Sep 14 19:43:04.927898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c248ab33-76ec-46f3-be72-5323ba0ab1b8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] Returning 404 to user: Instance fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:43:04.929037 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c248ab33-76ec-46f3-be72-5323ba0ab1b8 tempest-DeleteServersTestJSON-1327788447 tempest-DeleteServersTestJSON-1327788447-project] 10.222.0.58 "GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea" status: 404 len: 111 microversion: 2.1 time: 0.061352 Sep 14 19:43:04.933228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 121/224] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:04 2021] GET /compute/v2.1/servers/fb26a9e4-5c3b-4bab-bf43-e1f50d4415ea => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:43:05.508222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a6222538-7bc9-42a9-8758-00bb5142e45b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:05.513390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a6222538-7bc9-42a9-8758-00bb5142e45b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:05.537762 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a6222538-7bc9-42a9-8758-00bb5142e45b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:05.539409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a6222538-7bc9-42a9-8758-00bb5142e45b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:05.542132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a6222538-7bc9-42a9-8758-00bb5142e45b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:05.545774 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a6222538-7bc9-42a9-8758-00bb5142e45b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:05.681777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a6222538-7bc9-42a9-8758-00bb5142e45b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28163 microversion: 2.20 time: 0.182781 Sep 14 19:43:05.683937 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 104/225] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:05 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28163 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:43:05.822829 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3f2d1b87-6fe1-40b7-99e3-60e78aefbadc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:05.824126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3f2d1b87-6fe1-40b7-99e3-60e78aefbadc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:05.831407 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f2d1b87-6fe1-40b7-99e3-60e78aefbadc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:05.832001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f2d1b87-6fe1-40b7-99e3-60e78aefbadc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:05.833813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f2d1b87-6fe1-40b7-99e3-60e78aefbadc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:05.834563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f2d1b87-6fe1-40b7-99e3-60e78aefbadc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:05.863512 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2695c427-bf4c-4808-9ccf-6f82dd2f1285 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:05.864401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2695c427-bf4c-4808-9ccf-6f82dd2f1285 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:05.873132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2695c427-bf4c-4808-9ccf-6f82dd2f1285 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:05.873942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2695c427-bf4c-4808-9ccf-6f82dd2f1285 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:05.874676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2695c427-bf4c-4808-9ccf-6f82dd2f1285 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:05.875319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2695c427-bf4c-4808-9ccf-6f82dd2f1285 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:06.015281 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2695c427-bf4c-4808-9ccf-6f82dd2f1285 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:06.019973 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2695c427-bf4c-4808-9ccf-6f82dd2f1285 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.162118 Sep 14 19:43:06.020711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 105/226] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:05 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:06.134434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3f2d1b87-6fe1-40b7-99e3-60e78aefbadc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:06.147613 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3f2d1b87-6fe1-40b7-99e3-60e78aefbadc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1276 microversion: 2.1 time: 0.328896 Sep 14 19:43:06.149441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 122/227] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:05 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1276 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:06.697200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-697cb78c-932b-4950-8dc6-bef6cd5d75bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:06.698050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-697cb78c-932b-4950-8dc6-bef6cd5d75bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:06.703949 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-697cb78c-932b-4950-8dc6-bef6cd5d75bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:06.704567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-697cb78c-932b-4950-8dc6-bef6cd5d75bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:06.705782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-697cb78c-932b-4950-8dc6-bef6cd5d75bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:06.706150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-697cb78c-932b-4950-8dc6-bef6cd5d75bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:06.788628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-697cb78c-932b-4950-8dc6-bef6cd5d75bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28391 microversion: 2.20 time: 0.095785 Sep 14 19:43:06.793308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 106/228] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:06 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28391 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:07.041174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8a3e7784-8198-455d-bba3-f43430cc0705 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:07.046252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8a3e7784-8198-455d-bba3-f43430cc0705 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:07.063437 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a3e7784-8198-455d-bba3-f43430cc0705 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:07.065790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a3e7784-8198-455d-bba3-f43430cc0705 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:07.067348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a3e7784-8198-455d-bba3-f43430cc0705 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:07.067868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a3e7784-8198-455d-bba3-f43430cc0705 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:07.168056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2fb49991-2c68-4e2e-96af-27661b7a2aa4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:07.168855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2fb49991-2c68-4e2e-96af-27661b7a2aa4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:07.178010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2fb49991-2c68-4e2e-96af-27661b7a2aa4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:07.178530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2fb49991-2c68-4e2e-96af-27661b7a2aa4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:07.179765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2fb49991-2c68-4e2e-96af-27661b7a2aa4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:07.180655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2fb49991-2c68-4e2e-96af-27661b7a2aa4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:07.369823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2fb49991-2c68-4e2e-96af-27661b7a2aa4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:07.378961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2fb49991-2c68-4e2e-96af-27661b7a2aa4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1318 microversion: 2.1 time: 0.215742 Sep 14 19:43:07.379656 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 107/229] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:07 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:07.421453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8a3e7784-8198-455d-bba3-f43430cc0705 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:07.433591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8a3e7784-8198-455d-bba3-f43430cc0705 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.400401 Sep 14 19:43:07.434469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 123/230] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:07 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:07.801222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2027c6e1-65c2-4be2-8bfa-60863388242a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:07.802166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2027c6e1-65c2-4be2-8bfa-60863388242a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:07.809245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2027c6e1-65c2-4be2-8bfa-60863388242a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:07.810041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2027c6e1-65c2-4be2-8bfa-60863388242a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:07.810931 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2027c6e1-65c2-4be2-8bfa-60863388242a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:07.811559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2027c6e1-65c2-4be2-8bfa-60863388242a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:07.899832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2027c6e1-65c2-4be2-8bfa-60863388242a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28453 microversion: 2.20 time: 0.102283 Sep 14 19:43:07.903771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 108/231] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:07 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:43:08.030459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-588c2b24-cbbc-418d-bc7d-5b0e777a96da req-b66c6c92-6eeb-4047-82c7-d090668f38c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44d453d4-8637-4162-94d2-835dcd3e4990", "tag": "13411508-b65f-4a95-834a-741874266297"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:08.032196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:43:08.032196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:43:08.039642 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-588c2b24-cbbc-418d-bc7d-5b0e777a96da req-b66c6c92-6eeb-4047-82c7-d090668f38c7 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:08.040168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-588c2b24-cbbc-418d-bc7d-5b0e777a96da req-b66c6c92-6eeb-4047-82c7-d090668f38c7 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:08.068648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-588c2b24-cbbc-418d-bc7d-5b0e777a96da req-b66c6c92-6eeb-4047-82c7-d090668f38c7 service nova] Creating event network-changed:13411508-b65f-4a95-834a-741874266297 for instance 44d453d4-8637-4162-94d2-835dcd3e4990 on hv-cinder-80588 Sep 14 19:43:08.068648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-588c2b24-cbbc-418d-bc7d-5b0e777a96da req-b66c6c92-6eeb-4047-82c7-d090668f38c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032765 Sep 14 19:43:08.068648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 124/232] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:43:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:08.397207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-837c45c4-5798-44fd-a8b7-1993a4db1faa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:08.398010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-837c45c4-5798-44fd-a8b7-1993a4db1faa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:08.404615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-837c45c4-5798-44fd-a8b7-1993a4db1faa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:08.405061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-837c45c4-5798-44fd-a8b7-1993a4db1faa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:08.405883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-837c45c4-5798-44fd-a8b7-1993a4db1faa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:08.406307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-837c45c4-5798-44fd-a8b7-1993a4db1faa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:08.452339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c1af5d7d-d389-4b74-bcdc-211e58fd578c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:08.453129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c1af5d7d-d389-4b74-bcdc-211e58fd578c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:08.460170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1af5d7d-d389-4b74-bcdc-211e58fd578c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:08.461443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1af5d7d-d389-4b74-bcdc-211e58fd578c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:08.462272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1af5d7d-d389-4b74-bcdc-211e58fd578c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:08.462741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1af5d7d-d389-4b74-bcdc-211e58fd578c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:08.540626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-837c45c4-5798-44fd-a8b7-1993a4db1faa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:08.548712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-837c45c4-5798-44fd-a8b7-1993a4db1faa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1318 microversion: 2.1 time: 0.156145 Sep 14 19:43:08.549471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 109/233] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:08 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:08.918697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-55765012-f41a-4e89-915c-4389c26b78c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:08.919616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-55765012-f41a-4e89-915c-4389c26b78c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:08.926708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-55765012-f41a-4e89-915c-4389c26b78c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:08.927387 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-55765012-f41a-4e89-915c-4389c26b78c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:08.928340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-55765012-f41a-4e89-915c-4389c26b78c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:08.928779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-55765012-f41a-4e89-915c-4389c26b78c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:08.994720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c1af5d7d-d389-4b74-bcdc-211e58fd578c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:09.007883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c1af5d7d-d389-4b74-bcdc-211e58fd578c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.560256 Sep 14 19:43:09.009132 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 125/234] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:08 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:09.072662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-55765012-f41a-4e89-915c-4389c26b78c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28621 microversion: 2.20 time: 0.133752 Sep 14 19:43:09.072662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 110/235] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:08 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28621 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:09.576218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-38c91de3-a7e3-4dcd-af8b-c88491e88c72 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:09.576759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-38c91de3-a7e3-4dcd-af8b-c88491e88c72 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:09.593539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-38c91de3-a7e3-4dcd-af8b-c88491e88c72 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:09.593539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-38c91de3-a7e3-4dcd-af8b-c88491e88c72 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:09.593539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-38c91de3-a7e3-4dcd-af8b-c88491e88c72 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:09.593866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-38c91de3-a7e3-4dcd-af8b-c88491e88c72 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:09.821804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-38c91de3-a7e3-4dcd-af8b-c88491e88c72 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:09.831231 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-38c91de3-a7e3-4dcd-af8b-c88491e88c72 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1318 microversion: 2.1 time: 0.268554 Sep 14 19:43:09.833478 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 126/236] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:09 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:10.037409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fba6e0c4-e9c2-4bdf-a2a1-f57ce1b41d1a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:10.037409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fba6e0c4-e9c2-4bdf-a2a1-f57ce1b41d1a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:10.038446 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fba6e0c4-e9c2-4bdf-a2a1-f57ce1b41d1a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:10.038870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fba6e0c4-e9c2-4bdf-a2a1-f57ce1b41d1a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:10.039760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fba6e0c4-e9c2-4bdf-a2a1-f57ce1b41d1a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:10.040308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fba6e0c4-e9c2-4bdf-a2a1-f57ce1b41d1a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:10.063776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4c7d1c88-35ea-4283-9d49-c1545dfb9208 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:10.066003 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4c7d1c88-35ea-4283-9d49-c1545dfb9208 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:10.073739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4c7d1c88-35ea-4283-9d49-c1545dfb9208 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:10.074614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4c7d1c88-35ea-4283-9d49-c1545dfb9208 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:10.076107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4c7d1c88-35ea-4283-9d49-c1545dfb9208 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:10.076988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4c7d1c88-35ea-4283-9d49-c1545dfb9208 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:10.161883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4c7d1c88-35ea-4283-9d49-c1545dfb9208 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28621 microversion: 2.20 time: 0.102873 Sep 14 19:43:10.166044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 127/237] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:10 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28621 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:10.216854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fba6e0c4-e9c2-4bdf-a2a1-f57ce1b41d1a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:10.225909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fba6e0c4-e9c2-4bdf-a2a1-f57ce1b41d1a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1521 microversion: 2.1 time: 0.203920 Sep 14 19:43:10.226590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 111/238] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:10 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:10.850327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d72fd867-7f73-4b5f-9577-233093c8bc02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:10.851208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d72fd867-7f73-4b5f-9577-233093c8bc02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:10.857782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d72fd867-7f73-4b5f-9577-233093c8bc02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:10.858229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d72fd867-7f73-4b5f-9577-233093c8bc02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:10.859007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d72fd867-7f73-4b5f-9577-233093c8bc02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:10.859443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d72fd867-7f73-4b5f-9577-233093c8bc02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:10.986202 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d72fd867-7f73-4b5f-9577-233093c8bc02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:10.994602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d72fd867-7f73-4b5f-9577-233093c8bc02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1318 microversion: 2.1 time: 0.149611 Sep 14 19:43:10.995186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 128/239] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:10 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:11.174252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-da1ed07c-c2c5-4aeb-9e05-bed799474997 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:11.175254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-da1ed07c-c2c5-4aeb-9e05-bed799474997 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:11.181649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-da1ed07c-c2c5-4aeb-9e05-bed799474997 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:11.182098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-da1ed07c-c2c5-4aeb-9e05-bed799474997 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:11.182884 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-da1ed07c-c2c5-4aeb-9e05-bed799474997 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:11.183494 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-da1ed07c-c2c5-4aeb-9e05-bed799474997 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:11.242631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-85abcc57-2007-4376-89ca-e9bad507b0a4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:11.243252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-85abcc57-2007-4376-89ca-e9bad507b0a4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:11.249169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85abcc57-2007-4376-89ca-e9bad507b0a4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:11.249652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85abcc57-2007-4376-89ca-e9bad507b0a4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:11.250484 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85abcc57-2007-4376-89ca-e9bad507b0a4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:11.250918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85abcc57-2007-4376-89ca-e9bad507b0a4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:11.256780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-da1ed07c-c2c5-4aeb-9e05-bed799474997 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28621 microversion: 2.20 time: 0.086589 Sep 14 19:43:11.257540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 112/240] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:11 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28621 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:11.383172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-85abcc57-2007-4376-89ca-e9bad507b0a4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:11.392512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-85abcc57-2007-4376-89ca-e9bad507b0a4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1501 microversion: 2.1 time: 0.153559 Sep 14 19:43:11.393817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 129/241] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:11 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:11.410074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a2951c8e-2d09-4131-9aa3-31c61cd0b6d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:11.411035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a2951c8e-2d09-4131-9aa3-31c61cd0b6d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:11.419535 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2951c8e-2d09-4131-9aa3-31c61cd0b6d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:11.420486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2951c8e-2d09-4131-9aa3-31c61cd0b6d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:11.421452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2951c8e-2d09-4131-9aa3-31c61cd0b6d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:11.422084 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2951c8e-2d09-4131-9aa3-31c61cd0b6d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:11.593158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a2951c8e-2d09-4131-9aa3-31c61cd0b6d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:11.601379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a2951c8e-2d09-4131-9aa3-31c61cd0b6d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1516 microversion: 2.1 time: 0.196015 Sep 14 19:43:11.602180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 113/242] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:12.013770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1ddf1adf-40a5-47a7-9648-6201c94a7319 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:12.014785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1ddf1adf-40a5-47a7-9648-6201c94a7319 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:12.022525 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1ddf1adf-40a5-47a7-9648-6201c94a7319 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:12.023492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1ddf1adf-40a5-47a7-9648-6201c94a7319 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:12.024491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1ddf1adf-40a5-47a7-9648-6201c94a7319 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:12.025389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1ddf1adf-40a5-47a7-9648-6201c94a7319 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:12.233621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1ddf1adf-40a5-47a7-9648-6201c94a7319 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:12.244489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1ddf1adf-40a5-47a7-9648-6201c94a7319 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1318 microversion: 2.1 time: 0.234577 Sep 14 19:43:12.244489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 130/243] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:12 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:12.268719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ce5c33d5-06b2-44fa-8b28-58cb50583a70 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:12.269769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ce5c33d5-06b2-44fa-8b28-58cb50583a70 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:12.297432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce5c33d5-06b2-44fa-8b28-58cb50583a70 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:12.297432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce5c33d5-06b2-44fa-8b28-58cb50583a70 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:12.297432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce5c33d5-06b2-44fa-8b28-58cb50583a70 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:12.297432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce5c33d5-06b2-44fa-8b28-58cb50583a70 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:12.389341 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ce5c33d5-06b2-44fa-8b28-58cb50583a70 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28621 microversion: 2.20 time: 0.124399 Sep 14 19:43:12.390474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 114/244] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:12 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28621 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:43:13.260316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8ffd85d8-c4b4-4534-9204-437518d400d5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:13.260831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8ffd85d8-c4b4-4534-9204-437518d400d5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:13.269646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ffd85d8-c4b4-4534-9204-437518d400d5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:13.270107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ffd85d8-c4b4-4534-9204-437518d400d5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:13.270970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ffd85d8-c4b4-4534-9204-437518d400d5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:13.271590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ffd85d8-c4b4-4534-9204-437518d400d5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:13.435459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1b2ffbd3-1ac7-4372-bb22-b83c60337174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:13.441164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1b2ffbd3-1ac7-4372-bb22-b83c60337174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:13.453891 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b2ffbd3-1ac7-4372-bb22-b83c60337174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:13.457196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b2ffbd3-1ac7-4372-bb22-b83c60337174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:13.457196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b2ffbd3-1ac7-4372-bb22-b83c60337174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:13.457196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b2ffbd3-1ac7-4372-bb22-b83c60337174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:13.569023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1b2ffbd3-1ac7-4372-bb22-b83c60337174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28621 microversion: 2.20 time: 0.164891 Sep 14 19:43:13.570391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 115/245] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:13 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28621 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:13.586753 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8ffd85d8-c4b4-4534-9204-437518d400d5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:13.598440 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8ffd85d8-c4b4-4534-9204-437518d400d5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1318 microversion: 2.1 time: 0.342564 Sep 14 19:43:13.599726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 131/246] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:13 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:13.957935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7e6ccf05-a3f9-4eae-b0fe-fe7a97144cb3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:13.959462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7e6ccf05-a3f9-4eae-b0fe-fe7a97144cb3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:13.971344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e6ccf05-a3f9-4eae-b0fe-fe7a97144cb3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:13.975900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-07094d2d-6740-495e-b2f8-927565508616 req-642c3a87-98e9-46b9-931f-111e88e39823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d453d4-8637-4162-94d2-835dcd3e4990", "name": "network-vif-plugged", "status": "completed", "tag": "13411508-b65f-4a95-834a-741874266297"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:13.976875 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e6ccf05-a3f9-4eae-b0fe-fe7a97144cb3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:13.977990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:43:13.977990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:43:13.978196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e6ccf05-a3f9-4eae-b0fe-fe7a97144cb3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:13.978860 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e6ccf05-a3f9-4eae-b0fe-fe7a97144cb3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:13.989239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-07094d2d-6740-495e-b2f8-927565508616 req-642c3a87-98e9-46b9-931f-111e88e39823 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:13.989770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-07094d2d-6740-495e-b2f8-927565508616 req-642c3a87-98e9-46b9-931f-111e88e39823 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:14.009910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-07094d2d-6740-495e-b2f8-927565508616 req-642c3a87-98e9-46b9-931f-111e88e39823 service nova] Creating event network-vif-plugged:13411508-b65f-4a95-834a-741874266297 for instance 44d453d4-8637-4162-94d2-835dcd3e4990 on hv-cinder-80588 Sep 14 19:43:14.015562 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-07094d2d-6740-495e-b2f8-927565508616 req-642c3a87-98e9-46b9-931f-111e88e39823 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045375 Sep 14 19:43:14.023795 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 132/247] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:43:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:14.029683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-7e6ccf05-a3f9-4eae-b0fe-fe7a97144cb3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lazy-loading 'flavor' on Instance uuid 0b9185a2-5afd-4c39-bb28-beb531d58eb0 {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:43:14.478646 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7e6ccf05-a3f9-4eae-b0fe-fe7a97144cb3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/action" status: 200 len: 32 microversion: 2.1 time: 0.523700 Sep 14 19:43:14.484692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 116/248] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:43:13 2021] POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/action => generated 32 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:43:14.497164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-392aa61f-0926-4e1d-88b8-495223e22615 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:14.497978 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-392aa61f-0926-4e1d-88b8-495223e22615 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:14.512110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-392aa61f-0926-4e1d-88b8-495223e22615 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:14.512565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-392aa61f-0926-4e1d-88b8-495223e22615 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:14.513398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-392aa61f-0926-4e1d-88b8-495223e22615 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:14.513875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-392aa61f-0926-4e1d-88b8-495223e22615 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:14.583609 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7a2e6ca6-f9cd-4e84-a51e-e91e687e3526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:14.585187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7a2e6ca6-f9cd-4e84-a51e-e91e687e3526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:14.602106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7a2e6ca6-f9cd-4e84-a51e-e91e687e3526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:14.603975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7a2e6ca6-f9cd-4e84-a51e-e91e687e3526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:14.608564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7a2e6ca6-f9cd-4e84-a51e-e91e687e3526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:14.610791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7a2e6ca6-f9cd-4e84-a51e-e91e687e3526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:14.761999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7a2e6ca6-f9cd-4e84-a51e-e91e687e3526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 28809 microversion: 2.20 time: 0.182639 Sep 14 19:43:14.764304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 117/249] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:14 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 28809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:43:14.785475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4ff7b288-5dd2-47b4-bfcb-a35963581f60 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:14.789785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4ff7b288-5dd2-47b4-bfcb-a35963581f60 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:14.811485 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4ff7b288-5dd2-47b4-bfcb-a35963581f60 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:14.812268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4ff7b288-5dd2-47b4-bfcb-a35963581f60 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:14.815751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4ff7b288-5dd2-47b4-bfcb-a35963581f60 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:14.816694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4ff7b288-5dd2-47b4-bfcb-a35963581f60 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:14.965290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-392aa61f-0926-4e1d-88b8-495223e22615 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:14.973429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-392aa61f-0926-4e1d-88b8-495223e22615 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.483996 Sep 14 19:43:14.982609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 133/250] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:14 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:15.187213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4ff7b288-5dd2-47b4-bfcb-a35963581f60 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:15.198640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4ff7b288-5dd2-47b4-bfcb-a35963581f60 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1318 microversion: 2.1 time: 0.432185 Sep 14 19:43:15.199738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 118/251] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:14 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:15.776223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8b15d342-0143-437a-9c08-4b86aaed3a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:15.777142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8b15d342-0143-437a-9c08-4b86aaed3a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:15.787919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b15d342-0143-437a-9c08-4b86aaed3a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:15.798791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b15d342-0143-437a-9c08-4b86aaed3a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:15.799846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b15d342-0143-437a-9c08-4b86aaed3a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:15.801793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b15d342-0143-437a-9c08-4b86aaed3a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:15.926609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8b15d342-0143-437a-9c08-4b86aaed3a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 30002 microversion: 2.20 time: 0.153923 Sep 14 19:43:15.931201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 134/252] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:15 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 30002 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:15.999630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4d4b450d-420d-4d7d-9d77-bd2c2358fb03 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:16.000817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4d4b450d-420d-4d7d-9d77-bd2c2358fb03 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:16.017294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4d4b450d-420d-4d7d-9d77-bd2c2358fb03 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:16.021934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4d4b450d-420d-4d7d-9d77-bd2c2358fb03 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:16.021934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4d4b450d-420d-4d7d-9d77-bd2c2358fb03 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:16.021934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4d4b450d-420d-4d7d-9d77-bd2c2358fb03 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:16.217593 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b2f34f71-a3f2-4cdf-9add-d3b2a0a0721a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:16.218307 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b2f34f71-a3f2-4cdf-9add-d3b2a0a0721a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:16.265386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2f34f71-a3f2-4cdf-9add-d3b2a0a0721a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:16.268980 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2f34f71-a3f2-4cdf-9add-d3b2a0a0721a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:16.270370 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2f34f71-a3f2-4cdf-9add-d3b2a0a0721a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:16.273863 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2f34f71-a3f2-4cdf-9add-d3b2a0a0721a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:16.594137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4d4b450d-420d-4d7d-9d77-bd2c2358fb03 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:16.609061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4d4b450d-420d-4d7d-9d77-bd2c2358fb03 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.616588 Sep 14 19:43:16.610764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 119/253] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:15 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:16.647150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b2f34f71-a3f2-4cdf-9add-d3b2a0a0721a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:16.666807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b2f34f71-a3f2-4cdf-9add-d3b2a0a0721a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1318 microversion: 2.1 time: 0.452656 Sep 14 19:43:16.681715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 135/254] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:16 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:16.945678 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-daee171b-d750-4d9a-8c1a-c7d44d7acc0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:16.947741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-daee171b-d750-4d9a-8c1a-c7d44d7acc0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:16.965576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-daee171b-d750-4d9a-8c1a-c7d44d7acc0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:16.967389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-daee171b-d750-4d9a-8c1a-c7d44d7acc0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:16.968471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-daee171b-d750-4d9a-8c1a-c7d44d7acc0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:16.969085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-daee171b-d750-4d9a-8c1a-c7d44d7acc0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:17.071940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-daee171b-d750-4d9a-8c1a-c7d44d7acc0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 30799 microversion: 2.20 time: 0.133310 Sep 14 19:43:17.074769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 120/255] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:16 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 30799 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:17.639532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a16ba475-09e2-4f11-a990-26c2f4593e61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:17.640143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a16ba475-09e2-4f11-a990-26c2f4593e61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:17.655263 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a16ba475-09e2-4f11-a990-26c2f4593e61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:17.656339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a16ba475-09e2-4f11-a990-26c2f4593e61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:17.658436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a16ba475-09e2-4f11-a990-26c2f4593e61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:17.665334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a16ba475-09e2-4f11-a990-26c2f4593e61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:17.740322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1b5b1067-5539-41ee-b840-80a9e0f49f3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:17.741659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1b5b1067-5539-41ee-b840-80a9e0f49f3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:17.771786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b5b1067-5539-41ee-b840-80a9e0f49f3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:17.772584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b5b1067-5539-41ee-b840-80a9e0f49f3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:17.776012 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b5b1067-5539-41ee-b840-80a9e0f49f3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:17.776783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b5b1067-5539-41ee-b840-80a9e0f49f3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:18.107851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1b5b1067-5539-41ee-b840-80a9e0f49f3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:18.126148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1b5b1067-5539-41ee-b840-80a9e0f49f3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1509 microversion: 2.1 time: 0.396591 Sep 14 19:43:18.127510 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 121/256] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:17 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1509 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:18.133552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1f7e3e40-9221-4a93-bde4-37d2bb67aead tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:18.134816 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1f7e3e40-9221-4a93-bde4-37d2bb67aead tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:18.144807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a16ba475-09e2-4f11-a990-26c2f4593e61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:18.146385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f7e3e40-9221-4a93-bde4-37d2bb67aead tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:18.147529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f7e3e40-9221-4a93-bde4-37d2bb67aead tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:18.150630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f7e3e40-9221-4a93-bde4-37d2bb67aead tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:18.151359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f7e3e40-9221-4a93-bde4-37d2bb67aead tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:18.153312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a16ba475-09e2-4f11-a990-26c2f4593e61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.521580 Sep 14 19:43:18.160767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 136/257] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:17 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:18.165846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c859e1b5-5993-47ca-aa2a-72546e061121 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c80f692-a341-42ea-bc02-86fcfb059420"}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:18.180087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c859e1b5-5993-47ca-aa2a-72546e061121 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:18.191731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c859e1b5-5993-47ca-aa2a-72546e061121 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:18.192456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c859e1b5-5993-47ca-aa2a-72546e061121 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:18.193285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c859e1b5-5993-47ca-aa2a-72546e061121 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:18.196896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c859e1b5-5993-47ca-aa2a-72546e061121 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:18.264930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1f7e3e40-9221-4a93-bde4-37d2bb67aead tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 32017 microversion: 2.20 time: 0.135221 Sep 14 19:43:18.277376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 122/258] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:18 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 32017 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:18.810760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-c859e1b5-5993-47ca-aa2a-72546e061121 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] HTTP exception thrown: Invalid volume: volume 3c80f692-a341-42ea-bc02-86fcfb059420 is already attached to instances: d23b109a-dab1-48fd-b306-2d1c00fdeb0d Sep 14 19:43:18.812133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c859e1b5-5993-47ca-aa2a-72546e061121 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Returning 400 to user: Invalid volume: volume 3c80f692-a341-42ea-bc02-86fcfb059420 is already attached to instances: d23b109a-dab1-48fd-b306-2d1c00fdeb0d {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:43:18.816125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c859e1b5-5993-47ca-aa2a-72546e061121 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "POST /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.651444 Sep 14 19:43:18.816125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 137/259] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Sep 14 19:43:18 2021] POST /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990/os-volume_attachments => generated 174 bytes in 653 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 19:43:18.984537 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ddb35c8d-a8d0-41ad-b304-06728944136a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:18.985114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ddb35c8d-a8d0-41ad-b304-06728944136a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:19.005145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ddb35c8d-a8d0-41ad-b304-06728944136a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:19.009668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ddb35c8d-a8d0-41ad-b304-06728944136a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:19.011603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ddb35c8d-a8d0-41ad-b304-06728944136a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:19.012413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ddb35c8d-a8d0-41ad-b304-06728944136a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:19.184157 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-50eeabb9-4f52-441e-ab4a-550baa1afc48 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:19.188657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-50eeabb9-4f52-441e-ab4a-550baa1afc48 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:19.220111 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50eeabb9-4f52-441e-ab4a-550baa1afc48 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:19.221865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50eeabb9-4f52-441e-ab4a-550baa1afc48 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:19.226578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50eeabb9-4f52-441e-ab4a-550baa1afc48 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:19.227671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50eeabb9-4f52-441e-ab4a-550baa1afc48 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:19.508100 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-ddb35c8d-a8d0-41ad-b304-06728944136a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lazy-loading 'services' on Instance uuid d23b109a-dab1-48fd-b306-2d1c00fdeb0d {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:43:19.533409 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-50eeabb9-4f52-441e-ab4a-550baa1afc48 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:19.543140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-50eeabb9-4f52-441e-ab4a-550baa1afc48 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.370132 Sep 14 19:43:19.550689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 138/260] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:19.564347 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e18e1168-2a0d-4aa2-b8df-feda420caced tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:19.565598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e18e1168-2a0d-4aa2-b8df-feda420caced tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:19.575697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e18e1168-2a0d-4aa2-b8df-feda420caced tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:19.578778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e18e1168-2a0d-4aa2-b8df-feda420caced tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:19.580672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e18e1168-2a0d-4aa2-b8df-feda420caced tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:19.586327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e18e1168-2a0d-4aa2-b8df-feda420caced tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:19.754543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e18e1168-2a0d-4aa2-b8df-feda420caced tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 33174 microversion: 2.20 time: 0.202071 Sep 14 19:43:19.755204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 139/261] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:19 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 33174 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:20.188896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ddb35c8d-a8d0-41ad-b304-06728944136a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d/os-volume_attachments/3c80f692-a341-42ea-bc02-86fcfb059420" status: 202 len: 0 microversion: 2.1 time: 1.208791 Sep 14 19:43:20.191505 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 123/262] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Sep 14 19:43:18 2021] DELETE /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d/os-volume_attachments/3c80f692-a341-42ea-bc02-86fcfb059420 => generated 0 bytes in 1212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:20.204336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8f1f9402-c9e6-4f70-9f96-69d1aa15560d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:20.206539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8f1f9402-c9e6-4f70-9f96-69d1aa15560d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:20.214774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f1f9402-c9e6-4f70-9f96-69d1aa15560d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:20.215232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f1f9402-c9e6-4f70-9f96-69d1aa15560d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:20.223702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f1f9402-c9e6-4f70-9f96-69d1aa15560d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:20.224169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f1f9402-c9e6-4f70-9f96-69d1aa15560d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:20.316324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8f1f9402-c9e6-4f70-9f96-69d1aa15560d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119289 Sep 14 19:43:20.327453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 140/263] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:43:20 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:20.568502 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-37dcfd42-220d-48f6-8c3b-fab87283bb1b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:20.568973 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-37dcfd42-220d-48f6-8c3b-fab87283bb1b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:20.577000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-37dcfd42-220d-48f6-8c3b-fab87283bb1b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:20.578061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-37dcfd42-220d-48f6-8c3b-fab87283bb1b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:20.579107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-37dcfd42-220d-48f6-8c3b-fab87283bb1b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:20.579757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-37dcfd42-220d-48f6-8c3b-fab87283bb1b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:20.769560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3549ad27-1c19-4d32-ac79-3bb97e2ac3d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:20.774357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3549ad27-1c19-4d32-ac79-3bb97e2ac3d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:20.780953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3549ad27-1c19-4d32-ac79-3bb97e2ac3d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:20.781425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3549ad27-1c19-4d32-ac79-3bb97e2ac3d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:20.782280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3549ad27-1c19-4d32-ac79-3bb97e2ac3d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:20.797958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3549ad27-1c19-4d32-ac79-3bb97e2ac3d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:20.960903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3549ad27-1c19-4d32-ac79-3bb97e2ac3d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 34063 microversion: 2.20 time: 0.191506 Sep 14 19:43:20.962453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 141/264] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:20 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 34063 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:43:21.179794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-37dcfd42-220d-48f6-8c3b-fab87283bb1b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:21.195132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-37dcfd42-220d-48f6-8c3b-fab87283bb1b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.631772 Sep 14 19:43:21.205813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 124/265] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:20 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:21.337943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-adfe33dc-b4a1-42b4-b87f-ae9bed2df43e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:21.339287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-adfe33dc-b4a1-42b4-b87f-ae9bed2df43e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:21.353609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adfe33dc-b4a1-42b4-b87f-ae9bed2df43e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:21.355098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adfe33dc-b4a1-42b4-b87f-ae9bed2df43e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:21.358430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adfe33dc-b4a1-42b4-b87f-ae9bed2df43e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:21.358988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adfe33dc-b4a1-42b4-b87f-ae9bed2df43e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:21.457857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-adfe33dc-b4a1-42b4-b87f-ae9bed2df43e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119210 Sep 14 19:43:21.457857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 142/266] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:43:21 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:21.975029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1644b466-7cb2-422a-8dfc-c075ee88ba15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:21.976256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1644b466-7cb2-422a-8dfc-c075ee88ba15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:21.991365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1644b466-7cb2-422a-8dfc-c075ee88ba15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:21.991999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1644b466-7cb2-422a-8dfc-c075ee88ba15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:21.992865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1644b466-7cb2-422a-8dfc-c075ee88ba15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:21.993319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1644b466-7cb2-422a-8dfc-c075ee88ba15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:22.123097 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1644b466-7cb2-422a-8dfc-c075ee88ba15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 35180 microversion: 2.20 time: 0.139321 Sep 14 19:43:22.123097 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 143/267] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:21 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 35180 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:22.219301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d0614349-8ea2-4fb3-a1bd-3c900f1c2196 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:22.220299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d0614349-8ea2-4fb3-a1bd-3c900f1c2196 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:22.235663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d0614349-8ea2-4fb3-a1bd-3c900f1c2196 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:22.238489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d0614349-8ea2-4fb3-a1bd-3c900f1c2196 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:22.243501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d0614349-8ea2-4fb3-a1bd-3c900f1c2196 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:22.245447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d0614349-8ea2-4fb3-a1bd-3c900f1c2196 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:22.445088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-deaea948-743f-4ede-9f6b-c8f5a63f5c58 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'create', calling method: .version_select at 0x7fd0c872c1f0>, body: {"keypair": {"name": "tempest-keypair-417207832"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:22.522930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-deaea948-743f-4ede-9f6b-c8f5a63f5c58 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:43:22.533183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-deaea948-743f-4ede-9f6b-c8f5a63f5c58 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for user 698509e250034b698e057bacbf44393d and project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:43:22.675161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d0614349-8ea2-4fb3-a1bd-3c900f1c2196 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:22.685484 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d0614349-8ea2-4fb3-a1bd-3c900f1c2196 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.475443 Sep 14 19:43:22.686288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 144/268] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:22 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:22.706565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c1c3fba8-1df8-4f80-ae11-9ebf94b5e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:22.707962 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c1c3fba8-1df8-4f80-ae11-9ebf94b5e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:22.716281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c3fba8-1df8-4f80-ae11-9ebf94b5e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:22.717119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c3fba8-1df8-4f80-ae11-9ebf94b5e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:22.719337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c3fba8-1df8-4f80-ae11-9ebf94b5e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:22.720746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c3fba8-1df8-4f80-ae11-9ebf94b5e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:22.791212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c1c3fba8-1df8-4f80-ae11-9ebf94b5e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101784 Sep 14 19:43:22.798416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 145/269] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:43:22 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:43:23.002049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-deaea948-743f-4ede-9f6b-c8f5a63f5c58 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:43:23.010701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-deaea948-743f-4ede-9f6b-c8f5a63f5c58 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for user 698509e250034b698e057bacbf44393d and project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:43:23.069359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-deaea948-743f-4ede-9f6b-c8f5a63f5c58 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.395152 Sep 14 19:43:23.072630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 125/270] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Sep 14 19:43:21 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:23.134378 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e5b971b5-070d-4a4d-980e-c9ca2a38bbf3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:23.136311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e5b971b5-070d-4a4d-980e-c9ca2a38bbf3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:23.163389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e5b971b5-070d-4a4d-980e-c9ca2a38bbf3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:23.165123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e5b971b5-070d-4a4d-980e-c9ca2a38bbf3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:23.172166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e5b971b5-070d-4a4d-980e-c9ca2a38bbf3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:23.172944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e5b971b5-070d-4a4d-980e-c9ca2a38bbf3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:23.274727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1362911682", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "networks": [{"uuid": "dadf8579-8fa0-403c-8ccf-ca6def90a163"}]}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:23.341164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e5b971b5-070d-4a4d-980e-c9ca2a38bbf3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 36506 microversion: 2.20 time: 0.213790 Sep 14 19:43:23.346533 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 146/271] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:23 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 36506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:23.402064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] validate_networks() for [('dadf8579-8fa0-403c-8ccf-ca6def90a163', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:43:23.711253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9b988140-686e-4df0-a50f-433b96300eaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:23.713590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9b988140-686e-4df0-a50f-433b96300eaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:23.734122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b988140-686e-4df0-a50f-433b96300eaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:23.739490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b988140-686e-4df0-a50f-433b96300eaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:23.743035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b988140-686e-4df0-a50f-433b96300eaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:23.746702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b988140-686e-4df0-a50f-433b96300eaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:24.640007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9b988140-686e-4df0-a50f-433b96300eaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:24.646081 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9b988140-686e-4df0-a50f-433b96300eaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.944947 Sep 14 19:43:24.658625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 147/272] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:23 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:24.658625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-87da50d8-20c0-4601-8937-69d85aea4db1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:24.668808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-87da50d8-20c0-4601-8937-69d85aea4db1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:24.684935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:43:24.685481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:43:24.686059 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:43:24.686566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:43:24.687071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:43:24.691839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87da50d8-20c0-4601-8937-69d85aea4db1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:24.694067 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87da50d8-20c0-4601-8937-69d85aea4db1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:24.694884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87da50d8-20c0-4601-8937-69d85aea4db1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:24.695421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87da50d8-20c0-4601-8937-69d85aea4db1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:24.706756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:24.708337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:24.709398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:24.710966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:24.758549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Getting quotas for project 627619b6d80a4c4ca01e48750b307056. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:43:24.773926 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Getting quotas for user 8de96771b60a4d658f0e371f6b695bac and project 627619b6d80a4c4ca01e48750b307056. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:43:24.799232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:43:24.803527 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:43:24.851267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-87da50d8-20c0-4601-8937-69d85aea4db1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 37976 microversion: 2.20 time: 0.199407 Sep 14 19:43:24.853357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 148/273] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:24 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 37976 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:25.048955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6f814644-925d-4142-8479-afb408a9f602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.782378 Sep 14 19:43:25.053089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 126/274] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:43:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:43:25.062503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2e8bb1cc-2dea-4a8d-834f-2c97aaa31674 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:25.064573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2e8bb1cc-2dea-4a8d-834f-2c97aaa31674 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:25.254529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2e8bb1cc-2dea-4a8d-834f-2c97aaa31674 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:25.262361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2e8bb1cc-2dea-4a8d-834f-2c97aaa31674 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1218 microversion: 2.1 time: 0.204326 Sep 14 19:43:25.265249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 149/275] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:25 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:25.665329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-92019d5c-0017-4fae-99b7-9d558f043ea6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:25.667074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-92019d5c-0017-4fae-99b7-9d558f043ea6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:25.676887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-92019d5c-0017-4fae-99b7-9d558f043ea6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:25.679369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-92019d5c-0017-4fae-99b7-9d558f043ea6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:25.680489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-92019d5c-0017-4fae-99b7-9d558f043ea6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:25.681134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-92019d5c-0017-4fae-99b7-9d558f043ea6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:25.865354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c7df609f-1fe8-47f3-975d-36fc7a37943a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:25.867101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c7df609f-1fe8-47f3-975d-36fc7a37943a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:25.875569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7df609f-1fe8-47f3-975d-36fc7a37943a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:25.876014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7df609f-1fe8-47f3-975d-36fc7a37943a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:25.876842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7df609f-1fe8-47f3-975d-36fc7a37943a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:25.877279 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7df609f-1fe8-47f3-975d-36fc7a37943a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:25.968973 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c7df609f-1fe8-47f3-975d-36fc7a37943a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 38163 microversion: 2.20 time: 0.108181 Sep 14 19:43:25.970732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 150/276] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:25 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 38163 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:26.227440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-92019d5c-0017-4fae-99b7-9d558f043ea6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:26.231555 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-92019d5c-0017-4fae-99b7-9d558f043ea6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.571257 Sep 14 19:43:26.232159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 127/277] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:25 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:26.281614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6181255d-96d0-472c-95c0-8883edfabeba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:26.283317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6181255d-96d0-472c-95c0-8883edfabeba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:26.485745 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6181255d-96d0-472c-95c0-8883edfabeba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:26.496033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6181255d-96d0-472c-95c0-8883edfabeba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1218 microversion: 2.1 time: 0.219357 Sep 14 19:43:26.498306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 151/278] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:26 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:26.982351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eb1d4c70-a196-4285-a9b7-9b9dd0106e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:26.984065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eb1d4c70-a196-4285-a9b7-9b9dd0106e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:26.995295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb1d4c70-a196-4285-a9b7-9b9dd0106e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:26.999044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb1d4c70-a196-4285-a9b7-9b9dd0106e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:27.000019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb1d4c70-a196-4285-a9b7-9b9dd0106e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:27.000566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb1d4c70-a196-4285-a9b7-9b9dd0106e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:27.101677 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eb1d4c70-a196-4285-a9b7-9b9dd0106e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 38163 microversion: 2.20 time: 0.123246 Sep 14 19:43:27.106287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 128/279] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:26 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 38163 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:43:27.260281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-49985664-0ac9-46ca-be78-627b701a9407 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:27.262740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-49985664-0ac9-46ca-be78-627b701a9407 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:27.277781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49985664-0ac9-46ca-be78-627b701a9407 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:27.278949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49985664-0ac9-46ca-be78-627b701a9407 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:27.280878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49985664-0ac9-46ca-be78-627b701a9407 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:27.281977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49985664-0ac9-46ca-be78-627b701a9407 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:27.524085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0027d05a-cde1-472a-a1af-7df868df3753 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:27.526405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0027d05a-cde1-472a-a1af-7df868df3753 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:27.535798 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0027d05a-cde1-472a-a1af-7df868df3753 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:27.536652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0027d05a-cde1-472a-a1af-7df868df3753 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:27.537746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0027d05a-cde1-472a-a1af-7df868df3753 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:27.538407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0027d05a-cde1-472a-a1af-7df868df3753 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:27.670919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0027d05a-cde1-472a-a1af-7df868df3753 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:27.681251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0027d05a-cde1-472a-a1af-7df868df3753 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1214 microversion: 2.1 time: 0.163217 Sep 14 19:43:27.697432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 129/280] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:27 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:27.728577 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-49985664-0ac9-46ca-be78-627b701a9407 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:27.746356 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-49985664-0ac9-46ca-be78-627b701a9407 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.501572 Sep 14 19:43:27.756685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 152/281] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:27 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:28.114370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c482a9af-a6fe-4126-aa18-15730afadb5a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:28.115580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c482a9af-a6fe-4126-aa18-15730afadb5a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:28.122322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c482a9af-a6fe-4126-aa18-15730afadb5a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:28.122322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c482a9af-a6fe-4126-aa18-15730afadb5a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:28.123065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c482a9af-a6fe-4126-aa18-15730afadb5a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:28.123672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c482a9af-a6fe-4126-aa18-15730afadb5a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:28.230482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c482a9af-a6fe-4126-aa18-15730afadb5a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 38304 microversion: 2.20 time: 0.119965 Sep 14 19:43:28.233622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 130/282] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:28 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 38304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:28.246546 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b8a6c55e-4ab0-4a6c-8d75-d1f2342c0e89 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:28.250670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b8a6c55e-4ab0-4a6c-8d75-d1f2342c0e89 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:28.286588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b8a6c55e-4ab0-4a6c-8d75-d1f2342c0e89 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:28.287167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b8a6c55e-4ab0-4a6c-8d75-d1f2342c0e89 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:28.287824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b8a6c55e-4ab0-4a6c-8d75-d1f2342c0e89 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:28.288267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b8a6c55e-4ab0-4a6c-8d75-d1f2342c0e89 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:28.364415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b8a6c55e-4ab0-4a6c-8d75-d1f2342c0e89 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/ips" status: 200 len: 152 microversion: 2.20 time: 0.124341 Sep 14 19:43:28.385166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 153/283] 10.222.0.58 () {60 vars in 1289 bytes} [Tue Sep 14 19:43:28 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/ips => generated 152 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:43:28.703987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8ed14d9d-1f2c-4d3d-bad2-7ab2384b05bb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:28.704631 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8ed14d9d-1f2c-4d3d-bad2-7ab2384b05bb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:28.711543 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ed14d9d-1f2c-4d3d-bad2-7ab2384b05bb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:28.712132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ed14d9d-1f2c-4d3d-bad2-7ab2384b05bb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:28.712756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ed14d9d-1f2c-4d3d-bad2-7ab2384b05bb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:28.713377 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ed14d9d-1f2c-4d3d-bad2-7ab2384b05bb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:28.763319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cc0bfe92-4711-4965-bf02-710a089fbc0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:28.763933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cc0bfe92-4711-4965-bf02-710a089fbc0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:28.802545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc0bfe92-4711-4965-bf02-710a089fbc0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:28.809375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc0bfe92-4711-4965-bf02-710a089fbc0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:28.809375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc0bfe92-4711-4965-bf02-710a089fbc0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:28.809375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc0bfe92-4711-4965-bf02-710a089fbc0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:28.887640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8ed14d9d-1f2c-4d3d-bad2-7ab2384b05bb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:28.940053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8ed14d9d-1f2c-4d3d-bad2-7ab2384b05bb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1278 microversion: 2.1 time: 0.239023 Sep 14 19:43:28.943237 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 131/284] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:28 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1278 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:29.260140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cc0bfe92-4711-4965-bf02-710a089fbc0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:29.277477 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cc0bfe92-4711-4965-bf02-710a089fbc0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.517708 Sep 14 19:43:29.285611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 154/285] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:28 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:29.671063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-951338762", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58da4d12-7d41-4731-a464-9cffcf13229f"}], "security_groups": [{"name": "tempest-securitygroup--836213188"}], "key_name": "tempest-keypair-417207832", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:29.899485 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] validate_networks() for [('58da4d12-7d41-4731-a464-9cffcf13229f', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:43:29.972955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2b32e3f8-9be3-4918-a931-0d12be903ce4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:29.975677 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2b32e3f8-9be3-4918-a931-0d12be903ce4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:30.008274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b32e3f8-9be3-4918-a931-0d12be903ce4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:30.021547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b32e3f8-9be3-4918-a931-0d12be903ce4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:30.021547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b32e3f8-9be3-4918-a931-0d12be903ce4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:30.021547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b32e3f8-9be3-4918-a931-0d12be903ce4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:30.181262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2b32e3f8-9be3-4918-a931-0d12be903ce4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:30.190124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2b32e3f8-9be3-4918-a931-0d12be903ce4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1276 microversion: 2.1 time: 0.225639 Sep 14 19:43:30.193882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 155/286] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:29 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1276 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:30.299436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8e532695-6381-4665-bd27-9d7c60c027a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:30.301305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8e532695-6381-4665-bd27-9d7c60c027a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:30.334858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8e532695-6381-4665-bd27-9d7c60c027a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:30.335551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8e532695-6381-4665-bd27-9d7c60c027a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:30.337113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8e532695-6381-4665-bd27-9d7c60c027a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:30.339391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8e532695-6381-4665-bd27-9d7c60c027a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:30.616516 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8e532695-6381-4665-bd27-9d7c60c027a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:30.628661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8e532695-6381-4665-bd27-9d7c60c027a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.336368 Sep 14 19:43:30.639607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 156/287] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:30 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:30.891335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:43:30.892184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:43:30.893399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:43:30.894134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:43:30.895157 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:43:30.911800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:30.912975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:30.914662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:30.915282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:30.940533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:43:30.945529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for user 698509e250034b698e057bacbf44393d and project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:43:30.960844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:43:30.963304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:43:31.149139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a50e9f59-d1f9-4921-b36e-538a84552903 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.478475 Sep 14 19:43:31.156185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 132/288] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:43:29 2021] POST /compute/v2.1/servers => generated 401 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:43:31.167226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0b9721be-b105-4d07-a90f-8d4d868591a5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:31.168100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0b9721be-b105-4d07-a90f-8d4d868591a5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:31.208307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9c3bc7e2-b329-453b-8a41-da5834e4ee29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:31.209002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9c3bc7e2-b329-453b-8a41-da5834e4ee29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:31.219870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9c3bc7e2-b329-453b-8a41-da5834e4ee29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:31.220570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9c3bc7e2-b329-453b-8a41-da5834e4ee29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:31.221828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9c3bc7e2-b329-453b-8a41-da5834e4ee29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:31.223035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9c3bc7e2-b329-453b-8a41-da5834e4ee29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:31.301050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0b9721be-b105-4d07-a90f-8d4d868591a5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:31.309580 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0b9721be-b105-4d07-a90f-8d4d868591a5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1236 microversion: 2.1 time: 0.146732 Sep 14 19:43:31.337871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 157/289] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:31 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1236 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:31.484666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9c3bc7e2-b329-453b-8a41-da5834e4ee29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:31.489251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9c3bc7e2-b329-453b-8a41-da5834e4ee29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.284728 Sep 14 19:43:31.491153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 133/290] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:31 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:31.647105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ebd30fe5-d5c1-48bc-bac4-45893dbc4d32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:31.648591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ebd30fe5-d5c1-48bc-bac4-45893dbc4d32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:31.656803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ebd30fe5-d5c1-48bc-bac4-45893dbc4d32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:31.657773 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ebd30fe5-d5c1-48bc-bac4-45893dbc4d32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:31.659641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ebd30fe5-d5c1-48bc-bac4-45893dbc4d32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:31.659983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ebd30fe5-d5c1-48bc-bac4-45893dbc4d32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:31.886903 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-16a0187d-b247-481d-9ce9-e51e354a269b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:31.887934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-16a0187d-b247-481d-9ce9-e51e354a269b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:31.906501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ebd30fe5-d5c1-48bc-bac4-45893dbc4d32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:31.916469 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16a0187d-b247-481d-9ce9-e51e354a269b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:31.917010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16a0187d-b247-481d-9ce9-e51e354a269b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:31.917735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16a0187d-b247-481d-9ce9-e51e354a269b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:31.918366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16a0187d-b247-481d-9ce9-e51e354a269b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:31.928184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ebd30fe5-d5c1-48bc-bac4-45893dbc4d32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.286164 Sep 14 19:43:31.928767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 158/291] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:31 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:31.958442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-16a0187d-b247-481d-9ce9-e51e354a269b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lazy-loading 'flavor' on Instance uuid 72a26129-f7fb-4755-979a-968cdf0c7d34 {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:43:32.327835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3eff7b42-016a-48d8-8241-308dbc7c98ab tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:32.329173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3eff7b42-016a-48d8-8241-308dbc7c98ab tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:32.468756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3eff7b42-016a-48d8-8241-308dbc7c98ab tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:32.477284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3eff7b42-016a-48d8-8241-308dbc7c98ab tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1236 microversion: 2.1 time: 0.153299 Sep 14 19:43:32.481268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 159/292] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:32 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1236 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:32.509542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-def8108d-16ad-45c8-89b9-0fec8da45867 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:32.510452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-def8108d-16ad-45c8-89b9-0fec8da45867 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:32.521983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-def8108d-16ad-45c8-89b9-0fec8da45867 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:32.531424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-def8108d-16ad-45c8-89b9-0fec8da45867 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:32.531424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-def8108d-16ad-45c8-89b9-0fec8da45867 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:32.531424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-def8108d-16ad-45c8-89b9-0fec8da45867 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:32.863803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-def8108d-16ad-45c8-89b9-0fec8da45867 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:32.873287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-def8108d-16ad-45c8-89b9-0fec8da45867 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.369279 Sep 14 19:43:32.883789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 160/293] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:32 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:32.889163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-4b295f29-c6e5-472f-a5fe-ce9a88fddbd0 req-32743504-eb21-4954-9ce7-36c2ecfa5265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a4a9d3-a4e1-47ad-af23-b7b3b9445f03", "tag": "9de31650-de64-4bf5-b67f-0fe7fe3c2861"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:32.901835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:43:32.901835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:43:32.918120 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-4b295f29-c6e5-472f-a5fe-ce9a88fddbd0 req-32743504-eb21-4954-9ce7-36c2ecfa5265 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:32.918120 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-4b295f29-c6e5-472f-a5fe-ce9a88fddbd0 req-32743504-eb21-4954-9ce7-36c2ecfa5265 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:32.931813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-4b295f29-c6e5-472f-a5fe-ce9a88fddbd0 req-32743504-eb21-4954-9ce7-36c2ecfa5265 service nova] Creating event network-changed:9de31650-de64-4bf5-b67f-0fe7fe3c2861 for instance 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 on hv-cinder-80588 Sep 14 19:43:32.938434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-4b295f29-c6e5-472f-a5fe-ce9a88fddbd0 req-32743504-eb21-4954-9ce7-36c2ecfa5265 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052643 Sep 14 19:43:32.940074 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 161/294] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:43:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:32.946902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6ce5d633-0c3b-4501-af3e-a243502fc12d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:32.947875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6ce5d633-0c3b-4501-af3e-a243502fc12d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:32.954988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ce5d633-0c3b-4501-af3e-a243502fc12d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:32.955781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ce5d633-0c3b-4501-af3e-a243502fc12d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:32.963793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ce5d633-0c3b-4501-af3e-a243502fc12d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:32.964375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ce5d633-0c3b-4501-af3e-a243502fc12d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:33.049413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-16a0187d-b247-481d-9ce9-e51e354a269b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 202 len: 0 microversion: 2.20 time: 1.169107 Sep 14 19:43:33.052096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 134/295] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:43:31 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 0 bytes in 1173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:43:33.063088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eb26f11c-9212-44fb-86d0-a949cbab93a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:33.072700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eb26f11c-9212-44fb-86d0-a949cbab93a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:33.079200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb26f11c-9212-44fb-86d0-a949cbab93a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:33.079907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb26f11c-9212-44fb-86d0-a949cbab93a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:33.081687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb26f11c-9212-44fb-86d0-a949cbab93a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:33.083125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb26f11c-9212-44fb-86d0-a949cbab93a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:33.316529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6ce5d633-0c3b-4501-af3e-a243502fc12d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:33.334283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6ce5d633-0c3b-4501-af3e-a243502fc12d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.390081 Sep 14 19:43:33.341948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 162/296] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:32 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:33.401640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eb26f11c-9212-44fb-86d0-a949cbab93a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:33.407252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eb26f11c-9212-44fb-86d0-a949cbab93a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:33.408856 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eb26f11c-9212-44fb-86d0-a949cbab93a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:33.410089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eb26f11c-9212-44fb-86d0-a949cbab93a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.351673 Sep 14 19:43:33.410748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 135/297] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:33 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:43:33.497296 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-14ad3ed4-ccd2-42a5-89b4-b8d446da2b66 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:33.497933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-14ad3ed4-ccd2-42a5-89b4-b8d446da2b66 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:33.507998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14ad3ed4-ccd2-42a5-89b4-b8d446da2b66 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:33.508740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14ad3ed4-ccd2-42a5-89b4-b8d446da2b66 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:33.510227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14ad3ed4-ccd2-42a5-89b4-b8d446da2b66 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:33.510227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14ad3ed4-ccd2-42a5-89b4-b8d446da2b66 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:33.596591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-14ad3ed4-ccd2-42a5-89b4-b8d446da2b66 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:33.599716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-14ad3ed4-ccd2-42a5-89b4-b8d446da2b66 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1240 microversion: 2.1 time: 0.106321 Sep 14 19:43:33.600448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 163/298] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:33 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:33.890574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8d8e81dd-c1d2-47f4-8e0a-114832e2c41d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:33.891182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8d8e81dd-c1d2-47f4-8e0a-114832e2c41d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:33.897188 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d8e81dd-c1d2-47f4-8e0a-114832e2c41d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:33.902521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d8e81dd-c1d2-47f4-8e0a-114832e2c41d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:33.902521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d8e81dd-c1d2-47f4-8e0a-114832e2c41d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:33.902521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d8e81dd-c1d2-47f4-8e0a-114832e2c41d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:34.136781 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8d8e81dd-c1d2-47f4-8e0a-114832e2c41d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:34.145358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8d8e81dd-c1d2-47f4-8e0a-114832e2c41d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.258282 Sep 14 19:43:34.155331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 136/299] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:33 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:34.355073 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6c1a65ad-a938-4d91-8ab7-e5e3ee0d6b10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:34.355675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6c1a65ad-a938-4d91-8ab7-e5e3ee0d6b10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:34.363635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c1a65ad-a938-4d91-8ab7-e5e3ee0d6b10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:34.364279 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c1a65ad-a938-4d91-8ab7-e5e3ee0d6b10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:34.365193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c1a65ad-a938-4d91-8ab7-e5e3ee0d6b10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:34.365668 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c1a65ad-a938-4d91-8ab7-e5e3ee0d6b10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:34.430012 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c92309fe-58e5-49f2-b543-2ccc914fcea2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:34.430924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c92309fe-58e5-49f2-b543-2ccc914fcea2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:34.438270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c92309fe-58e5-49f2-b543-2ccc914fcea2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:34.440225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c92309fe-58e5-49f2-b543-2ccc914fcea2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:34.441263 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c92309fe-58e5-49f2-b543-2ccc914fcea2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:34.442402 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c92309fe-58e5-49f2-b543-2ccc914fcea2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:34.518262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6c1a65ad-a938-4d91-8ab7-e5e3ee0d6b10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:34.537951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6c1a65ad-a938-4d91-8ab7-e5e3ee0d6b10 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.176166 Sep 14 19:43:34.537951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 164/300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:34 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:34.618154 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fdb508b2-dd2f-4e1f-b1bc-6a68e9d96a62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:34.618776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fdb508b2-dd2f-4e1f-b1bc-6a68e9d96a62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:34.625428 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdb508b2-dd2f-4e1f-b1bc-6a68e9d96a62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:34.626472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdb508b2-dd2f-4e1f-b1bc-6a68e9d96a62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:34.627320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdb508b2-dd2f-4e1f-b1bc-6a68e9d96a62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:34.627784 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdb508b2-dd2f-4e1f-b1bc-6a68e9d96a62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:34.695312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-fdb508b2-dd2f-4e1f-b1bc-6a68e9d96a62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:34.706713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fdb508b2-dd2f-4e1f-b1bc-6a68e9d96a62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1240 microversion: 2.1 time: 0.092520 Sep 14 19:43:34.708488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 165/301] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:34 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:34.867681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c92309fe-58e5-49f2-b543-2ccc914fcea2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:34.884394 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c92309fe-58e5-49f2-b543-2ccc914fcea2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:34.886326 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c92309fe-58e5-49f2-b543-2ccc914fcea2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:34.887976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c92309fe-58e5-49f2-b543-2ccc914fcea2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.463075 Sep 14 19:43:34.889030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 137/302] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:34 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:43:35.163463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-298fec71-fbd6-4def-aa6d-c2bc269bd8c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:35.164151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-298fec71-fbd6-4def-aa6d-c2bc269bd8c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:35.170926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-298fec71-fbd6-4def-aa6d-c2bc269bd8c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:35.171467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-298fec71-fbd6-4def-aa6d-c2bc269bd8c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:35.172144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-298fec71-fbd6-4def-aa6d-c2bc269bd8c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:35.172582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-298fec71-fbd6-4def-aa6d-c2bc269bd8c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:35.343271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-298fec71-fbd6-4def-aa6d-c2bc269bd8c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:35.352974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-298fec71-fbd6-4def-aa6d-c2bc269bd8c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.193576 Sep 14 19:43:35.362855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 166/303] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:35 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:35.544593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6b883223-e812-44ad-822b-11c06de8034b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:35.546101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6b883223-e812-44ad-822b-11c06de8034b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:35.552509 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b883223-e812-44ad-822b-11c06de8034b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:35.552946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b883223-e812-44ad-822b-11c06de8034b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:35.554192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b883223-e812-44ad-822b-11c06de8034b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:35.554797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b883223-e812-44ad-822b-11c06de8034b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:35.724191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5016952b-865f-4d3d-91ea-9241260c0c29 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:35.725787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5016952b-865f-4d3d-91ea-9241260c0c29 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:35.732385 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5016952b-865f-4d3d-91ea-9241260c0c29 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:35.732839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5016952b-865f-4d3d-91ea-9241260c0c29 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:35.733732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5016952b-865f-4d3d-91ea-9241260c0c29 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:35.734179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5016952b-865f-4d3d-91ea-9241260c0c29 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:35.753877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6b883223-e812-44ad-822b-11c06de8034b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:35.762124 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6b883223-e812-44ad-822b-11c06de8034b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.221542 Sep 14 19:43:35.772159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 138/304] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:35 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:35.800682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5016952b-865f-4d3d-91ea-9241260c0c29 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:35.812451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5016952b-865f-4d3d-91ea-9241260c0c29 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1232 microversion: 2.1 time: 0.090350 Sep 14 19:43:35.814475 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 167/305] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:35 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1232 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:35.906334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3f690a5d-4a9c-4537-8dd4-72693751d3fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:35.906928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3f690a5d-4a9c-4537-8dd4-72693751d3fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:35.913533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f690a5d-4a9c-4537-8dd4-72693751d3fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:35.920910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f690a5d-4a9c-4537-8dd4-72693751d3fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:35.920910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f690a5d-4a9c-4537-8dd4-72693751d3fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:35.920910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f690a5d-4a9c-4537-8dd4-72693751d3fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:36.138820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3f690a5d-4a9c-4537-8dd4-72693751d3fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:36.150195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3f690a5d-4a9c-4537-8dd4-72693751d3fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:36.155283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3f690a5d-4a9c-4537-8dd4-72693751d3fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:36.156706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3f690a5d-4a9c-4537-8dd4-72693751d3fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.254247 Sep 14 19:43:36.160010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 139/306] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:35 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:36.370942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-241c8bd0-9c9e-4f6c-9360-0ed3a902af7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:36.372224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-241c8bd0-9c9e-4f6c-9360-0ed3a902af7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:36.379093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-241c8bd0-9c9e-4f6c-9360-0ed3a902af7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:36.379693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-241c8bd0-9c9e-4f6c-9360-0ed3a902af7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:36.380545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-241c8bd0-9c9e-4f6c-9360-0ed3a902af7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:36.381158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-241c8bd0-9c9e-4f6c-9360-0ed3a902af7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:36.605589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-241c8bd0-9c9e-4f6c-9360-0ed3a902af7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:36.613118 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-241c8bd0-9c9e-4f6c-9360-0ed3a902af7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.247016 Sep 14 19:43:36.614599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 168/307] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:36 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:36.779419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b6a45664-273b-472e-b353-f3992c738a2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:36.780826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b6a45664-273b-472e-b353-f3992c738a2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:36.793844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6a45664-273b-472e-b353-f3992c738a2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:36.794302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6a45664-273b-472e-b353-f3992c738a2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:36.795105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6a45664-273b-472e-b353-f3992c738a2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:36.795835 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6a45664-273b-472e-b353-f3992c738a2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:36.833695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c19be608-9432-4a82-bcb2-c833e97711b2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:36.834598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c19be608-9432-4a82-bcb2-c833e97711b2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:36.844129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c19be608-9432-4a82-bcb2-c833e97711b2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:36.844862 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c19be608-9432-4a82-bcb2-c833e97711b2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:36.846078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c19be608-9432-4a82-bcb2-c833e97711b2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:36.849704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c19be608-9432-4a82-bcb2-c833e97711b2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:36.937124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c19be608-9432-4a82-bcb2-c833e97711b2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:36.949386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c19be608-9432-4a82-bcb2-c833e97711b2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1288 microversion: 2.1 time: 0.119892 Sep 14 19:43:36.950624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 169/308] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:36 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1288 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:37.066421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b6a45664-273b-472e-b353-f3992c738a2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:37.122675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b6a45664-273b-472e-b353-f3992c738a2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1522 microversion: 2.1 time: 0.347090 Sep 14 19:43:37.124836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 140/309] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:36 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:37.177666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9a97d949-4acd-46bf-a0da-45b323b31946 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:37.178596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9a97d949-4acd-46bf-a0da-45b323b31946 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:37.191941 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a97d949-4acd-46bf-a0da-45b323b31946 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:37.196512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a97d949-4acd-46bf-a0da-45b323b31946 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:37.197692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a97d949-4acd-46bf-a0da-45b323b31946 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:37.198296 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a97d949-4acd-46bf-a0da-45b323b31946 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:37.630949 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-77755b91-6dcc-4dc5-929b-93c673dcb86b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:37.631738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-77755b91-6dcc-4dc5-929b-93c673dcb86b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:37.641407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77755b91-6dcc-4dc5-929b-93c673dcb86b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:37.642807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77755b91-6dcc-4dc5-929b-93c673dcb86b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:37.643635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77755b91-6dcc-4dc5-929b-93c673dcb86b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:37.644038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77755b91-6dcc-4dc5-929b-93c673dcb86b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.023359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-77755b91-6dcc-4dc5-929b-93c673dcb86b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:38.040349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9a97d949-4acd-46bf-a0da-45b323b31946 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:38.056485 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-77755b91-6dcc-4dc5-929b-93c673dcb86b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.429446 Sep 14 19:43:38.058486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9a97d949-4acd-46bf-a0da-45b323b31946 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:38.065180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 141/310] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:37 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:38.065340 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9a97d949-4acd-46bf-a0da-45b323b31946 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:38.068665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9a97d949-4acd-46bf-a0da-45b323b31946 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.894727 Sep 14 19:43:38.083763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 170/311] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:38.090532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6ba93641-f4ca-4beb-babe-764b308d4c62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:38.092695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6ba93641-f4ca-4beb-babe-764b308d4c62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:38.110077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba93641-f4ca-4beb-babe-764b308d4c62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:38.112753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba93641-f4ca-4beb-babe-764b308d4c62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.113827 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba93641-f4ca-4beb-babe-764b308d4c62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:38.114776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba93641-f4ca-4beb-babe-764b308d4c62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.263957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6ba93641-f4ca-4beb-babe-764b308d4c62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:38.275732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6ba93641-f4ca-4beb-babe-764b308d4c62 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1296 microversion: 2.1 time: 0.213568 Sep 14 19:43:38.276342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 142/312] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:38 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1296 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:38.289001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-68d4c4bf-8541-4f0f-a4c7-2671990d004b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:38.289992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-68d4c4bf-8541-4f0f-a4c7-2671990d004b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:38.315457 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-68d4c4bf-8541-4f0f-a4c7-2671990d004b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:38.316223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-68d4c4bf-8541-4f0f-a4c7-2671990d004b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.318199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-68d4c4bf-8541-4f0f-a4c7-2671990d004b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:38.319273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-68d4c4bf-8541-4f0f-a4c7-2671990d004b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.412970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e679b02f-2780-4adf-b7c4-388673616813 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Action: 'create', calling method: .version_select at 0x7fd0bbfdcaf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1826042944"}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:38.456808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-e679b02f-2780-4adf-b7c4-388673616813 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Getting quotas for project 4ba21a8e4a9e49ea953ed4a871211a18. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:43:38.464102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-e679b02f-2780-4adf-b7c4-388673616813 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Getting quotas for user 0f22db89d8174d76b7c5e6f4f99a11bf and project 4ba21a8e4a9e49ea953ed4a871211a18. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:43:38.562822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-68d4c4bf-8541-4f0f-a4c7-2671990d004b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:38.572861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-68d4c4bf-8541-4f0f-a4c7-2671990d004b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1502 microversion: 2.1 time: 0.293975 Sep 14 19:43:38.588159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 143/313] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:38 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1502 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:38.593686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f6e682ea-9412-4b21-8dca-0d74a8b7d0b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2f9ebfd-5535-480f-b545-91380d52adb7"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:38.597892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f6e682ea-9412-4b21-8dca-0d74a8b7d0b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:38.605976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6e682ea-9412-4b21-8dca-0d74a8b7d0b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:38.606432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6e682ea-9412-4b21-8dca-0d74a8b7d0b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.608963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6e682ea-9412-4b21-8dca-0d74a8b7d0b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:38.609460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6e682ea-9412-4b21-8dca-0d74a8b7d0b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.638930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-f6e682ea-9412-4b21-8dca-0d74a8b7d0b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] HTTP exception thrown: Cannot 'attach_volume' instance 0b9185a2-5afd-4c39-bb28-beb531d58eb0 while it is in vm_state rescued Sep 14 19:43:38.640498 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f6e682ea-9412-4b21-8dca-0d74a8b7d0b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Returning 409 to user: Cannot 'attach_volume' instance 0b9185a2-5afd-4c39-bb28-beb531d58eb0 while it is in vm_state rescued {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:43:38.641467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f6e682ea-9412-4b21-8dca-0d74a8b7d0b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052190 Sep 14 19:43:38.646584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 144/314] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Sep 14 19:43:38 2021] POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 19:43:38.652246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e85e1951-bd03-4564-a6ec-ab9f46d5a1ee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:38.652938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e85e1951-bd03-4564-a6ec-ab9f46d5a1ee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:38.661020 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e85e1951-bd03-4564-a6ec-ab9f46d5a1ee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:38.661473 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e85e1951-bd03-4564-a6ec-ab9f46d5a1ee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.662301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e85e1951-bd03-4564-a6ec-ab9f46d5a1ee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:38.663443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e85e1951-bd03-4564-a6ec-ab9f46d5a1ee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.912787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e85e1951-bd03-4564-a6ec-ab9f46d5a1ee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/action" status: 202 len: 0 microversion: 2.1 time: 0.264858 Sep 14 19:43:38.916853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 145/315] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:43:38 2021] POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:43:38.924821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-80b04039-c001-49ae-b596-1ba5983db488 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:38.927615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-80b04039-c001-49ae-b596-1ba5983db488 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:38.956229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-80b04039-c001-49ae-b596-1ba5983db488 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:38.956840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-80b04039-c001-49ae-b596-1ba5983db488 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.959028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-80b04039-c001-49ae-b596-1ba5983db488 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:38.960418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-e679b02f-2780-4adf-b7c4-388673616813 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Getting quotas for project 4ba21a8e4a9e49ea953ed4a871211a18. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:43:38.961090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-80b04039-c001-49ae-b596-1ba5983db488 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:38.978269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-e679b02f-2780-4adf-b7c4-388673616813 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Getting quotas for user 0f22db89d8174d76b7c5e6f4f99a11bf and project 4ba21a8e4a9e49ea953ed4a871211a18. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:43:38.999402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e679b02f-2780-4adf-b7c4-388673616813 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.912896 Sep 14 19:43:39.000433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 171/316] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Sep 14 19:43:38 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:39.077800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8da20913-5cbe-40c5-891c-b1eeb881272d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:39.080231 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8da20913-5cbe-40c5-891c-b1eeb881272d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:39.109387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8da20913-5cbe-40c5-891c-b1eeb881272d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:39.112819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8da20913-5cbe-40c5-891c-b1eeb881272d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:39.114312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8da20913-5cbe-40c5-891c-b1eeb881272d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:39.118952 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8da20913-5cbe-40c5-891c-b1eeb881272d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:39.305357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-80b04039-c001-49ae-b596-1ba5983db488 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:39.307741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-80b04039-c001-49ae-b596-1ba5983db488 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1510 microversion: 2.1 time: 0.389102 Sep 14 19:43:39.308371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 146/317] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:38 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:39.316958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a66d7dce-a4b6-464f-9329-be600fcd6ad1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:39.317564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a66d7dce-a4b6-464f-9329-be600fcd6ad1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:39.335426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a66d7dce-a4b6-464f-9329-be600fcd6ad1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:39.336383 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a66d7dce-a4b6-464f-9329-be600fcd6ad1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:39.338837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a66d7dce-a4b6-464f-9329-be600fcd6ad1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:39.338837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a66d7dce-a4b6-464f-9329-be600fcd6ad1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:39.544408 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a66d7dce-a4b6-464f-9329-be600fcd6ad1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:39.559020 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a66d7dce-a4b6-464f-9329-be600fcd6ad1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:39.560555 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a66d7dce-a4b6-464f-9329-be600fcd6ad1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:39.561780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a66d7dce-a4b6-464f-9329-be600fcd6ad1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.252455 Sep 14 19:43:39.562362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 147/318] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:39 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:39.576559 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8da20913-5cbe-40c5-891c-b1eeb881272d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:39.586709 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8da20913-5cbe-40c5-891c-b1eeb881272d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.514231 Sep 14 19:43:39.591368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-773618d9-2dc8-4ab6-a22d-e51b6c7b475b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:39.599912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-773618d9-2dc8-4ab6-a22d-e51b6c7b475b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:39.600073 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 172/319] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:39 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:39.608752 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-773618d9-2dc8-4ab6-a22d-e51b6c7b475b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:39.609201 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-773618d9-2dc8-4ab6-a22d-e51b6c7b475b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:39.610031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-773618d9-2dc8-4ab6-a22d-e51b6c7b475b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:39.611022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-773618d9-2dc8-4ab6-a22d-e51b6c7b475b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:39.812465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-773618d9-2dc8-4ab6-a22d-e51b6c7b475b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:39.820187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-773618d9-2dc8-4ab6-a22d-e51b6c7b475b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.240391 Sep 14 19:43:39.830309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 148/320] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:39 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:40.326068 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0cd8d555-fd2c-4f09-8a42-20aa3b20faab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:40.327651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0cd8d555-fd2c-4f09-8a42-20aa3b20faab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:40.339108 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0cd8d555-fd2c-4f09-8a42-20aa3b20faab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:40.339901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0cd8d555-fd2c-4f09-8a42-20aa3b20faab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:40.341189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0cd8d555-fd2c-4f09-8a42-20aa3b20faab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:40.341879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0cd8d555-fd2c-4f09-8a42-20aa3b20faab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:40.527227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0cd8d555-fd2c-4f09-8a42-20aa3b20faab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:40.535433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0cd8d555-fd2c-4f09-8a42-20aa3b20faab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1510 microversion: 2.1 time: 0.213130 Sep 14 19:43:40.536535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 173/321] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:40 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:40.582823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-17f3029a-ddfe-4c5f-883d-c113e053c8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:40.583572 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-17f3029a-ddfe-4c5f-883d-c113e053c8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:40.599818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-17f3029a-ddfe-4c5f-883d-c113e053c8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:40.599818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-17f3029a-ddfe-4c5f-883d-c113e053c8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:40.599818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-17f3029a-ddfe-4c5f-883d-c113e053c8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:40.599818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-17f3029a-ddfe-4c5f-883d-c113e053c8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:40.606059 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-be05136e-ff4c-405f-9d4d-33af8b5bd23a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:40.608291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-be05136e-ff4c-405f-9d4d-33af8b5bd23a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:40.628211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-be05136e-ff4c-405f-9d4d-33af8b5bd23a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:40.629672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-be05136e-ff4c-405f-9d4d-33af8b5bd23a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:40.631029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-be05136e-ff4c-405f-9d4d-33af8b5bd23a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:40.631730 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-be05136e-ff4c-405f-9d4d-33af8b5bd23a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:40.862491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-be05136e-ff4c-405f-9d4d-33af8b5bd23a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:40.871632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-be05136e-ff4c-405f-9d4d-33af8b5bd23a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.270391 Sep 14 19:43:40.872844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 174/322] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:40 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:40.878603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-59530a43-6f16-41f7-817b-634a20529cbc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:40.879629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-59530a43-6f16-41f7-817b-634a20529cbc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:40.885976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59530a43-6f16-41f7-817b-634a20529cbc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:40.886746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59530a43-6f16-41f7-817b-634a20529cbc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:40.887945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59530a43-6f16-41f7-817b-634a20529cbc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:40.888568 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59530a43-6f16-41f7-817b-634a20529cbc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:40.944228 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-17f3029a-ddfe-4c5f-883d-c113e053c8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:40.952410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-17f3029a-ddfe-4c5f-883d-c113e053c8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:40.954930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-17f3029a-ddfe-4c5f-883d-c113e053c8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:40.956363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-17f3029a-ddfe-4c5f-883d-c113e053c8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.379940 Sep 14 19:43:40.967506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 149/323] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:41.098174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-59530a43-6f16-41f7-817b-634a20529cbc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:41.107613 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-59530a43-6f16-41f7-817b-634a20529cbc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.233378 Sep 14 19:43:41.108374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 175/324] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:40 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:41.600733 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0d4f33e1-5389-40c5-9820-52f24c5561c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:41.601445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0d4f33e1-5389-40c5-9820-52f24c5561c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:41.607910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d4f33e1-5389-40c5-9820-52f24c5561c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:41.608443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d4f33e1-5389-40c5-9820-52f24c5561c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:41.614258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d4f33e1-5389-40c5-9820-52f24c5561c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:41.614258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d4f33e1-5389-40c5-9820-52f24c5561c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:41.769348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0d4f33e1-5389-40c5-9820-52f24c5561c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:41.777524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0d4f33e1-5389-40c5-9820-52f24c5561c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1510 microversion: 2.1 time: 0.180470 Sep 14 19:43:41.778121 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 150/325] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:41 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:41.890054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b7b4b4f1-af80-467e-8780-7e3874bbb377 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:41.892015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b7b4b4f1-af80-467e-8780-7e3874bbb377 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:41.899203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7b4b4f1-af80-467e-8780-7e3874bbb377 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:41.899874 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7b4b4f1-af80-467e-8780-7e3874bbb377 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:41.900880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7b4b4f1-af80-467e-8780-7e3874bbb377 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:41.901584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7b4b4f1-af80-467e-8780-7e3874bbb377 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:41.976487 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e75463b1-f790-46f6-af90-a742c1f55ace tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:41.977490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e75463b1-f790-46f6-af90-a742c1f55ace tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:41.985848 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e75463b1-f790-46f6-af90-a742c1f55ace tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:41.986632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e75463b1-f790-46f6-af90-a742c1f55ace tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:41.988333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e75463b1-f790-46f6-af90-a742c1f55ace tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:41.989291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e75463b1-f790-46f6-af90-a742c1f55ace tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:42.382525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e75463b1-f790-46f6-af90-a742c1f55ace tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:42.400605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e75463b1-f790-46f6-af90-a742c1f55ace tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:42.402276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e75463b1-f790-46f6-af90-a742c1f55ace tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:42.409854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e75463b1-f790-46f6-af90-a742c1f55ace tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.437564 Sep 14 19:43:42.411060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 151/326] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:41 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:42.415669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1658d502-03cb-42fa-bce4-99376e843691 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:42.416643 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1658d502-03cb-42fa-bce4-99376e843691 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:42.425133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1658d502-03cb-42fa-bce4-99376e843691 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:42.426017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1658d502-03cb-42fa-bce4-99376e843691 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:42.427188 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1658d502-03cb-42fa-bce4-99376e843691 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:42.427844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1658d502-03cb-42fa-bce4-99376e843691 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:42.455573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b7b4b4f1-af80-467e-8780-7e3874bbb377 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:42.468621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b7b4b4f1-af80-467e-8780-7e3874bbb377 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.582074 Sep 14 19:43:42.472067 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 176/327] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:41 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:42.609289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1658d502-03cb-42fa-bce4-99376e843691 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:42.624623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1658d502-03cb-42fa-bce4-99376e843691 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.212369 Sep 14 19:43:42.626270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 152/328] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:42 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:42.795856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a52feb60-3acc-4ee3-84f2-c14b6b6d0835 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:42.800633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a52feb60-3acc-4ee3-84f2-c14b6b6d0835 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:42.809470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a52feb60-3acc-4ee3-84f2-c14b6b6d0835 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:42.810324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a52feb60-3acc-4ee3-84f2-c14b6b6d0835 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:42.811571 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a52feb60-3acc-4ee3-84f2-c14b6b6d0835 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:42.813086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a52feb60-3acc-4ee3-84f2-c14b6b6d0835 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:43.170259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a52feb60-3acc-4ee3-84f2-c14b6b6d0835 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:43.179823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a52feb60-3acc-4ee3-84f2-c14b6b6d0835 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1510 microversion: 2.1 time: 0.388186 Sep 14 19:43:43.181024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 177/329] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:42 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:43.433250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b565773a-2a53-4522-b617-939c1387a484 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:43.439263 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b565773a-2a53-4522-b617-939c1387a484 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:43.442232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b565773a-2a53-4522-b617-939c1387a484 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:43.442689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b565773a-2a53-4522-b617-939c1387a484 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:43.443484 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b565773a-2a53-4522-b617-939c1387a484 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:43.443946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b565773a-2a53-4522-b617-939c1387a484 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:43.491778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-408f688c-a7d6-4ace-aa8a-f9184485d09c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:43.492953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-408f688c-a7d6-4ace-aa8a-f9184485d09c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:43.502436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-408f688c-a7d6-4ace-aa8a-f9184485d09c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:43.507880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-408f688c-a7d6-4ace-aa8a-f9184485d09c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:43.507880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-408f688c-a7d6-4ace-aa8a-f9184485d09c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:43.507880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-408f688c-a7d6-4ace-aa8a-f9184485d09c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:43.618367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b565773a-2a53-4522-b617-939c1387a484 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:43.630789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b565773a-2a53-4522-b617-939c1387a484 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:43.632498 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b565773a-2a53-4522-b617-939c1387a484 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:43.633759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b565773a-2a53-4522-b617-939c1387a484 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.204329 Sep 14 19:43:43.634587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 153/330] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:43.680077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-6e314966-aee0-45fe-a984-e5507ce0e643 req-0beb84dc-8ff9-4e6c-8095-07e4c166d799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1719e572-6299-43f2-a47b-f1774166a3a6", "tag": "532c332c-72bb-4af2-a240-857f96b8522b"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:43.688943 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:43:43.688943 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:43:43.702680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-6e314966-aee0-45fe-a984-e5507ce0e643 req-0beb84dc-8ff9-4e6c-8095-07e4c166d799 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:43.705735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-6e314966-aee0-45fe-a984-e5507ce0e643 req-0beb84dc-8ff9-4e6c-8095-07e4c166d799 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:43.728250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-6e314966-aee0-45fe-a984-e5507ce0e643 req-0beb84dc-8ff9-4e6c-8095-07e4c166d799 service nova] Creating event network-changed:532c332c-72bb-4af2-a240-857f96b8522b for instance 1719e572-6299-43f2-a47b-f1774166a3a6 on hv-cinder-80588 Sep 14 19:43:43.741719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-6e314966-aee0-45fe-a984-e5507ce0e643 req-0beb84dc-8ff9-4e6c-8095-07e4c166d799 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105567 Sep 14 19:43:43.742534 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 154/331] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:43:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:43.744201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-408f688c-a7d6-4ace-aa8a-f9184485d09c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:43.748904 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-efa21d63-5c12-4e60-b790-19e6a11e733a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:43.748904 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-efa21d63-5c12-4e60-b790-19e6a11e733a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:43.753657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-408f688c-a7d6-4ace-aa8a-f9184485d09c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.265809 Sep 14 19:43:43.754346 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 178/332] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:43 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:43.755457 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efa21d63-5c12-4e60-b790-19e6a11e733a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:43.755879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efa21d63-5c12-4e60-b790-19e6a11e733a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:43.756808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efa21d63-5c12-4e60-b790-19e6a11e733a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:43.757247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efa21d63-5c12-4e60-b790-19e6a11e733a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:43.912289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-efa21d63-5c12-4e60-b790-19e6a11e733a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:43.924044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-efa21d63-5c12-4e60-b790-19e6a11e733a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.180253 Sep 14 19:43:43.925090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 155/333] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:43 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:44.054270 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-cdbd70ac-0a0c-4eb2-bb1a-6a209c17126a req-6a9b5d18-cace-4256-be23-2bf98cc34ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a4a9d3-a4e1-47ad-af23-b7b3b9445f03", "name": "network-vif-plugged", "status": "completed", "tag": "9de31650-de64-4bf5-b67f-0fe7fe3c2861"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:44.056932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:43:44.056932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:43:44.065307 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-cdbd70ac-0a0c-4eb2-bb1a-6a209c17126a req-6a9b5d18-cace-4256-be23-2bf98cc34ae9 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:44.065858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-cdbd70ac-0a0c-4eb2-bb1a-6a209c17126a req-6a9b5d18-cace-4256-be23-2bf98cc34ae9 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:44.078069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-cdbd70ac-0a0c-4eb2-bb1a-6a209c17126a req-6a9b5d18-cace-4256-be23-2bf98cc34ae9 service nova] Creating event network-vif-plugged:9de31650-de64-4bf5-b67f-0fe7fe3c2861 for instance 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 on hv-cinder-80588 Sep 14 19:43:44.085306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-cdbd70ac-0a0c-4eb2-bb1a-6a209c17126a req-6a9b5d18-cace-4256-be23-2bf98cc34ae9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036365 Sep 14 19:43:44.086336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 179/334] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:43:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:44.207392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-03f19b44-469b-47b4-a675-ef00e097a771 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:44.209549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-03f19b44-469b-47b4-a675-ef00e097a771 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:44.216335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03f19b44-469b-47b4-a675-ef00e097a771 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:44.216931 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03f19b44-469b-47b4-a675-ef00e097a771 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:44.218306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03f19b44-469b-47b4-a675-ef00e097a771 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:44.227424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03f19b44-469b-47b4-a675-ef00e097a771 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:44.393164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-03f19b44-469b-47b4-a675-ef00e097a771 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:44.401138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-03f19b44-469b-47b4-a675-ef00e097a771 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1510 microversion: 2.1 time: 0.206985 Sep 14 19:43:44.401769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 156/335] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:44 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:44.654536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-818715ef-766c-4883-b212-ceb26bb16444 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:44.655228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-818715ef-766c-4883-b212-ceb26bb16444 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:44.661727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-818715ef-766c-4883-b212-ceb26bb16444 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:44.662260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-818715ef-766c-4883-b212-ceb26bb16444 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:44.663133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-818715ef-766c-4883-b212-ceb26bb16444 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:44.663638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-818715ef-766c-4883-b212-ceb26bb16444 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:44.770089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2c594fe5-7321-41e2-94bd-92dd98b69bb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:44.770717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2c594fe5-7321-41e2-94bd-92dd98b69bb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:44.777283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2c594fe5-7321-41e2-94bd-92dd98b69bb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:44.777764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2c594fe5-7321-41e2-94bd-92dd98b69bb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:44.778808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2c594fe5-7321-41e2-94bd-92dd98b69bb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:44.779247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2c594fe5-7321-41e2-94bd-92dd98b69bb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:44.972385 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-818715ef-766c-4883-b212-ceb26bb16444 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:44.973568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2c594fe5-7321-41e2-94bd-92dd98b69bb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:44.984295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2c594fe5-7321-41e2-94bd-92dd98b69bb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.217856 Sep 14 19:43:44.985392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 157/336] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:44 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:44.995519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-818715ef-766c-4883-b212-ceb26bb16444 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:44.996033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c2997800-5b00-4042-9303-b04ed2a2d026 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:44.996977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c2997800-5b00-4042-9303-b04ed2a2d026 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:44.998506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-818715ef-766c-4883-b212-ceb26bb16444 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:45.000251 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-818715ef-766c-4883-b212-ceb26bb16444 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.350126 Sep 14 19:43:45.002286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 180/337] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:45.015934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2997800-5b00-4042-9303-b04ed2a2d026 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:45.016411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2997800-5b00-4042-9303-b04ed2a2d026 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:45.017220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2997800-5b00-4042-9303-b04ed2a2d026 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:45.017701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2997800-5b00-4042-9303-b04ed2a2d026 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:45.165763 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c2997800-5b00-4042-9303-b04ed2a2d026 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:45.174392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c2997800-5b00-4042-9303-b04ed2a2d026 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.187577 Sep 14 19:43:45.174982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 158/338] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:44 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:45.422548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d0038112-ae94-43bc-ba9a-407f8542915d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:45.423979 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d0038112-ae94-43bc-ba9a-407f8542915d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:45.444268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d0038112-ae94-43bc-ba9a-407f8542915d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:45.451645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d0038112-ae94-43bc-ba9a-407f8542915d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:45.453092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d0038112-ae94-43bc-ba9a-407f8542915d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:45.453863 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d0038112-ae94-43bc-ba9a-407f8542915d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:45.628415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d0038112-ae94-43bc-ba9a-407f8542915d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:45.638150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d0038112-ae94-43bc-ba9a-407f8542915d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1510 microversion: 2.1 time: 0.222572 Sep 14 19:43:45.640015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 181/339] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:45 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:46.002890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f1737b2c-864f-472d-bfa5-1a6442639829 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:46.003502 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f1737b2c-864f-472d-bfa5-1a6442639829 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:46.009519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f1737b2c-864f-472d-bfa5-1a6442639829 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:46.009993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f1737b2c-864f-472d-bfa5-1a6442639829 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:46.010809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f1737b2c-864f-472d-bfa5-1a6442639829 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:46.011246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f1737b2c-864f-472d-bfa5-1a6442639829 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:46.021084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9fb4a25d-b39a-4e8e-b172-05063e9951ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:46.021844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9fb4a25d-b39a-4e8e-b172-05063e9951ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:46.029429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fb4a25d-b39a-4e8e-b172-05063e9951ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:46.029957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fb4a25d-b39a-4e8e-b172-05063e9951ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:46.030826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fb4a25d-b39a-4e8e-b172-05063e9951ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:46.031287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fb4a25d-b39a-4e8e-b172-05063e9951ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:46.198330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f1737b2c-864f-472d-bfa5-1a6442639829 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:46.206414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f1737b2c-864f-472d-bfa5-1a6442639829 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1318 microversion: 2.1 time: 0.207202 Sep 14 19:43:46.207003 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 159/340] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:45 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:46.212027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9fb4a25d-b39a-4e8e-b172-05063e9951ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:46.220821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-71d5e8d1-635d-4e86-9419-d68667c11743 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:46.221636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-71d5e8d1-635d-4e86-9419-d68667c11743 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:46.221891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9fb4a25d-b39a-4e8e-b172-05063e9951ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:46.223361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9fb4a25d-b39a-4e8e-b172-05063e9951ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:46.225108 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9fb4a25d-b39a-4e8e-b172-05063e9951ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.208018 Sep 14 19:43:46.225704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 182/341] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:46.231315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71d5e8d1-635d-4e86-9419-d68667c11743 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:46.231765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71d5e8d1-635d-4e86-9419-d68667c11743 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:46.232549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71d5e8d1-635d-4e86-9419-d68667c11743 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:46.232982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71d5e8d1-635d-4e86-9419-d68667c11743 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:46.501822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-71d5e8d1-635d-4e86-9419-d68667c11743 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:46.509398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-71d5e8d1-635d-4e86-9419-d68667c11743 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.292846 Sep 14 19:43:46.510006 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 160/342] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:46 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:46.656767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f807a033-881e-4fff-8528-ce9553d2b047 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:46.658012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f807a033-881e-4fff-8528-ce9553d2b047 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:46.666361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f807a033-881e-4fff-8528-ce9553d2b047 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:46.666804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f807a033-881e-4fff-8528-ce9553d2b047 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:46.667630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f807a033-881e-4fff-8528-ce9553d2b047 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:46.668072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f807a033-881e-4fff-8528-ce9553d2b047 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:46.803242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f807a033-881e-4fff-8528-ce9553d2b047 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:46.812034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f807a033-881e-4fff-8528-ce9553d2b047 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1516 microversion: 2.1 time: 0.159452 Sep 14 19:43:46.813638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 183/343] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:46 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:47.223488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a28ca258-02a2-437f-a3ca-4b522e42e8ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:47.224671 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a28ca258-02a2-437f-a3ca-4b522e42e8ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:47.230794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a28ca258-02a2-437f-a3ca-4b522e42e8ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:47.231240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a28ca258-02a2-437f-a3ca-4b522e42e8ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:47.232222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a28ca258-02a2-437f-a3ca-4b522e42e8ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:47.232692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a28ca258-02a2-437f-a3ca-4b522e42e8ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:47.244181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b66adb0e-9f82-4df5-9286-39bfcfa8c2f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:47.244775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b66adb0e-9f82-4df5-9286-39bfcfa8c2f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:47.277758 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b66adb0e-9f82-4df5-9286-39bfcfa8c2f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:47.278306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b66adb0e-9f82-4df5-9286-39bfcfa8c2f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:47.279227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b66adb0e-9f82-4df5-9286-39bfcfa8c2f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:47.279678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b66adb0e-9f82-4df5-9286-39bfcfa8c2f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:47.434999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a28ca258-02a2-437f-a3ca-4b522e42e8ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:47.444323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a28ca258-02a2-437f-a3ca-4b522e42e8ed tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1509 microversion: 2.1 time: 0.225061 Sep 14 19:43:47.454697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 161/344] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:47 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:47.454990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b66adb0e-9f82-4df5-9286-39bfcfa8c2f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:47.464387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b66adb0e-9f82-4df5-9286-39bfcfa8c2f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:47.465975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b66adb0e-9f82-4df5-9286-39bfcfa8c2f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:47.467156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b66adb0e-9f82-4df5-9286-39bfcfa8c2f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.226783 Sep 14 19:43:47.478168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 184/345] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:47 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:43:47.528160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-33315b5e-2872-4649-9bda-8730f8386884 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:47.529717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-33315b5e-2872-4649-9bda-8730f8386884 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:47.536858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33315b5e-2872-4649-9bda-8730f8386884 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:47.545166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33315b5e-2872-4649-9bda-8730f8386884 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:47.546493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33315b5e-2872-4649-9bda-8730f8386884 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:47.546967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33315b5e-2872-4649-9bda-8730f8386884 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:47.728475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-33315b5e-2872-4649-9bda-8730f8386884 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:47.735698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-33315b5e-2872-4649-9bda-8730f8386884 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.212126 Sep 14 19:43:47.736345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 162/346] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:47 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:48.489088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bea44d41-0a2e-47b0-b58f-3bf25e6c694e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:48.489675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bea44d41-0a2e-47b0-b58f-3bf25e6c694e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:48.496662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bea44d41-0a2e-47b0-b58f-3bf25e6c694e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:48.497117 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bea44d41-0a2e-47b0-b58f-3bf25e6c694e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:48.497992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bea44d41-0a2e-47b0-b58f-3bf25e6c694e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:48.498439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bea44d41-0a2e-47b0-b58f-3bf25e6c694e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:48.653773 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bea44d41-0a2e-47b0-b58f-3bf25e6c694e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:48.667534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bea44d41-0a2e-47b0-b58f-3bf25e6c694e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:48.667534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bea44d41-0a2e-47b0-b58f-3bf25e6c694e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:48.667534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bea44d41-0a2e-47b0-b58f-3bf25e6c694e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.183871 Sep 14 19:43:48.667944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 185/347] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:48 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:48.752500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f5c1c9e3-3f2d-402b-8384-8411b9d884f6 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:48.753071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f5c1c9e3-3f2d-402b-8384-8411b9d884f6 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:48.759079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5c1c9e3-3f2d-402b-8384-8411b9d884f6 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:48.759526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5c1c9e3-3f2d-402b-8384-8411b9d884f6 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:48.760296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5c1c9e3-3f2d-402b-8384-8411b9d884f6 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:48.760730 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5c1c9e3-3f2d-402b-8384-8411b9d884f6 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:48.885958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f5c1c9e3-3f2d-402b-8384-8411b9d884f6 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:48.894084 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f5c1c9e3-3f2d-402b-8384-8411b9d884f6 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.145479 Sep 14 19:43:48.894663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 163/348] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:48 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:49.153236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f6f9b2ed-7558-45c2-b0be-9bbad798b3bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:49.153892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f6f9b2ed-7558-45c2-b0be-9bbad798b3bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:49.160534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6f9b2ed-7558-45c2-b0be-9bbad798b3bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:49.161174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6f9b2ed-7558-45c2-b0be-9bbad798b3bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:49.162142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6f9b2ed-7558-45c2-b0be-9bbad798b3bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:49.162929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6f9b2ed-7558-45c2-b0be-9bbad798b3bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:49.310006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f6f9b2ed-7558-45c2-b0be-9bbad798b3bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:49.319256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f6f9b2ed-7558-45c2-b0be-9bbad798b3bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1516 microversion: 2.1 time: 0.169937 Sep 14 19:43:49.319836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 186/349] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:49 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:49.336598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-99bbbdc0-9622-4d91-923b-a8485d00fd97 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84a2e904-704f-4ae0-aa81-f36e65581850"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:49.338331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-99bbbdc0-9622-4d91-923b-a8485d00fd97 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:49.346967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99bbbdc0-9622-4d91-923b-a8485d00fd97 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:49.347654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99bbbdc0-9622-4d91-923b-a8485d00fd97 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:49.349160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99bbbdc0-9622-4d91-923b-a8485d00fd97 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:49.349831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99bbbdc0-9622-4d91-923b-a8485d00fd97 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:49.684100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-70d4f783-fdef-4e8d-be19-f8a1b053d682 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:49.684710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-70d4f783-fdef-4e8d-be19-f8a1b053d682 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:49.691260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70d4f783-fdef-4e8d-be19-f8a1b053d682 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:49.691707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70d4f783-fdef-4e8d-be19-f8a1b053d682 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:49.692494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70d4f783-fdef-4e8d-be19-f8a1b053d682 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:49.692930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70d4f783-fdef-4e8d-be19-f8a1b053d682 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:49.819115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-70d4f783-fdef-4e8d-be19-f8a1b053d682 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:49.827179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-70d4f783-fdef-4e8d-be19-f8a1b053d682 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:49.829294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-70d4f783-fdef-4e8d-be19-f8a1b053d682 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:49.830734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-70d4f783-fdef-4e8d-be19-f8a1b053d682 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.150420 Sep 14 19:43:49.831291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 187/350] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:49 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:43:49.912727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b397882d-0adf-44c8-a024-d2b648c5de13 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:49.913748 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b397882d-0adf-44c8-a024-d2b648c5de13 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:49.922354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b397882d-0adf-44c8-a024-d2b648c5de13 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:49.922737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b397882d-0adf-44c8-a024-d2b648c5de13 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:49.923782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b397882d-0adf-44c8-a024-d2b648c5de13 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:49.924532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b397882d-0adf-44c8-a024-d2b648c5de13 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:50.073372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b397882d-0adf-44c8-a024-d2b648c5de13 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:50.083160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b397882d-0adf-44c8-a024-d2b648c5de13 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.175021 Sep 14 19:43:50.084035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 188/351] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:49 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:50.848887 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-282711ae-0ea9-463a-ba55-c04d83e8c3d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:50.849489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-282711ae-0ea9-463a-ba55-c04d83e8c3d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:50.855246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-282711ae-0ea9-463a-ba55-c04d83e8c3d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:50.855889 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-282711ae-0ea9-463a-ba55-c04d83e8c3d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:50.856651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-282711ae-0ea9-463a-ba55-c04d83e8c3d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:50.857084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-282711ae-0ea9-463a-ba55-c04d83e8c3d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:51.124072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-282711ae-0ea9-463a-ba55-c04d83e8c3d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:51.132836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-282711ae-0ea9-463a-ba55-c04d83e8c3d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:51.134391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-282711ae-0ea9-463a-ba55-c04d83e8c3d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:51.135582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-282711ae-0ea9-463a-ba55-c04d83e8c3d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1722 microversion: 2.20 time: 0.291181 Sep 14 19:43:51.136144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 189/352] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:50 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:43:51.150285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d072b44f-9f12-436d-8c83-10ef5b3b3090 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:51.150895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d072b44f-9f12-436d-8c83-10ef5b3b3090 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:51.156867 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d072b44f-9f12-436d-8c83-10ef5b3b3090 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:51.157321 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d072b44f-9f12-436d-8c83-10ef5b3b3090 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:51.158129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d072b44f-9f12-436d-8c83-10ef5b3b3090 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:51.158954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d072b44f-9f12-436d-8c83-10ef5b3b3090 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:51.342608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d072b44f-9f12-436d-8c83-10ef5b3b3090 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:51.350708 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d072b44f-9f12-436d-8c83-10ef5b3b3090 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.213537 Sep 14 19:43:51.351478 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 190/353] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:51 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:52.154378 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-729910c4-a04c-4329-8781-a0c9feb6750b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:52.155041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-729910c4-a04c-4329-8781-a0c9feb6750b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:52.162834 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-729910c4-a04c-4329-8781-a0c9feb6750b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:52.163546 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-729910c4-a04c-4329-8781-a0c9feb6750b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:52.164797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-729910c4-a04c-4329-8781-a0c9feb6750b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:52.166058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-729910c4-a04c-4329-8781-a0c9feb6750b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:52.247239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-99bbbdc0-9622-4d91-923b-a8485d00fd97 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.914407 Sep 14 19:43:52.247872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 164/354] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Sep 14 19:43:49 2021] POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 194 bytes in 2916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:52.327319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-729910c4-a04c-4329-8781-a0c9feb6750b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:52.336657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-729910c4-a04c-4329-8781-a0c9feb6750b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:52.338345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-729910c4-a04c-4329-8781-a0c9feb6750b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:52.339720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-729910c4-a04c-4329-8781-a0c9feb6750b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1743 microversion: 2.20 time: 0.189245 Sep 14 19:43:52.340679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 191/355] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1743 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:43:52.371810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0d79bcae-a6ad-483c-8b15-59b5cecdc0b0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:52.371810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0d79bcae-a6ad-483c-8b15-59b5cecdc0b0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:52.384232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d79bcae-a6ad-483c-8b15-59b5cecdc0b0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:52.384658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d79bcae-a6ad-483c-8b15-59b5cecdc0b0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:52.385453 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d79bcae-a6ad-483c-8b15-59b5cecdc0b0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:52.385927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d79bcae-a6ad-483c-8b15-59b5cecdc0b0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:52.546849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0d79bcae-a6ad-483c-8b15-59b5cecdc0b0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:52.567201 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0d79bcae-a6ad-483c-8b15-59b5cecdc0b0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.202605 Sep 14 19:43:52.568451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 165/356] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:52 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:52.712035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-921b1d0d-0e7d-4e02-9967-af6d7de45105 req-24c2d6c6-7acd-4d75-be32-23352e903b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1719e572-6299-43f2-a47b-f1774166a3a6", "name": "network-vif-plugged", "status": "completed", "tag": "532c332c-72bb-4af2-a240-857f96b8522b"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:52.713707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:43:52.713707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:43:52.721538 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-921b1d0d-0e7d-4e02-9967-af6d7de45105 req-24c2d6c6-7acd-4d75-be32-23352e903b15 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:52.722076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-921b1d0d-0e7d-4e02-9967-af6d7de45105 req-24c2d6c6-7acd-4d75-be32-23352e903b15 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:52.734515 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-921b1d0d-0e7d-4e02-9967-af6d7de45105 req-24c2d6c6-7acd-4d75-be32-23352e903b15 service nova] Creating event network-vif-plugged:532c332c-72bb-4af2-a240-857f96b8522b for instance 1719e572-6299-43f2-a47b-f1774166a3a6 on hv-cinder-80588 Sep 14 19:43:52.740732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-921b1d0d-0e7d-4e02-9967-af6d7de45105 req-24c2d6c6-7acd-4d75-be32-23352e903b15 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032119 Sep 14 19:43:52.742039 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 192/357] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:43:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:53.042283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f2335aeb-504d-468a-8bab-8c7eff931448 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acac5afb-34f0-429c-849e-bcb32adb62e8"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:53.044127 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f2335aeb-504d-468a-8bab-8c7eff931448 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:53.052948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2335aeb-504d-468a-8bab-8c7eff931448 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:53.053793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2335aeb-504d-468a-8bab-8c7eff931448 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:53.054749 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2335aeb-504d-468a-8bab-8c7eff931448 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:53.055391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2335aeb-504d-468a-8bab-8c7eff931448 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:53.363219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-403e748a-299e-4296-a04d-692f0e97bb28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:53.364126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-403e748a-299e-4296-a04d-692f0e97bb28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:53.372724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-403e748a-299e-4296-a04d-692f0e97bb28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:53.373426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-403e748a-299e-4296-a04d-692f0e97bb28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:53.374486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-403e748a-299e-4296-a04d-692f0e97bb28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:53.375146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-403e748a-299e-4296-a04d-692f0e97bb28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:53.591039 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-403e748a-299e-4296-a04d-692f0e97bb28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:53.599479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-403e748a-299e-4296-a04d-692f0e97bb28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:53.600980 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-403e748a-299e-4296-a04d-692f0e97bb28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:53.602202 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-403e748a-299e-4296-a04d-692f0e97bb28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1743 microversion: 2.20 time: 0.246701 Sep 14 19:43:53.602757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 193/358] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:53 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1743 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:43:53.607085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-328892b4-0582-46ad-92f7-3a1eb80ccf40 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:53.607685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-328892b4-0582-46ad-92f7-3a1eb80ccf40 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:53.613815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-328892b4-0582-46ad-92f7-3a1eb80ccf40 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:53.614267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-328892b4-0582-46ad-92f7-3a1eb80ccf40 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:53.615159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-328892b4-0582-46ad-92f7-3a1eb80ccf40 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:53.615511 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-328892b4-0582-46ad-92f7-3a1eb80ccf40 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:53.746714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-328892b4-0582-46ad-92f7-3a1eb80ccf40 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:53.758593 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-328892b4-0582-46ad-92f7-3a1eb80ccf40 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.154774 Sep 14 19:43:53.759181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 194/359] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:53 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:54.611112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f2335aeb-504d-468a-8bab-8c7eff931448 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "POST /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.573844 Sep 14 19:43:54.611825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 166/360] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Sep 14 19:43:53 2021] POST /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03/os-volume_attachments => generated 194 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:54.620470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1204433656", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "networks": [{"uuid": "cabdc1cd-3ed9-411f-b2a1-449182bf7ea2"}]}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:54.625945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ca602b0c-2be1-4ab9-a5b9-79a84b30db7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:54.631307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ca602b0c-2be1-4ab9-a5b9-79a84b30db7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:54.647635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca602b0c-2be1-4ab9-a5b9-79a84b30db7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:54.654612 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca602b0c-2be1-4ab9-a5b9-79a84b30db7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:54.655637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca602b0c-2be1-4ab9-a5b9-79a84b30db7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:54.662277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca602b0c-2be1-4ab9-a5b9-79a84b30db7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:54.947062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.network.neutron [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] validate_networks() for [('cabdc1cd-3ed9-411f-b2a1-449182bf7ea2', None, None, None, None, None)] {{(pid=115678) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:43:55.189338 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ca602b0c-2be1-4ab9-a5b9-79a84b30db7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:55.207867 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ca602b0c-2be1-4ab9-a5b9-79a84b30db7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:55.210793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ca602b0c-2be1-4ab9-a5b9-79a84b30db7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:55.223911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ca602b0c-2be1-4ab9-a5b9-79a84b30db7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.602614 Sep 14 19:43:55.242489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 167/361] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:55.242489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e25a8fdf-5e36-4117-99bb-b7154a55c0be tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:55.243052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e25a8fdf-5e36-4117-99bb-b7154a55c0be tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:55.260271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e25a8fdf-5e36-4117-99bb-b7154a55c0be tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:55.260994 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e25a8fdf-5e36-4117-99bb-b7154a55c0be tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:55.264570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e25a8fdf-5e36-4117-99bb-b7154a55c0be tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:55.265883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e25a8fdf-5e36-4117-99bb-b7154a55c0be tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:55.633268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Flavor limits 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:43:55.634576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Image limits 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:43:55.635230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Flavor pref 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:43:55.635805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Image pref 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:43:55.636381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:43:55.649943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:55.650665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:55.651670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:55.652325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:55.679265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Getting quotas for project ad18cc0be51b4a2c8016758bb56e20f6. Resources: {'cores', 'ram', 'instances'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:43:55.685355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Getting quotas for user 3f93d21b697e42b896a5ad9314b75c64 and project ad18cc0be51b4a2c8016758bb56e20f6. Resources: {'cores', 'ram', 'instances'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:43:55.710734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Going to run 1 instances... {{(pid=115678) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:43:55.714782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:43:55.856450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-430ae0a1-32d1-4e29-8ae0-e55aeb39afb0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244318 Sep 14 19:43:55.866508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 195/362] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:43:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:43:55.878824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5f2494d0-edbf-4aea-99af-e3c9d6a5e805 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:55.879557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5f2494d0-edbf-4aea-99af-e3c9d6a5e805 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:55.950518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e25a8fdf-5e36-4117-99bb-b7154a55c0be tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:55.960958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e25a8fdf-5e36-4117-99bb-b7154a55c0be tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1361 microversion: 2.1 time: 0.723956 Sep 14 19:43:55.966675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 168/363] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:55 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1361 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:56.021391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5f2494d0-edbf-4aea-99af-e3c9d6a5e805 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:56.035215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5f2494d0-edbf-4aea-99af-e3c9d6a5e805 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1219 microversion: 2.1 time: 0.160507 Sep 14 19:43:56.036473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 196/364] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:55 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:56.250912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9abdde15-7085-41ef-86fc-a09b41434b13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:56.251519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9abdde15-7085-41ef-86fc-a09b41434b13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:56.261924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9abdde15-7085-41ef-86fc-a09b41434b13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:56.262380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9abdde15-7085-41ef-86fc-a09b41434b13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:56.263172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9abdde15-7085-41ef-86fc-a09b41434b13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:56.263604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9abdde15-7085-41ef-86fc-a09b41434b13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:56.544651 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9abdde15-7085-41ef-86fc-a09b41434b13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:56.557785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9abdde15-7085-41ef-86fc-a09b41434b13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:56.567054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9abdde15-7085-41ef-86fc-a09b41434b13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:56.570670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9abdde15-7085-41ef-86fc-a09b41434b13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.324317 Sep 14 19:43:56.575561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 169/365] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:56 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:56.857828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-d39fd408-c568-4566-9cff-72608e5a19b3 req-c8353281-c6e8-4a40-935d-8dc1060d05c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a26129-f7fb-4755-979a-968cdf0c7d34", "name": "network-vif-plugged", "status": "completed", "tag": "f0babfc4-e4f0-41d5-9206-dc7125b0b10e"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:43:56.859680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:43:56.859680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:43:56.876977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-d39fd408-c568-4566-9cff-72608e5a19b3 req-c8353281-c6e8-4a40-935d-8dc1060d05c8 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:56.877744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-d39fd408-c568-4566-9cff-72608e5a19b3 req-c8353281-c6e8-4a40-935d-8dc1060d05c8 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:56.928036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-d39fd408-c568-4566-9cff-72608e5a19b3 req-c8353281-c6e8-4a40-935d-8dc1060d05c8 service nova] Creating event network-vif-plugged:f0babfc4-e4f0-41d5-9206-dc7125b0b10e for instance 72a26129-f7fb-4755-979a-968cdf0c7d34 on hv-cinder-80588 Sep 14 19:43:56.988138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-d39fd408-c568-4566-9cff-72608e5a19b3 req-c8353281-c6e8-4a40-935d-8dc1060d05c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112616 Sep 14 19:43:56.988138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 197/366] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:43:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:56.988496 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f588458a-84fb-4786-9130-0c3678167e90 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:56.988496 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f588458a-84fb-4786-9130-0c3678167e90 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:56.997957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f588458a-84fb-4786-9130-0c3678167e90 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:57.002818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f588458a-84fb-4786-9130-0c3678167e90 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:57.008195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f588458a-84fb-4786-9130-0c3678167e90 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:57.014130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f588458a-84fb-4786-9130-0c3678167e90 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:57.053535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9123cff9-2b77-4da8-b570-ac7ad7346c08 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:57.054549 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9123cff9-2b77-4da8-b570-ac7ad7346c08 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:57.148332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9123cff9-2b77-4da8-b570-ac7ad7346c08 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:57.155670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9123cff9-2b77-4da8-b570-ac7ad7346c08 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1219 microversion: 2.1 time: 0.106638 Sep 14 19:43:57.158126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 198/367] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:57 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:43:57.247637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f588458a-84fb-4786-9130-0c3678167e90 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:57.261424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f588458a-84fb-4786-9130-0c3678167e90 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1547 microversion: 2.1 time: 0.281847 Sep 14 19:43:57.262579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 170/368] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:56 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1547 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:57.285431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a1c18671-8fb0-4806-9010-2e3eb7b9c61c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:57.289279 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a1c18671-8fb0-4806-9010-2e3eb7b9c61c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:57.303957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1c18671-8fb0-4806-9010-2e3eb7b9c61c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:57.310840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1c18671-8fb0-4806-9010-2e3eb7b9c61c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:57.310840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1c18671-8fb0-4806-9010-2e3eb7b9c61c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:57.310840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1c18671-8fb0-4806-9010-2e3eb7b9c61c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:57.447044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a1c18671-8fb0-4806-9010-2e3eb7b9c61c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.170432 Sep 14 19:43:57.448697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 199/369] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Sep 14 19:43:57 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:43:57.597788 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-16859046-1915-4c59-8f43-6f420fac5dc0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:57.598911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-16859046-1915-4c59-8f43-6f420fac5dc0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:57.614715 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16859046-1915-4c59-8f43-6f420fac5dc0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:57.616577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16859046-1915-4c59-8f43-6f420fac5dc0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:57.623596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16859046-1915-4c59-8f43-6f420fac5dc0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:57.624076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16859046-1915-4c59-8f43-6f420fac5dc0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:58.170886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16859046-1915-4c59-8f43-6f420fac5dc0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:58.177714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-627f3d5f-18d6-4cc3-95ed-e1e5b207c82e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:58.179694 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-627f3d5f-18d6-4cc3-95ed-e1e5b207c82e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:58.198283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-627f3d5f-18d6-4cc3-95ed-e1e5b207c82e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:58.198515 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16859046-1915-4c59-8f43-6f420fac5dc0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:58.198626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-627f3d5f-18d6-4cc3-95ed-e1e5b207c82e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:58.198626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-627f3d5f-18d6-4cc3-95ed-e1e5b207c82e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:58.198626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-627f3d5f-18d6-4cc3-95ed-e1e5b207c82e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:58.205885 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16859046-1915-4c59-8f43-6f420fac5dc0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:58.207432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-16859046-1915-4c59-8f43-6f420fac5dc0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.617666 Sep 14 19:43:58.213687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 171/370] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:57 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:58.659223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-627f3d5f-18d6-4cc3-95ed-e1e5b207c82e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:58.691641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-627f3d5f-18d6-4cc3-95ed-e1e5b207c82e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1223 microversion: 2.1 time: 0.518431 Sep 14 19:43:58.706144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 200/371] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:58 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1223 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:43:59.229353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1f90bf23-c92f-49fd-b228-f9901b2b03e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:59.230765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1f90bf23-c92f-49fd-b228-f9901b2b03e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:59.239624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f90bf23-c92f-49fd-b228-f9901b2b03e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:59.244423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f90bf23-c92f-49fd-b228-f9901b2b03e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:59.246255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f90bf23-c92f-49fd-b228-f9901b2b03e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:59.251046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f90bf23-c92f-49fd-b228-f9901b2b03e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:59.462581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1f90bf23-c92f-49fd-b228-f9901b2b03e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:59.474740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1f90bf23-c92f-49fd-b228-f9901b2b03e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:59.477630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1f90bf23-c92f-49fd-b228-f9901b2b03e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:59.479566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1f90bf23-c92f-49fd-b228-f9901b2b03e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.255023 Sep 14 19:43:59.480384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 172/372] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:43:59 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:43:59.724501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-eb4a0e5d-cafb-4270-a8ef-5fce961eb5c2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:43:59.725277 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-eb4a0e5d-cafb-4270-a8ef-5fce961eb5c2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:43:59.737633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb4a0e5d-cafb-4270-a8ef-5fce961eb5c2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:59.738355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb4a0e5d-cafb-4270-a8ef-5fce961eb5c2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:59.739485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb4a0e5d-cafb-4270-a8ef-5fce961eb5c2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:43:59.740285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb4a0e5d-cafb-4270-a8ef-5fce961eb5c2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:43:59.888211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-eb4a0e5d-cafb-4270-a8ef-5fce961eb5c2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:43:59.905614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-eb4a0e5d-cafb-4270-a8ef-5fce961eb5c2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1271 microversion: 2.1 time: 0.179287 Sep 14 19:43:59.905614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 201/373] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:43:59 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:00.054768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0968e9ec-2ca1-4eb1-9f6f-53cad96c50d7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:00.055778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0968e9ec-2ca1-4eb1-9f6f-53cad96c50d7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:00.075696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0968e9ec-2ca1-4eb1-9f6f-53cad96c50d7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:00.076163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0968e9ec-2ca1-4eb1-9f6f-53cad96c50d7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:00.077052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0968e9ec-2ca1-4eb1-9f6f-53cad96c50d7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:00.080774 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0968e9ec-2ca1-4eb1-9f6f-53cad96c50d7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:00.092891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-643d2e4c-e341-42e7-aea1-d03f68e6a34f req-99d99090-07aa-4504-93b5-743633f48fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1719e572-6299-43f2-a47b-f1774166a3a6", "tag": "532c332c-72bb-4af2-a240-857f96b8522b"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:00.095924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:44:00.095924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:44:00.121892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-643d2e4c-e341-42e7-aea1-d03f68e6a34f req-99d99090-07aa-4504-93b5-743633f48fb7 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:00.121892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-643d2e4c-e341-42e7-aea1-d03f68e6a34f req-99d99090-07aa-4504-93b5-743633f48fb7 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:00.152593 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-643d2e4c-e341-42e7-aea1-d03f68e6a34f req-99d99090-07aa-4504-93b5-743633f48fb7 service nova] Creating event network-changed:532c332c-72bb-4af2-a240-857f96b8522b for instance 1719e572-6299-43f2-a47b-f1774166a3a6 on hv-cinder-80588 Sep 14 19:44:00.171395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0968e9ec-2ca1-4eb1-9f6f-53cad96c50d7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.122459 Sep 14 19:44:00.174882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 173/374] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:00 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:00.219080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-643d2e4c-e341-42e7-aea1-d03f68e6a34f req-99d99090-07aa-4504-93b5-743633f48fb7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132903 Sep 14 19:44:00.219080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 202/375] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:44:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:44:00.498868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bcc9359e-9d8e-4fdc-9a1b-1c2bf384fc39 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:00.500866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bcc9359e-9d8e-4fdc-9a1b-1c2bf384fc39 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:00.520246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcc9359e-9d8e-4fdc-9a1b-1c2bf384fc39 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:00.521258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcc9359e-9d8e-4fdc-9a1b-1c2bf384fc39 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:00.522551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcc9359e-9d8e-4fdc-9a1b-1c2bf384fc39 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:00.524547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcc9359e-9d8e-4fdc-9a1b-1c2bf384fc39 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:00.923149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dea1bfc7-c3f4-4a2a-a404-96a5a38f390c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:00.925968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dea1bfc7-c3f4-4a2a-a404-96a5a38f390c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:00.948168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bcc9359e-9d8e-4fdc-9a1b-1c2bf384fc39 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:00.958401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dea1bfc7-c3f4-4a2a-a404-96a5a38f390c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:00.966503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dea1bfc7-c3f4-4a2a-a404-96a5a38f390c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:00.971271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dea1bfc7-c3f4-4a2a-a404-96a5a38f390c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:00.971732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dea1bfc7-c3f4-4a2a-a404-96a5a38f390c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:00.975509 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bcc9359e-9d8e-4fdc-9a1b-1c2bf384fc39 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:00.977466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bcc9359e-9d8e-4fdc-9a1b-1c2bf384fc39 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:00.981971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bcc9359e-9d8e-4fdc-9a1b-1c2bf384fc39 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.484460 Sep 14 19:44:00.983824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 174/376] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:00 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:01.153984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dea1bfc7-c3f4-4a2a-a404-96a5a38f390c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:01.182681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-02ce30ed-d1b5-4ff8-addf-5e93a4b25e94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:01.183944 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-02ce30ed-d1b5-4ff8-addf-5e93a4b25e94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:01.196723 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dea1bfc7-c3f4-4a2a-a404-96a5a38f390c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1289 microversion: 2.1 time: 0.282436 Sep 14 19:44:01.198598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02ce30ed-d1b5-4ff8-addf-5e93a4b25e94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:01.200826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 203/377] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:00 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1289 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:01.202467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02ce30ed-d1b5-4ff8-addf-5e93a4b25e94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:01.206018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02ce30ed-d1b5-4ff8-addf-5e93a4b25e94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:01.206018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02ce30ed-d1b5-4ff8-addf-5e93a4b25e94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:01.363674 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-02ce30ed-d1b5-4ff8-addf-5e93a4b25e94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.183669 Sep 14 19:44:01.364633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 175/378] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:01 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:01.874276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fe41d693-3955-417e-904b-a2fce68d7456 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:01.876054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fe41d693-3955-417e-904b-a2fce68d7456 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:01.882786 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fe41d693-3955-417e-904b-a2fce68d7456 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:01.883496 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fe41d693-3955-417e-904b-a2fce68d7456 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:01.884492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fe41d693-3955-417e-904b-a2fce68d7456 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:01.885079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fe41d693-3955-417e-904b-a2fce68d7456 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:01.934633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-fe41d693-3955-417e-904b-a2fce68d7456 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lazy-loading 'flavor' on Instance uuid 0b9185a2-5afd-4c39-bb28-beb531d58eb0 {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:44:02.002165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-05c36cd9-698d-4285-8099-943a179a029f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:02.003631 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-05c36cd9-698d-4285-8099-943a179a029f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:02.010297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05c36cd9-698d-4285-8099-943a179a029f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:02.010933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05c36cd9-698d-4285-8099-943a179a029f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:02.011911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05c36cd9-698d-4285-8099-943a179a029f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:02.012344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05c36cd9-698d-4285-8099-943a179a029f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:02.154243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-05c36cd9-698d-4285-8099-943a179a029f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:02.168926 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-05c36cd9-698d-4285-8099-943a179a029f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:02.170489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-05c36cd9-698d-4285-8099-943a179a029f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:02.172522 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-05c36cd9-698d-4285-8099-943a179a029f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.174530 Sep 14 19:44:02.173029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 176/379] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:01 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:02.224170 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a29c8039-f5cd-44d7-af89-91e48d38bfa5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:02.224983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a29c8039-f5cd-44d7-af89-91e48d38bfa5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:02.240692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a29c8039-f5cd-44d7-af89-91e48d38bfa5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:02.241460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a29c8039-f5cd-44d7-af89-91e48d38bfa5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:02.242513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a29c8039-f5cd-44d7-af89-91e48d38bfa5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:02.244906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a29c8039-f5cd-44d7-af89-91e48d38bfa5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:02.463353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a29c8039-f5cd-44d7-af89-91e48d38bfa5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:02.478148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a29c8039-f5cd-44d7-af89-91e48d38bfa5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1277 microversion: 2.1 time: 0.265177 Sep 14 19:44:02.478747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 177/380] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:02 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:02.506741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-05cb12f3-40d3-4b18-8a70-42aa165ceb79 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:02.507730 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-05cb12f3-40d3-4b18-8a70-42aa165ceb79 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:02.519831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05cb12f3-40d3-4b18-8a70-42aa165ceb79 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:02.523123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05cb12f3-40d3-4b18-8a70-42aa165ceb79 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:02.524982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05cb12f3-40d3-4b18-8a70-42aa165ceb79 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:02.528195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05cb12f3-40d3-4b18-8a70-42aa165ceb79 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:02.627009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-05cb12f3-40d3-4b18-8a70-42aa165ceb79 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.131272 Sep 14 19:44:02.627993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 178/381] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:02 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:02.674852 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fe41d693-3955-417e-904b-a2fce68d7456 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/action" status: 200 len: 32 microversion: 2.1 time: 0.804729 Sep 14 19:44:02.676527 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 204/382] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:01 2021] POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/action => generated 32 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:02.686267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-faf32157-1aa8-4ff5-98b6-1e5dba565ee9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:02.687258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-faf32157-1aa8-4ff5-98b6-1e5dba565ee9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:02.700476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faf32157-1aa8-4ff5-98b6-1e5dba565ee9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:02.701187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faf32157-1aa8-4ff5-98b6-1e5dba565ee9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:02.702698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faf32157-1aa8-4ff5-98b6-1e5dba565ee9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:02.705563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faf32157-1aa8-4ff5-98b6-1e5dba565ee9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:03.047128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-faf32157-1aa8-4ff5-98b6-1e5dba565ee9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:03.065363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-faf32157-1aa8-4ff5-98b6-1e5dba565ee9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.380016 Sep 14 19:44:03.065363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 179/383] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:02 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:03.191680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0058df6c-3554-4336-9699-5b1924411702 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:03.192390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0058df6c-3554-4336-9699-5b1924411702 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:03.204673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0058df6c-3554-4336-9699-5b1924411702 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:03.205692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0058df6c-3554-4336-9699-5b1924411702 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:03.209566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0058df6c-3554-4336-9699-5b1924411702 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:03.211624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0058df6c-3554-4336-9699-5b1924411702 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:03.496689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0e3a01c7-2682-4b68-8ee4-860509e0685b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:03.497304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0e3a01c7-2682-4b68-8ee4-860509e0685b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:03.507145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0e3a01c7-2682-4b68-8ee4-860509e0685b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:03.507591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0e3a01c7-2682-4b68-8ee4-860509e0685b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:03.508379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0e3a01c7-2682-4b68-8ee4-860509e0685b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:03.508813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0e3a01c7-2682-4b68-8ee4-860509e0685b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:03.641570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0e3a01c7-2682-4b68-8ee4-860509e0685b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:03.651957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0e3a01c7-2682-4b68-8ee4-860509e0685b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1277 microversion: 2.1 time: 0.158806 Sep 14 19:44:03.665760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 180/384] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:03 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:03.680197 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8c11e81e-1810-4476-aedb-d5103f453e1c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:03.686316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8c11e81e-1810-4476-aedb-d5103f453e1c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:03.713057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c11e81e-1810-4476-aedb-d5103f453e1c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:03.719347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c11e81e-1810-4476-aedb-d5103f453e1c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:03.720373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c11e81e-1810-4476-aedb-d5103f453e1c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:03.720981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c11e81e-1810-4476-aedb-d5103f453e1c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:03.821591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8c11e81e-1810-4476-aedb-d5103f453e1c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.152949 Sep 14 19:44:03.822240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 181/385] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:03 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:03.865478 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0058df6c-3554-4336-9699-5b1924411702 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:03.876038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0058df6c-3554-4336-9699-5b1924411702 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:03.878488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0058df6c-3554-4336-9699-5b1924411702 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:03.880449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0058df6c-3554-4336-9699-5b1924411702 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.693476 Sep 14 19:44:03.881398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 205/386] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:04.081164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3edb4bc4-fe19-46fb-ad29-302765734330 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:04.081890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3edb4bc4-fe19-46fb-ad29-302765734330 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:04.102126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3edb4bc4-fe19-46fb-ad29-302765734330 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:04.112806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3edb4bc4-fe19-46fb-ad29-302765734330 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:04.114072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3edb4bc4-fe19-46fb-ad29-302765734330 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:04.114525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3edb4bc4-fe19-46fb-ad29-302765734330 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:04.558524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3edb4bc4-fe19-46fb-ad29-302765734330 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:04.566963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3edb4bc4-fe19-46fb-ad29-302765734330 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.490752 Sep 14 19:44:04.570364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 182/387] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:04 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:04.668215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-185d7428-3e2b-4641-989a-eabd9a1b3b5c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:04.669442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-185d7428-3e2b-4641-989a-eabd9a1b3b5c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:04.677487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-185d7428-3e2b-4641-989a-eabd9a1b3b5c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:04.691254 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-185d7428-3e2b-4641-989a-eabd9a1b3b5c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:04.692233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-185d7428-3e2b-4641-989a-eabd9a1b3b5c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:04.693035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-185d7428-3e2b-4641-989a-eabd9a1b3b5c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:04.855424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bbe71929-0061-44d2-aa18-fe9d1d945762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:04.863247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bbe71929-0061-44d2-aa18-fe9d1d945762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:04.883212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bbe71929-0061-44d2-aa18-fe9d1d945762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:04.886017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bbe71929-0061-44d2-aa18-fe9d1d945762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:04.891214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bbe71929-0061-44d2-aa18-fe9d1d945762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:04.892537 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bbe71929-0061-44d2-aa18-fe9d1d945762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:05.028397 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bbe71929-0061-44d2-aa18-fe9d1d945762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.181153 Sep 14 19:44:05.032878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 183/388] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:04 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:05.039458 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6ba7943f-bf4f-459a-965f-165c013be54f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:05.042831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6ba7943f-bf4f-459a-965f-165c013be54f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:05.058381 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba7943f-bf4f-459a-965f-165c013be54f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:05.059072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba7943f-bf4f-459a-965f-165c013be54f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:05.060037 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba7943f-bf4f-459a-965f-165c013be54f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:05.060670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba7943f-bf4f-459a-965f-165c013be54f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:05.284316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-185d7428-3e2b-4641-989a-eabd9a1b3b5c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:05.294116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-185d7428-3e2b-4641-989a-eabd9a1b3b5c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1319 microversion: 2.1 time: 0.627695 Sep 14 19:44:05.296272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 206/389] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:04 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1319 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:05.476771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6ba7943f-bf4f-459a-965f-165c013be54f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:05.490411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6ba7943f-bf4f-459a-965f-165c013be54f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:05.491947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6ba7943f-bf4f-459a-965f-165c013be54f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:05.493782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6ba7943f-bf4f-459a-965f-165c013be54f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.459211 Sep 14 19:44:05.494353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 184/390] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:05 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:05.585078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a7d3d8c1-de19-4ca1-8d05-9c393551c0ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:05.585719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a7d3d8c1-de19-4ca1-8d05-9c393551c0ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:05.603990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7d3d8c1-de19-4ca1-8d05-9c393551c0ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:05.604871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7d3d8c1-de19-4ca1-8d05-9c393551c0ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:05.607652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7d3d8c1-de19-4ca1-8d05-9c393551c0ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:05.607652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7d3d8c1-de19-4ca1-8d05-9c393551c0ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:05.910110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a7d3d8c1-de19-4ca1-8d05-9c393551c0ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:05.919299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a7d3d8c1-de19-4ca1-8d05-9c393551c0ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.338582 Sep 14 19:44:05.923549 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 207/391] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:05 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:06.039948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b67bbb2a-9250-4a6f-bad2-98a1b2e6d286 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:06.040869 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b67bbb2a-9250-4a6f-bad2-98a1b2e6d286 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:06.058694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b67bbb2a-9250-4a6f-bad2-98a1b2e6d286 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:06.059284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b67bbb2a-9250-4a6f-bad2-98a1b2e6d286 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:06.060399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b67bbb2a-9250-4a6f-bad2-98a1b2e6d286 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:06.060975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b67bbb2a-9250-4a6f-bad2-98a1b2e6d286 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:06.181022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b67bbb2a-9250-4a6f-bad2-98a1b2e6d286 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.144179 Sep 14 19:44:06.184635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 185/392] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:06 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:06.313917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-127913f5-857c-45e3-bfdd-5ceedcaa11ac tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:06.314661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-127913f5-857c-45e3-bfdd-5ceedcaa11ac tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:06.327309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-127913f5-857c-45e3-bfdd-5ceedcaa11ac tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:06.329235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-127913f5-857c-45e3-bfdd-5ceedcaa11ac tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:06.336084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-127913f5-857c-45e3-bfdd-5ceedcaa11ac tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:06.342853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-127913f5-857c-45e3-bfdd-5ceedcaa11ac tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:06.376166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-2827dce2-74a7-4b58-8810-5665887e82c1 req-7be8f444-849b-4c0c-8c40-f935bfa4796a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3106dd73-2741-49d1-9906-80ecde50dd8e", "tag": "36ff7926-98a9-4ebc-92cf-fe7571488e5c"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:06.378172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:44:06.378172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:44:06.408780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-2827dce2-74a7-4b58-8810-5665887e82c1 req-7be8f444-849b-4c0c-8c40-f935bfa4796a service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:06.409238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-2827dce2-74a7-4b58-8810-5665887e82c1 req-7be8f444-849b-4c0c-8c40-f935bfa4796a service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:06.477414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-2827dce2-74a7-4b58-8810-5665887e82c1 req-7be8f444-849b-4c0c-8c40-f935bfa4796a service nova] Creating event network-changed:36ff7926-98a9-4ebc-92cf-fe7571488e5c for instance 3106dd73-2741-49d1-9906-80ecde50dd8e on hv-cinder-80588 Sep 14 19:44:06.491593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-2827dce2-74a7-4b58-8810-5665887e82c1 req-7be8f444-849b-4c0c-8c40-f935bfa4796a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123686 Sep 14 19:44:06.500406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 186/393] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:44:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:44:06.519982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-921ced0d-7ce8-4c87-922b-a48a815d8f9f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:06.520687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-921ced0d-7ce8-4c87-922b-a48a815d8f9f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:06.534451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-921ced0d-7ce8-4c87-922b-a48a815d8f9f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:06.534900 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-921ced0d-7ce8-4c87-922b-a48a815d8f9f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:06.538906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-921ced0d-7ce8-4c87-922b-a48a815d8f9f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:06.539447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-921ced0d-7ce8-4c87-922b-a48a815d8f9f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:06.859226 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-921ced0d-7ce8-4c87-922b-a48a815d8f9f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:06.868095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-921ced0d-7ce8-4c87-922b-a48a815d8f9f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:06.872925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-921ced0d-7ce8-4c87-922b-a48a815d8f9f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:06.876413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-921ced0d-7ce8-4c87-922b-a48a815d8f9f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.366213 Sep 14 19:44:06.881082 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 187/394] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:06 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:06.943557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e727f49e-45a1-40a9-be6f-d962bd1557a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:06.944462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e727f49e-45a1-40a9-be6f-d962bd1557a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:06.959466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e727f49e-45a1-40a9-be6f-d962bd1557a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:06.961693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e727f49e-45a1-40a9-be6f-d962bd1557a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:06.962700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e727f49e-45a1-40a9-be6f-d962bd1557a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:06.964019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e727f49e-45a1-40a9-be6f-d962bd1557a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:07.265026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-127913f5-857c-45e3-bfdd-5ceedcaa11ac tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:07.273835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-127913f5-857c-45e3-bfdd-5ceedcaa11ac tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1319 microversion: 2.1 time: 0.964290 Sep 14 19:44:07.277187 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 208/395] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:06 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1319 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:07.284646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0573ba7e-4dd4-4381-b888-2d5127583762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:07.288335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0573ba7e-4dd4-4381-b888-2d5127583762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:07.300784 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0573ba7e-4dd4-4381-b888-2d5127583762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:07.301645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0573ba7e-4dd4-4381-b888-2d5127583762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:07.302645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0573ba7e-4dd4-4381-b888-2d5127583762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:07.303319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0573ba7e-4dd4-4381-b888-2d5127583762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:07.408212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0573ba7e-4dd4-4381-b888-2d5127583762 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.129224 Sep 14 19:44:07.408853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 209/396] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:07 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:07.571779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e727f49e-45a1-40a9-be6f-d962bd1557a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:07.587581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e727f49e-45a1-40a9-be6f-d962bd1557a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.650867 Sep 14 19:44:07.611350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 188/397] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:06 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:07.899983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4e499305-eb3c-4b2e-a166-2e5f2c5a4fc6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:07.911644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4e499305-eb3c-4b2e-a166-2e5f2c5a4fc6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:07.911644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4e499305-eb3c-4b2e-a166-2e5f2c5a4fc6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:07.911644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4e499305-eb3c-4b2e-a166-2e5f2c5a4fc6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:07.912295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4e499305-eb3c-4b2e-a166-2e5f2c5a4fc6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:07.912915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4e499305-eb3c-4b2e-a166-2e5f2c5a4fc6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:08.200064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4e499305-eb3c-4b2e-a166-2e5f2c5a4fc6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:08.214147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4e499305-eb3c-4b2e-a166-2e5f2c5a4fc6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:08.218694 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4e499305-eb3c-4b2e-a166-2e5f2c5a4fc6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:08.223108 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4e499305-eb3c-4b2e-a166-2e5f2c5a4fc6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.325751 Sep 14 19:44:08.238148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 210/398] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:07 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:08.301268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-49cf7d0c-3a7b-4676-9dca-9225fe8f01b5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:08.301942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-49cf7d0c-3a7b-4676-9dca-9225fe8f01b5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:08.316313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49cf7d0c-3a7b-4676-9dca-9225fe8f01b5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:08.317019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49cf7d0c-3a7b-4676-9dca-9225fe8f01b5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:08.317994 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49cf7d0c-3a7b-4676-9dca-9225fe8f01b5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:08.318989 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49cf7d0c-3a7b-4676-9dca-9225fe8f01b5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:08.432826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6cb542e3-a21b-4a6e-8455-9b3a92bee58c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:08.433948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6cb542e3-a21b-4a6e-8455-9b3a92bee58c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:08.446031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cb542e3-a21b-4a6e-8455-9b3a92bee58c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:08.446748 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cb542e3-a21b-4a6e-8455-9b3a92bee58c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:08.448941 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cb542e3-a21b-4a6e-8455-9b3a92bee58c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:08.451316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cb542e3-a21b-4a6e-8455-9b3a92bee58c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:08.608682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6cb542e3-a21b-4a6e-8455-9b3a92bee58c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.180238 Sep 14 19:44:08.612338 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 211/399] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:08 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:08.626811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0f345660-f109-4a76-ba42-b8d667bfb93e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:08.627955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0f345660-f109-4a76-ba42-b8d667bfb93e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:08.636195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f345660-f109-4a76-ba42-b8d667bfb93e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:08.637697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f345660-f109-4a76-ba42-b8d667bfb93e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:08.638715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f345660-f109-4a76-ba42-b8d667bfb93e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:08.639306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f345660-f109-4a76-ba42-b8d667bfb93e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:08.875831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-49cf7d0c-3a7b-4676-9dca-9225fe8f01b5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:08.875831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-49cf7d0c-3a7b-4676-9dca-9225fe8f01b5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1319 microversion: 2.1 time: 0.422567 Sep 14 19:44:08.875831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 189/400] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:08 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:08.934212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0f345660-f109-4a76-ba42-b8d667bfb93e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:08.942697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0f345660-f109-4a76-ba42-b8d667bfb93e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.327807 Sep 14 19:44:08.943369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 212/401] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:08 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:09.244520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a364c85d-ca26-42de-ae7e-f1bfba3934a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:09.245076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a364c85d-ca26-42de-ae7e-f1bfba3934a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:09.252084 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a364c85d-ca26-42de-ae7e-f1bfba3934a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:09.252812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a364c85d-ca26-42de-ae7e-f1bfba3934a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:09.253892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a364c85d-ca26-42de-ae7e-f1bfba3934a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:09.254329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a364c85d-ca26-42de-ae7e-f1bfba3934a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:09.386083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a364c85d-ca26-42de-ae7e-f1bfba3934a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:09.398261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a364c85d-ca26-42de-ae7e-f1bfba3934a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:09.399000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a364c85d-ca26-42de-ae7e-f1bfba3934a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:09.400210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a364c85d-ca26-42de-ae7e-f1bfba3934a7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.159805 Sep 14 19:44:09.400777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 190/402] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:09.622104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-64f6cd91-1b06-481a-bf72-703191d10fcb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:09.623034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-64f6cd91-1b06-481a-bf72-703191d10fcb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:09.632925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64f6cd91-1b06-481a-bf72-703191d10fcb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:09.633830 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64f6cd91-1b06-481a-bf72-703191d10fcb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:09.634985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64f6cd91-1b06-481a-bf72-703191d10fcb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:09.635692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64f6cd91-1b06-481a-bf72-703191d10fcb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:09.755686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-64f6cd91-1b06-481a-bf72-703191d10fcb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.136755 Sep 14 19:44:09.756490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 213/403] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:09 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:09.893192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a04de978-42d2-4328-9ff7-9da6f7863a51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:09.895717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a04de978-42d2-4328-9ff7-9da6f7863a51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:09.919577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a04de978-42d2-4328-9ff7-9da6f7863a51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:09.920369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a04de978-42d2-4328-9ff7-9da6f7863a51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:09.925549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a04de978-42d2-4328-9ff7-9da6f7863a51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:09.926260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a04de978-42d2-4328-9ff7-9da6f7863a51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:09.961717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7824a4af-5236-4f81-b5cc-687168797ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:09.962528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7824a4af-5236-4f81-b5cc-687168797ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:09.976350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7824a4af-5236-4f81-b5cc-687168797ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:09.976828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7824a4af-5236-4f81-b5cc-687168797ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:09.977656 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7824a4af-5236-4f81-b5cc-687168797ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:09.978128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7824a4af-5236-4f81-b5cc-687168797ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:10.174634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7824a4af-5236-4f81-b5cc-687168797ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:10.183984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7824a4af-5236-4f81-b5cc-687168797ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.226392 Sep 14 19:44:10.186151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 214/404] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:09 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:10.315270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a04de978-42d2-4328-9ff7-9da6f7863a51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:10.326751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a04de978-42d2-4328-9ff7-9da6f7863a51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1319 microversion: 2.1 time: 0.437687 Sep 14 19:44:10.339213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 191/405] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:09 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:10.420650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1bd5df32-0214-489c-8201-40035c987eb5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:10.421954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1bd5df32-0214-489c-8201-40035c987eb5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:10.431922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bd5df32-0214-489c-8201-40035c987eb5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:10.434111 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bd5df32-0214-489c-8201-40035c987eb5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:10.437623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bd5df32-0214-489c-8201-40035c987eb5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:10.438307 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bd5df32-0214-489c-8201-40035c987eb5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:10.726630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1bd5df32-0214-489c-8201-40035c987eb5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:10.740089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1bd5df32-0214-489c-8201-40035c987eb5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:10.746957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1bd5df32-0214-489c-8201-40035c987eb5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:10.748448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1bd5df32-0214-489c-8201-40035c987eb5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.333405 Sep 14 19:44:10.749526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 215/406] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:10.768150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2b20e45d-bbfd-417b-b1dd-be66b78f3c56 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:10.769154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2b20e45d-bbfd-417b-b1dd-be66b78f3c56 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:10.783776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b20e45d-bbfd-417b-b1dd-be66b78f3c56 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:10.785901 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b20e45d-bbfd-417b-b1dd-be66b78f3c56 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:10.789885 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b20e45d-bbfd-417b-b1dd-be66b78f3c56 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:10.790693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b20e45d-bbfd-417b-b1dd-be66b78f3c56 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:10.803203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c6ed914c-0d78-47ce-a207-ad6b7df4ebfd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acac5afb-34f0-429c-849e-bcb32adb62e8"}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:10.804590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c6ed914c-0d78-47ce-a207-ad6b7df4ebfd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:10.828989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6ed914c-0d78-47ce-a207-ad6b7df4ebfd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:10.829449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6ed914c-0d78-47ce-a207-ad6b7df4ebfd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:10.830284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6ed914c-0d78-47ce-a207-ad6b7df4ebfd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:10.830891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6ed914c-0d78-47ce-a207-ad6b7df4ebfd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:10.929558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2b20e45d-bbfd-417b-b1dd-be66b78f3c56 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.165772 Sep 14 19:44:10.930057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 192/407] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:10 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:10.936654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1075823717", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1826042944", "security_groups": [{"name": "tempest-secgroup-smoke-818892582"}], "networks": [{"uuid": "79fbc96c-0e96-496d-be7a-a5adbe5fed9e"}], "block_device_mapping_v2": [{"uuid": "7a787c0c-d2ad-4a8c-9f87-8fffe1f7029f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:11.090167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-c6ed914c-0d78-47ce-a207-ad6b7df4ebfd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] HTTP exception thrown: Invalid volume: volume acac5afb-34f0-429c-849e-bcb32adb62e8 is already attached to instances: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 Sep 14 19:44:11.091035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c6ed914c-0d78-47ce-a207-ad6b7df4ebfd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Returning 400 to user: Invalid volume: volume acac5afb-34f0-429c-849e-bcb32adb62e8 is already attached to instances: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:44:11.092024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c6ed914c-0d78-47ce-a207-ad6b7df4ebfd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "POST /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.292706 Sep 14 19:44:11.095918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 216/408] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Sep 14 19:44:10 2021] POST /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03/os-volume_attachments => generated 174 bytes in 296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 19:44:11.201666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9b226600-4ae7-4577-9eb8-12749168f47a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:11.202387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9b226600-4ae7-4577-9eb8-12749168f47a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:11.218346 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b226600-4ae7-4577-9eb8-12749168f47a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:11.219622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b226600-4ae7-4577-9eb8-12749168f47a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:11.222290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b226600-4ae7-4577-9eb8-12749168f47a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:11.226043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b226600-4ae7-4577-9eb8-12749168f47a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:11.310409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] validate_networks() for [('79fbc96c-0e96-496d-be7a-a5adbe5fed9e', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:44:11.481413 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9b226600-4ae7-4577-9eb8-12749168f47a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:11.493632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9b226600-4ae7-4577-9eb8-12749168f47a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.296055 Sep 14 19:44:11.494328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 217/409] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:11.499982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-600c54ff-3a54-441c-a826-dcc250673b70 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:11.506109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-600c54ff-3a54-441c-a826-dcc250673b70 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:11.526421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-600c54ff-3a54-441c-a826-dcc250673b70 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:11.527467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-600c54ff-3a54-441c-a826-dcc250673b70 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:11.528716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-600c54ff-3a54-441c-a826-dcc250673b70 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:11.529543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-600c54ff-3a54-441c-a826-dcc250673b70 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:11.788648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-600c54ff-3a54-441c-a826-dcc250673b70 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lazy-loading 'services' on Instance uuid 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:44:12.168156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-600c54ff-3a54-441c-a826-dcc250673b70 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "DELETE /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03/os-volume_attachments/acac5afb-34f0-429c-849e-bcb32adb62e8" status: 202 len: 0 microversion: 2.1 time: 0.672442 Sep 14 19:44:12.186367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 218/410] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Sep 14 19:44:11 2021] DELETE /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03/os-volume_attachments/acac5afb-34f0-429c-849e-bcb32adb62e8 => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:44:12.212763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-72fe8990-8902-46a8-913a-710244e0851b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:12.220083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-72fe8990-8902-46a8-913a-710244e0851b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:12.256159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72fe8990-8902-46a8-913a-710244e0851b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:12.256646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72fe8990-8902-46a8-913a-710244e0851b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:12.257457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72fe8990-8902-46a8-913a-710244e0851b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:12.274797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:44:12.274797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:44:12.274797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:44:12.274797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:44:12.274797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:44:12.275671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72fe8990-8902-46a8-913a-710244e0851b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:12.310284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:12.310740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:12.311600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:12.312071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:12.365322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Getting quotas for project 4ba21a8e4a9e49ea953ed4a871211a18. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:44:12.374975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Getting quotas for user 0f22db89d8174d76b7c5e6f4f99a11bf and project 4ba21a8e4a9e49ea953ed4a871211a18. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:44:12.458662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-72fe8990-8902-46a8-913a-710244e0851b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:12.467197 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-72fe8990-8902-46a8-913a-710244e0851b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1319 microversion: 2.1 time: 0.275824 Sep 14 19:44:12.477940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 219/411] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:12 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:12.477940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d83a1991-b941-47b2-abf3-c1bbbcc84a41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:12.477940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d83a1991-b941-47b2-abf3-c1bbbcc84a41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:12.483047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d83a1991-b941-47b2-abf3-c1bbbcc84a41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:12.485123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:44:12.494463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a787c0c-d2ad-4a8c-9f87-8fffe1f7029f',volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:44:12.496456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d83a1991-b941-47b2-abf3-c1bbbcc84a41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:12.497435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d83a1991-b941-47b2-abf3-c1bbbcc84a41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:12.500897 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d83a1991-b941-47b2-abf3-c1bbbcc84a41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:12.784658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d83a1991-b941-47b2-abf3-c1bbbcc84a41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:12.804394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d83a1991-b941-47b2-abf3-c1bbbcc84a41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:12.806337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d83a1991-b941-47b2-abf3-c1bbbcc84a41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:12.807792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d83a1991-b941-47b2-abf3-c1bbbcc84a41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.337983 Sep 14 19:44:12.808701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 220/412] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:12 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:12.814266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c990a22e-fd1b-4fda-b49d-200841fc7d51 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:12.815859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c990a22e-fd1b-4fda-b49d-200841fc7d51 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:12.823428 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c990a22e-fd1b-4fda-b49d-200841fc7d51 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:12.823951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c990a22e-fd1b-4fda-b49d-200841fc7d51 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:12.824888 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c990a22e-fd1b-4fda-b49d-200841fc7d51 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:12.825675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c990a22e-fd1b-4fda-b49d-200841fc7d51 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:12.935523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c990a22e-fd1b-4fda-b49d-200841fc7d51 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.121475 Sep 14 19:44:12.936901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 221/413] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:12 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:12.948218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d977fc3e-6f0c-4151-a09d-17c95e097073 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:12.950586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d977fc3e-6f0c-4151-a09d-17c95e097073 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:12.959909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d977fc3e-6f0c-4151-a09d-17c95e097073 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:12.963963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d977fc3e-6f0c-4151-a09d-17c95e097073 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:12.965047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d977fc3e-6f0c-4151-a09d-17c95e097073 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:12.965714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d977fc3e-6f0c-4151-a09d-17c95e097073 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:13.065975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d977fc3e-6f0c-4151-a09d-17c95e097073 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125024 Sep 14 19:44:13.076620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 222/414] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:44:12 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:44:13.089467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2691d5c1-f015-488e-bb00-b33e971b3b4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:13.090937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2691d5c1-f015-488e-bb00-b33e971b3b4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:13.108141 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2691d5c1-f015-488e-bb00-b33e971b3b4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:13.111435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2691d5c1-f015-488e-bb00-b33e971b3b4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:13.118293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2691d5c1-f015-488e-bb00-b33e971b3b4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:13.119658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2691d5c1-f015-488e-bb00-b33e971b3b4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:13.336757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2691d5c1-f015-488e-bb00-b33e971b3b4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:13.355295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2691d5c1-f015-488e-bb00-b33e971b3b4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.276520 Sep 14 19:44:13.368363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 223/415] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:13 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:13.487743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a46a02ca-ad09-4cfe-bea8-041cac48d449 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:13.488612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a46a02ca-ad09-4cfe-bea8-041cac48d449 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:13.502232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a46a02ca-ad09-4cfe-bea8-041cac48d449 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:13.502700 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a46a02ca-ad09-4cfe-bea8-041cac48d449 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:13.503510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a46a02ca-ad09-4cfe-bea8-041cac48d449 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:13.503980 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a46a02ca-ad09-4cfe-bea8-041cac48d449 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:13.537053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-27990f18-6e52-4b34-9917-67a69dad8a35 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.605438 Sep 14 19:44:13.539088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 193/416] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:44:10 2021] POST /compute/v2.1/servers => generated 405 bytes in 2608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:44:13.550882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-67719a55-501c-40af-a685-91f856f6e1a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:13.554264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-67719a55-501c-40af-a685-91f856f6e1a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:13.663551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a46a02ca-ad09-4cfe-bea8-041cac48d449 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:13.666066 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-67719a55-501c-40af-a685-91f856f6e1a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:13.676730 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-67719a55-501c-40af-a685-91f856f6e1a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1089 microversion: 2.1 time: 0.130961 Sep 14 19:44:13.678511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 194/417] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:13 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1089 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:13.683726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a46a02ca-ad09-4cfe-bea8-041cac48d449 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1319 microversion: 2.1 time: 0.200929 Sep 14 19:44:13.685395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 224/418] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:13 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:13.828779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-03cbb099-ecf9-42e9-aa01-f60ad0a71c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:13.829572 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-03cbb099-ecf9-42e9-aa01-f60ad0a71c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:13.857413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03cbb099-ecf9-42e9-aa01-f60ad0a71c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:13.858173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03cbb099-ecf9-42e9-aa01-f60ad0a71c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:13.859191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03cbb099-ecf9-42e9-aa01-f60ad0a71c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:13.859727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03cbb099-ecf9-42e9-aa01-f60ad0a71c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:13.948239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2a9ff78f-fb69-44d9-8721-df7cf6a91d02 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:13.950049 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2a9ff78f-fb69-44d9-8721-df7cf6a91d02 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:13.959338 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a9ff78f-fb69-44d9-8721-df7cf6a91d02 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:13.960102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a9ff78f-fb69-44d9-8721-df7cf6a91d02 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:13.961763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a9ff78f-fb69-44d9-8721-df7cf6a91d02 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:13.962391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a9ff78f-fb69-44d9-8721-df7cf6a91d02 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:14.034668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-03cbb099-ecf9-42e9-aa01-f60ad0a71c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:14.037017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2a9ff78f-fb69-44d9-8721-df7cf6a91d02 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 14 microversion: 2.1 time: 0.092570 Sep 14 19:44:14.038364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 225/419] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:13 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:14.054931 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-03cbb099-ecf9-42e9-aa01-f60ad0a71c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:14.057101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-03cbb099-ecf9-42e9-aa01-f60ad0a71c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:14.058349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-03cbb099-ecf9-42e9-aa01-f60ad0a71c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.233411 Sep 14 19:44:14.069864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 195/420] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:14.084138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bba013f1-2768-4a74-925f-bde60c60d2dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:14.085367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bba013f1-2768-4a74-925f-bde60c60d2dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:14.092620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bba013f1-2768-4a74-925f-bde60c60d2dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:14.094627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bba013f1-2768-4a74-925f-bde60c60d2dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:14.094627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bba013f1-2768-4a74-925f-bde60c60d2dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:14.094627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bba013f1-2768-4a74-925f-bde60c60d2dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:14.144630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bba013f1-2768-4a74-925f-bde60c60d2dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064484 Sep 14 19:44:14.149688 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 226/421] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:44:14 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:44:14.366947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-878608882", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "networks": [{"uuid": "dadf8579-8fa0-403c-8ccf-ca6def90a163"}]}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:14.375082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-91ca043e-280e-491e-bb63-d623810d739d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:14.376131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-91ca043e-280e-491e-bb63-d623810d739d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:14.382539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91ca043e-280e-491e-bb63-d623810d739d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:14.383244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91ca043e-280e-491e-bb63-d623810d739d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:14.384205 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91ca043e-280e-491e-bb63-d623810d739d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:14.384833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91ca043e-280e-491e-bb63-d623810d739d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:14.612088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-91ca043e-280e-491e-bb63-d623810d739d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:14.620557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-91ca043e-280e-491e-bb63-d623810d739d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.249609 Sep 14 19:44:14.631678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 227/422] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:14 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:14.704822 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-402b4d4d-31c9-4a71-b674-727534c48476 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:14.705842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-402b4d4d-31c9-4a71-b674-727534c48476 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:14.733015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-402b4d4d-31c9-4a71-b674-727534c48476 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:14.733015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-402b4d4d-31c9-4a71-b674-727534c48476 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:14.733015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-402b4d4d-31c9-4a71-b674-727534c48476 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:14.733015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-402b4d4d-31c9-4a71-b674-727534c48476 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:14.905299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-402b4d4d-31c9-4a71-b674-727534c48476 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:14.913366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-402b4d4d-31c9-4a71-b674-727534c48476 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1319 microversion: 2.1 time: 0.213097 Sep 14 19:44:14.914022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 228/423] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:14 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:14.927451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6db5fc42-9f9f-410b-b113-79386a8405d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:14.928122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6db5fc42-9f9f-410b-b113-79386a8405d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:14.982806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6db5fc42-9f9f-410b-b113-79386a8405d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:14.989749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6db5fc42-9f9f-410b-b113-79386a8405d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1089 microversion: 2.1 time: 0.074498 Sep 14 19:44:14.990781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 229/424] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:14 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:15.048604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0a9e4a13-4aa7-49c6-ad88-8c3c6a0a3d69 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:15.049766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0a9e4a13-4aa7-49c6-ad88-8c3c6a0a3d69 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:15.056183 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a9e4a13-4aa7-49c6-ad88-8c3c6a0a3d69 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:15.056714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a9e4a13-4aa7-49c6-ad88-8c3c6a0a3d69 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:15.057654 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a9e4a13-4aa7-49c6-ad88-8c3c6a0a3d69 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:15.058151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a9e4a13-4aa7-49c6-ad88-8c3c6a0a3d69 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:15.142828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0a9e4a13-4aa7-49c6-ad88-8c3c6a0a3d69 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 7815 microversion: 2.1 time: 0.098146 Sep 14 19:44:15.143524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 230/425] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:15 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 7815 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:15.148405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-562537cf-274f-43ee-a5c4-29ca4ed62cd0 req-253b46ac-c8c4-4da5-a931-f721f12d8479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3106dd73-2741-49d1-9906-80ecde50dd8e", "name": "network-vif-plugged", "status": "completed", "tag": "36ff7926-98a9-4ebc-92cf-fe7571488e5c"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:15.149916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:44:15.149916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:44:15.157428 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-562537cf-274f-43ee-a5c4-29ca4ed62cd0 req-253b46ac-c8c4-4da5-a931-f721f12d8479 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:15.157836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-562537cf-274f-43ee-a5c4-29ca4ed62cd0 req-253b46ac-c8c4-4da5-a931-f721f12d8479 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:15.168212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-562537cf-274f-43ee-a5c4-29ca4ed62cd0 req-253b46ac-c8c4-4da5-a931-f721f12d8479 service nova] Creating event network-vif-plugged:36ff7926-98a9-4ebc-92cf-fe7571488e5c for instance 3106dd73-2741-49d1-9906-80ecde50dd8e on hv-cinder-80588 Sep 14 19:44:15.185890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-562537cf-274f-43ee-a5c4-29ca4ed62cd0 req-253b46ac-c8c4-4da5-a931-f721f12d8479 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041011 Sep 14 19:44:15.186482 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 231/426] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:44:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:44:15.191945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a0733d2d-df86-46cf-8950-771fe99c7ecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:15.192643 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a0733d2d-df86-46cf-8950-771fe99c7ecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:15.198987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a0733d2d-df86-46cf-8950-771fe99c7ecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:15.199553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a0733d2d-df86-46cf-8950-771fe99c7ecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:15.200228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a0733d2d-df86-46cf-8950-771fe99c7ecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:15.206240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a0733d2d-df86-46cf-8950-771fe99c7ecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:15.338040 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a0733d2d-df86-46cf-8950-771fe99c7ecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:15.345790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a0733d2d-df86-46cf-8950-771fe99c7ecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:15.347342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a0733d2d-df86-46cf-8950-771fe99c7ecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:15.348485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a0733d2d-df86-46cf-8950-771fe99c7ecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.160430 Sep 14 19:44:15.349040 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 232/427] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:15 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:15.641128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-26f1daad-eb4e-4417-8aa4-264b1ec401e8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:15.642420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-26f1daad-eb4e-4417-8aa4-264b1ec401e8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:15.652335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26f1daad-eb4e-4417-8aa4-264b1ec401e8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:15.652913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26f1daad-eb4e-4417-8aa4-264b1ec401e8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:15.653786 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26f1daad-eb4e-4417-8aa4-264b1ec401e8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:15.654282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26f1daad-eb4e-4417-8aa4-264b1ec401e8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:15.903058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-26f1daad-eb4e-4417-8aa4-264b1ec401e8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:15.912827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-26f1daad-eb4e-4417-8aa4-264b1ec401e8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.278315 Sep 14 19:44:15.926343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 233/428] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:15 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:15.933079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-32fde6ac-9a9d-499b-998d-01626c1792d8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:15.933756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-32fde6ac-9a9d-499b-998d-01626c1792d8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:15.941216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-32fde6ac-9a9d-499b-998d-01626c1792d8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:15.941883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-32fde6ac-9a9d-499b-998d-01626c1792d8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:15.942862 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-32fde6ac-9a9d-499b-998d-01626c1792d8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:15.943204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-32fde6ac-9a9d-499b-998d-01626c1792d8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:16.212850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-32fde6ac-9a9d-499b-998d-01626c1792d8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:16.227930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-32fde6ac-9a9d-499b-998d-01626c1792d8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1319 microversion: 2.1 time: 0.299884 Sep 14 19:44:16.228524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 234/429] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:15 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:16.238179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-716dd2cf-e354-4b15-879a-3868db291279 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:16.239284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-716dd2cf-e354-4b15-879a-3868db291279 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:16.248414 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-716dd2cf-e354-4b15-879a-3868db291279 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:16.249133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-716dd2cf-e354-4b15-879a-3868db291279 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:16.250207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-716dd2cf-e354-4b15-879a-3868db291279 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:16.250849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-716dd2cf-e354-4b15-879a-3868db291279 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:16.353156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-716dd2cf-e354-4b15-879a-3868db291279 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:16.366420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-716dd2cf-e354-4b15-879a-3868db291279 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1131 microversion: 2.1 time: 0.136381 Sep 14 19:44:16.367241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 235/430] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:16 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1131 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:16.377994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1df5d57c-324c-448c-b924-a70aca49a615 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:16.379312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1df5d57c-324c-448c-b924-a70aca49a615 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:16.385819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1df5d57c-324c-448c-b924-a70aca49a615 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:16.386528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1df5d57c-324c-448c-b924-a70aca49a615 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:16.387420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1df5d57c-324c-448c-b924-a70aca49a615 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:16.387994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1df5d57c-324c-448c-b924-a70aca49a615 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:16.482384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1df5d57c-324c-448c-b924-a70aca49a615 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 15025 microversion: 2.1 time: 0.113458 Sep 14 19:44:16.486218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 236/431] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:16 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 15025 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:16.492266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f3b01c8f-86a5-4459-8f17-be59d2d2cbd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:16.509463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f3b01c8f-86a5-4459-8f17-be59d2d2cbd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:16.509463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3b01c8f-86a5-4459-8f17-be59d2d2cbd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:16.509463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3b01c8f-86a5-4459-8f17-be59d2d2cbd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:16.509463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3b01c8f-86a5-4459-8f17-be59d2d2cbd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:16.510388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3b01c8f-86a5-4459-8f17-be59d2d2cbd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:16.666443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f3b01c8f-86a5-4459-8f17-be59d2d2cbd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:16.675265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f3b01c8f-86a5-4459-8f17-be59d2d2cbd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:16.676754 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f3b01c8f-86a5-4459-8f17-be59d2d2cbd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:16.677949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f3b01c8f-86a5-4459-8f17-be59d2d2cbd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.190328 Sep 14 19:44:16.678503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 237/432] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:16 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:16.932071 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c5ef7695-2f83-4667-b61d-4781b5823ec9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:16.932753 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c5ef7695-2f83-4667-b61d-4781b5823ec9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:16.939529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5ef7695-2f83-4667-b61d-4781b5823ec9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:16.939984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5ef7695-2f83-4667-b61d-4781b5823ec9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:16.940768 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5ef7695-2f83-4667-b61d-4781b5823ec9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:16.941200 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5ef7695-2f83-4667-b61d-4781b5823ec9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:17.075230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c5ef7695-2f83-4667-b61d-4781b5823ec9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:17.083675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c5ef7695-2f83-4667-b61d-4781b5823ec9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.155263 Sep 14 19:44:17.084582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 238/433] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:16 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:17.244396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5255cd0e-28b0-4340-a301-9fcedb55b653 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:17.245012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5255cd0e-28b0-4340-a301-9fcedb55b653 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:17.251761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5255cd0e-28b0-4340-a301-9fcedb55b653 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:17.252313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5255cd0e-28b0-4340-a301-9fcedb55b653 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:17.253148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5255cd0e-28b0-4340-a301-9fcedb55b653 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:17.253731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5255cd0e-28b0-4340-a301-9fcedb55b653 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:17.394048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5255cd0e-28b0-4340-a301-9fcedb55b653 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:17.403135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5255cd0e-28b0-4340-a301-9fcedb55b653 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1319 microversion: 2.1 time: 0.161132 Sep 14 19:44:17.404764 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 239/434] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:17 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:17.411102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a185a98e-9b24-44fe-ba4a-93e51872a2c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:17.411960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a185a98e-9b24-44fe-ba4a-93e51872a2c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:17.418590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a185a98e-9b24-44fe-ba4a-93e51872a2c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:17.419036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a185a98e-9b24-44fe-ba4a-93e51872a2c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:17.419992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a185a98e-9b24-44fe-ba4a-93e51872a2c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:17.420590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a185a98e-9b24-44fe-ba4a-93e51872a2c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:17.532513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a185a98e-9b24-44fe-ba4a-93e51872a2c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:17.544588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a185a98e-9b24-44fe-ba4a-93e51872a2c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1195 microversion: 2.1 time: 0.138201 Sep 14 19:44:17.545167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 240/435] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:17 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1195 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:17.554481 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-88abb851-25f2-4a7e-9e74-fd27122eb7f3 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:17.555441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-88abb851-25f2-4a7e-9e74-fd27122eb7f3 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:17.562587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88abb851-25f2-4a7e-9e74-fd27122eb7f3 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:17.563033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88abb851-25f2-4a7e-9e74-fd27122eb7f3 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:17.563833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88abb851-25f2-4a7e-9e74-fd27122eb7f3 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:17.564498 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88abb851-25f2-4a7e-9e74-fd27122eb7f3 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:17.678644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-88abb851-25f2-4a7e-9e74-fd27122eb7f3 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 17801 microversion: 2.1 time: 0.130913 Sep 14 19:44:17.679993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 241/436] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:17 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 17801 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:17.697842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a9ccc2d1-9594-4cce-b5d0-6737090cff77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:17.698774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a9ccc2d1-9594-4cce-b5d0-6737090cff77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:17.706373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9ccc2d1-9594-4cce-b5d0-6737090cff77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:17.707223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9ccc2d1-9594-4cce-b5d0-6737090cff77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:17.708327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9ccc2d1-9594-4cce-b5d0-6737090cff77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:17.708899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9ccc2d1-9594-4cce-b5d0-6737090cff77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:17.910528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a9ccc2d1-9594-4cce-b5d0-6737090cff77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:17.919028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a9ccc2d1-9594-4cce-b5d0-6737090cff77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:17.920591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a9ccc2d1-9594-4cce-b5d0-6737090cff77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:17.923057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a9ccc2d1-9594-4cce-b5d0-6737090cff77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.229855 Sep 14 19:44:17.923617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 242/437] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:17 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:18.101348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7473dc73-0631-4f49-be4c-92edb27fec95 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:18.102365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7473dc73-0631-4f49-be4c-92edb27fec95 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:18.120281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7473dc73-0631-4f49-be4c-92edb27fec95 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:18.124987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7473dc73-0631-4f49-be4c-92edb27fec95 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:18.132448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7473dc73-0631-4f49-be4c-92edb27fec95 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:18.133104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7473dc73-0631-4f49-be4c-92edb27fec95 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:18.430068 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7473dc73-0631-4f49-be4c-92edb27fec95 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:18.439586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7473dc73-0631-4f49-be4c-92edb27fec95 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.342808 Sep 14 19:44:18.449449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 243/438] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:18 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:18.451837 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ea82fd3a-43ed-4131-83f6-8ca33a3791b3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:18.456472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ea82fd3a-43ed-4131-83f6-8ca33a3791b3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:18.465922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea82fd3a-43ed-4131-83f6-8ca33a3791b3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:18.466271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea82fd3a-43ed-4131-83f6-8ca33a3791b3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:18.469603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea82fd3a-43ed-4131-83f6-8ca33a3791b3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:18.470068 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea82fd3a-43ed-4131-83f6-8ca33a3791b3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:18.667756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ea82fd3a-43ed-4131-83f6-8ca33a3791b3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:18.683942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ea82fd3a-43ed-4131-83f6-8ca33a3791b3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1507 microversion: 2.1 time: 0.242336 Sep 14 19:44:18.684831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 244/439] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:18 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:18.692508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6ecf07e4-83a5-4482-8118-f193be02fc91 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:18.693426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6ecf07e4-83a5-4482-8118-f193be02fc91 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:18.699820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ecf07e4-83a5-4482-8118-f193be02fc91 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:18.700485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ecf07e4-83a5-4482-8118-f193be02fc91 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:18.701433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ecf07e4-83a5-4482-8118-f193be02fc91 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:18.702056 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ecf07e4-83a5-4482-8118-f193be02fc91 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:19.016366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6ecf07e4-83a5-4482-8118-f193be02fc91 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:19.025012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6ecf07e4-83a5-4482-8118-f193be02fc91 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1272 microversion: 2.1 time: 0.338555 Sep 14 19:44:19.035867 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 245/440] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:18 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1272 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:19.040779 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-285ea98b-79e0-48fc-b974-11747b3ff6b4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:19.041769 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-285ea98b-79e0-48fc-b974-11747b3ff6b4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:19.049676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-285ea98b-79e0-48fc-b974-11747b3ff6b4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:19.052168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-285ea98b-79e0-48fc-b974-11747b3ff6b4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:19.052168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-285ea98b-79e0-48fc-b974-11747b3ff6b4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:19.052168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-285ea98b-79e0-48fc-b974-11747b3ff6b4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:19.146847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-285ea98b-79e0-48fc-b974-11747b3ff6b4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 18663 microversion: 2.1 time: 0.109577 Sep 14 19:44:19.147836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 246/441] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:19 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 18663 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:19.156228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-64443ab1-1463-42d9-b758-5bf4945eb531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:19.157207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-64443ab1-1463-42d9-b758-5bf4945eb531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:19.167502 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64443ab1-1463-42d9-b758-5bf4945eb531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:19.168728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64443ab1-1463-42d9-b758-5bf4945eb531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:19.169712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64443ab1-1463-42d9-b758-5bf4945eb531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:19.170451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64443ab1-1463-42d9-b758-5bf4945eb531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:19.476693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-64443ab1-1463-42d9-b758-5bf4945eb531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:19.494917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-64443ab1-1463-42d9-b758-5bf4945eb531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:19.497248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-64443ab1-1463-42d9-b758-5bf4945eb531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:19.498763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-64443ab1-1463-42d9-b758-5bf4945eb531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.349681 Sep 14 19:44:19.499524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 247/442] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:19.505199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e3a71984-21ee-41a8-baba-02602e9c8a45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:19.506093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e3a71984-21ee-41a8-baba-02602e9c8a45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:19.513664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3a71984-21ee-41a8-baba-02602e9c8a45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:19.521189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3a71984-21ee-41a8-baba-02602e9c8a45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:19.521189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3a71984-21ee-41a8-baba-02602e9c8a45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:19.521189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3a71984-21ee-41a8-baba-02602e9c8a45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:19.690361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e3a71984-21ee-41a8-baba-02602e9c8a45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:19.701283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e3a71984-21ee-41a8-baba-02602e9c8a45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.200487 Sep 14 19:44:19.701880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 248/443] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:20.047065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-62e3c3ee-12c1-4585-8436-34f4c230a5b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:20.047876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-62e3c3ee-12c1-4585-8436-34f4c230a5b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:20.065600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-62e3c3ee-12c1-4585-8436-34f4c230a5b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:20.066188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-62e3c3ee-12c1-4585-8436-34f4c230a5b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:20.067409 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-62e3c3ee-12c1-4585-8436-34f4c230a5b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:20.067945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-62e3c3ee-12c1-4585-8436-34f4c230a5b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:20.251673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-62e3c3ee-12c1-4585-8436-34f4c230a5b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:20.273861 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-62e3c3ee-12c1-4585-8436-34f4c230a5b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.230965 Sep 14 19:44:20.278518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 249/444] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:20 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:20.285723 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-78c3986c-8990-46c8-af3a-2644557b5fe9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:20.287857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-78c3986c-8990-46c8-af3a-2644557b5fe9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:20.294752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78c3986c-8990-46c8-af3a-2644557b5fe9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:20.296759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78c3986c-8990-46c8-af3a-2644557b5fe9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:20.297996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78c3986c-8990-46c8-af3a-2644557b5fe9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:20.298634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78c3986c-8990-46c8-af3a-2644557b5fe9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:20.576932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-78c3986c-8990-46c8-af3a-2644557b5fe9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 21058 microversion: 2.1 time: 0.143560 Sep 14 19:44:20.576932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 250/445] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:20 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 21058 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:20.576932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-64d4f05f-406f-4567-8791-31c9732a0ea7 req-8143ef38-7e69-481a-8e05-bb1216cc0b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7745385c-e705-4e0e-8fc7-c96f398b93d9", "tag": "ffccccb6-d608-41f3-af2c-a06ebc5fa625"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:20.576932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:44:20.576932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:44:20.578398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-64d4f05f-406f-4567-8791-31c9732a0ea7 req-8143ef38-7e69-481a-8e05-bb1216cc0b6c service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:20.578398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-64d4f05f-406f-4567-8791-31c9732a0ea7 req-8143ef38-7e69-481a-8e05-bb1216cc0b6c service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:20.578398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-64d4f05f-406f-4567-8791-31c9732a0ea7 req-8143ef38-7e69-481a-8e05-bb1216cc0b6c service nova] Creating event network-changed:ffccccb6-d608-41f3-af2c-a06ebc5fa625 for instance 7745385c-e705-4e0e-8fc7-c96f398b93d9 on hv-cinder-80588 Sep 14 19:44:20.578398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-64d4f05f-406f-4567-8791-31c9732a0ea7 req-8143ef38-7e69-481a-8e05-bb1216cc0b6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071275 Sep 14 19:44:20.578398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 251/446] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:44:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:44:20.578766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b774c61f-6dcc-41be-991d-2211889f014b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:20.578766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b774c61f-6dcc-41be-991d-2211889f014b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:20.578766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b774c61f-6dcc-41be-991d-2211889f014b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:20.578766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b774c61f-6dcc-41be-991d-2211889f014b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:20.579047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b774c61f-6dcc-41be-991d-2211889f014b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:20.579047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b774c61f-6dcc-41be-991d-2211889f014b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:20.836017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b774c61f-6dcc-41be-991d-2211889f014b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:20.844621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b774c61f-6dcc-41be-991d-2211889f014b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:20.849946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b774c61f-6dcc-41be-991d-2211889f014b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:20.853781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b774c61f-6dcc-41be-991d-2211889f014b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.341185 Sep 14 19:44:20.854926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 252/447] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:20.865464 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b86ee165-3a5c-4664-95bd-a2d5a024a742 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:20.866236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b86ee165-3a5c-4664-95bd-a2d5a024a742 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:20.876040 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b86ee165-3a5c-4664-95bd-a2d5a024a742 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:20.876659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b86ee165-3a5c-4664-95bd-a2d5a024a742 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:20.877598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b86ee165-3a5c-4664-95bd-a2d5a024a742 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:20.878144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b86ee165-3a5c-4664-95bd-a2d5a024a742 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:21.356206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b86ee165-3a5c-4664-95bd-a2d5a024a742 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:21.364785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b86ee165-3a5c-4664-95bd-a2d5a024a742 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.508599 Sep 14 19:44:21.365353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 253/448] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:20 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:21.371667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2de9bbd4-6d56-4374-accc-c5625f73882d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:21.372280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2de9bbd4-6d56-4374-accc-c5625f73882d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:21.378113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2de9bbd4-6d56-4374-accc-c5625f73882d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:21.378562 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2de9bbd4-6d56-4374-accc-c5625f73882d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:21.379357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2de9bbd4-6d56-4374-accc-c5625f73882d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:21.379788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2de9bbd4-6d56-4374-accc-c5625f73882d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:21.510960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2de9bbd4-6d56-4374-accc-c5625f73882d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:21.518736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2de9bbd4-6d56-4374-accc-c5625f73882d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.152406 Sep 14 19:44:21.519306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 254/449] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:21 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:21.560270 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ab19a0db-4f65-41db-ad81-502b046f71e9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:21.561239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ab19a0db-4f65-41db-ad81-502b046f71e9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:21.567882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab19a0db-4f65-41db-ad81-502b046f71e9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:21.568462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab19a0db-4f65-41db-ad81-502b046f71e9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:21.569331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab19a0db-4f65-41db-ad81-502b046f71e9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:21.569810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab19a0db-4f65-41db-ad81-502b046f71e9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:21.676224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ab19a0db-4f65-41db-ad81-502b046f71e9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 22896 microversion: 2.1 time: 0.119491 Sep 14 19:44:21.677078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 255/450] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:21 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 22896 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:44:21.777733 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] validate_networks() for [('dadf8579-8fa0-403c-8ccf-ca6def90a163', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:44:21.873140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-66cdbc81-2e0a-42ec-b49c-1271eb83af5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:21.873927 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-66cdbc81-2e0a-42ec-b49c-1271eb83af5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:21.884826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-66cdbc81-2e0a-42ec-b49c-1271eb83af5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:21.884826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-66cdbc81-2e0a-42ec-b49c-1271eb83af5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:21.885322 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-66cdbc81-2e0a-42ec-b49c-1271eb83af5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:21.885701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-66cdbc81-2e0a-42ec-b49c-1271eb83af5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:22.130396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-66cdbc81-2e0a-42ec-b49c-1271eb83af5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:22.148200 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-66cdbc81-2e0a-42ec-b49c-1271eb83af5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:22.152557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-66cdbc81-2e0a-42ec-b49c-1271eb83af5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:22.153812 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-66cdbc81-2e0a-42ec-b49c-1271eb83af5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1738 microversion: 2.20 time: 0.285269 Sep 14 19:44:22.154565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 256/451] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:21 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1738 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:22.311233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:44:22.311683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:44:22.312159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:44:22.312794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:44:22.313369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:44:22.325657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:22.326103 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:22.328381 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:22.329106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:22.349608 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Getting quotas for project 627619b6d80a4c4ca01e48750b307056. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:44:22.353462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Getting quotas for user 8de96771b60a4d658f0e371f6b695bac and project 627619b6d80a4c4ca01e48750b307056. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:44:22.367310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:44:22.370521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:44:22.381354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2c223ca0-d0f0-4414-8a13-f4752424b844 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:22.381596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2c223ca0-d0f0-4414-8a13-f4752424b844 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:22.387700 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c223ca0-d0f0-4414-8a13-f4752424b844 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:22.389370 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c223ca0-d0f0-4414-8a13-f4752424b844 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:22.389538 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c223ca0-d0f0-4414-8a13-f4752424b844 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:22.390572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c223ca0-d0f0-4414-8a13-f4752424b844 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:22.575096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-35b0cd37-c9aa-420a-a126-8a25077086d0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.212729 Sep 14 19:44:22.576048 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 196/452] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:44:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 8214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:44:22.603234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-46f08c69-6796-4e09-8146-8917d150d488 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:22.604556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-46f08c69-6796-4e09-8146-8917d150d488 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:22.621791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-46f08c69-6796-4e09-8146-8917d150d488 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:22.621791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-46f08c69-6796-4e09-8146-8917d150d488 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:22.624670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-46f08c69-6796-4e09-8146-8917d150d488 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:22.625610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-46f08c69-6796-4e09-8146-8917d150d488 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:22.679447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2c223ca0-d0f0-4414-8a13-f4752424b844 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:22.710569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2c223ca0-d0f0-4414-8a13-f4752424b844 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.331648 Sep 14 19:44:22.724170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 257/453] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:22 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:22.731056 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-84780bc8-57b5-4f6b-a947-ca0dc18c108d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:22.731676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-84780bc8-57b5-4f6b-a947-ca0dc18c108d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:22.891287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-46f08c69-6796-4e09-8146-8917d150d488 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:22.911213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-46f08c69-6796-4e09-8146-8917d150d488 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.326691 Sep 14 19:44:22.911813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 197/454] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:22 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:22.926558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e25a1a5d-d3ce-4d7c-beff-5267bc611a67 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:22.932369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e25a1a5d-d3ce-4d7c-beff-5267bc611a67 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:22.948675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-84780bc8-57b5-4f6b-a947-ca0dc18c108d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:22.956695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e25a1a5d-d3ce-4d7c-beff-5267bc611a67 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:22.957939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e25a1a5d-d3ce-4d7c-beff-5267bc611a67 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:22.959022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e25a1a5d-d3ce-4d7c-beff-5267bc611a67 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:22.959373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-84780bc8-57b5-4f6b-a947-ca0dc18c108d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1217 microversion: 2.1 time: 0.232631 Sep 14 19:44:22.960929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e25a1a5d-d3ce-4d7c-beff-5267bc611a67 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:22.972057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 258/455] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:22 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1217 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:23.067489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e25a1a5d-d3ce-4d7c-beff-5267bc611a67 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 23801 microversion: 2.1 time: 0.154407 Sep 14 19:44:23.071842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 198/456] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:22 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 23801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:23.172818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b7e7bbab-4c8b-4c61-bf7e-fc3f16edf5c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:23.173539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b7e7bbab-4c8b-4c61-bf7e-fc3f16edf5c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:23.185353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7e7bbab-4c8b-4c61-bf7e-fc3f16edf5c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:23.185919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7e7bbab-4c8b-4c61-bf7e-fc3f16edf5c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:23.187491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7e7bbab-4c8b-4c61-bf7e-fc3f16edf5c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:23.187491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7e7bbab-4c8b-4c61-bf7e-fc3f16edf5c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:23.390781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b7e7bbab-4c8b-4c61-bf7e-fc3f16edf5c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:23.402586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b7e7bbab-4c8b-4c61-bf7e-fc3f16edf5c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:23.404283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b7e7bbab-4c8b-4c61-bf7e-fc3f16edf5c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:23.405939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b7e7bbab-4c8b-4c61-bf7e-fc3f16edf5c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1720 microversion: 2.20 time: 0.237380 Sep 14 19:44:23.407026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 259/457] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1720 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:23.726998 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8c202a2a-a91f-4244-b805-7cdf993a2302 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:23.727693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8c202a2a-a91f-4244-b805-7cdf993a2302 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:23.737820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c202a2a-a91f-4244-b805-7cdf993a2302 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:23.738639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c202a2a-a91f-4244-b805-7cdf993a2302 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:23.739601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c202a2a-a91f-4244-b805-7cdf993a2302 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:23.740133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c202a2a-a91f-4244-b805-7cdf993a2302 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:23.925576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8c202a2a-a91f-4244-b805-7cdf993a2302 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:23.927825 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-15799605-03cb-4ab7-9616-cd801e160690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:23.928876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-15799605-03cb-4ab7-9616-cd801e160690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:23.936101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8c202a2a-a91f-4244-b805-7cdf993a2302 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.213456 Sep 14 19:44:23.946021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 199/458] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:23 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:23.949048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-15799605-03cb-4ab7-9616-cd801e160690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:23.949273 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-15799605-03cb-4ab7-9616-cd801e160690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:23.950126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-15799605-03cb-4ab7-9616-cd801e160690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:23.950569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-15799605-03cb-4ab7-9616-cd801e160690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:23.978550 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ce81ad4a-8d8b-4ae0-b9d2-ca9c5ca4e5ab tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:23.979175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ce81ad4a-8d8b-4ae0-b9d2-ca9c5ca4e5ab tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:24.009736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce81ad4a-8d8b-4ae0-b9d2-ca9c5ca4e5ab tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:24.010365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce81ad4a-8d8b-4ae0-b9d2-ca9c5ca4e5ab tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:24.011219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce81ad4a-8d8b-4ae0-b9d2-ca9c5ca4e5ab tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:24.011720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce81ad4a-8d8b-4ae0-b9d2-ca9c5ca4e5ab tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:24.089039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ce81ad4a-8d8b-4ae0-b9d2-ca9c5ca4e5ab tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:24.099815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ce81ad4a-8d8b-4ae0-b9d2-ca9c5ca4e5ab tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1213 microversion: 2.1 time: 0.127412 Sep 14 19:44:24.110736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 200/459] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:23 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:24.115861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9280dcba-f812-43b2-b746-53f628e0f800 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:24.117067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9280dcba-f812-43b2-b746-53f628e0f800 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:24.124021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9280dcba-f812-43b2-b746-53f628e0f800 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:24.125484 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9280dcba-f812-43b2-b746-53f628e0f800 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:24.126521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9280dcba-f812-43b2-b746-53f628e0f800 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:24.126991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9280dcba-f812-43b2-b746-53f628e0f800 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:24.127109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-15799605-03cb-4ab7-9616-cd801e160690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:24.136005 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-15799605-03cb-4ab7-9616-cd801e160690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.211626 Sep 14 19:44:24.149312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 260/460] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:23 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:24.227276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9280dcba-f812-43b2-b746-53f628e0f800 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 24771 microversion: 2.1 time: 0.114777 Sep 14 19:44:24.228392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 201/461] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:24 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 24771 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:24.424576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2d7a21e4-d3d4-44b9-9c66-2a37b1481611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:24.425670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2d7a21e4-d3d4-44b9-9c66-2a37b1481611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:24.432484 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d7a21e4-d3d4-44b9-9c66-2a37b1481611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:24.433227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d7a21e4-d3d4-44b9-9c66-2a37b1481611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:24.434282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d7a21e4-d3d4-44b9-9c66-2a37b1481611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:24.434964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d7a21e4-d3d4-44b9-9c66-2a37b1481611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:24.575724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2d7a21e4-d3d4-44b9-9c66-2a37b1481611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:24.584217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2d7a21e4-d3d4-44b9-9c66-2a37b1481611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:24.585762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2d7a21e4-d3d4-44b9-9c66-2a37b1481611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:24.586929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2d7a21e4-d3d4-44b9-9c66-2a37b1481611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1720 microversion: 2.20 time: 0.166624 Sep 14 19:44:24.587827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 261/462] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:24.953984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8c5e7ee1-b1ac-41f0-ad16-786c20412cea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:24.955270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8c5e7ee1-b1ac-41f0-ad16-786c20412cea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:24.963422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c5e7ee1-b1ac-41f0-ad16-786c20412cea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:24.963872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c5e7ee1-b1ac-41f0-ad16-786c20412cea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:24.964728 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c5e7ee1-b1ac-41f0-ad16-786c20412cea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:24.966997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c5e7ee1-b1ac-41f0-ad16-786c20412cea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:25.118590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-abd8894f-e384-4e46-ae8d-8ccc1b71a4a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:25.135133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-abd8894f-e384-4e46-ae8d-8ccc1b71a4a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:25.135133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-abd8894f-e384-4e46-ae8d-8ccc1b71a4a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:25.135133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-abd8894f-e384-4e46-ae8d-8ccc1b71a4a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:25.135133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-abd8894f-e384-4e46-ae8d-8ccc1b71a4a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:25.135514 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-abd8894f-e384-4e46-ae8d-8ccc1b71a4a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:25.187890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8c5e7ee1-b1ac-41f0-ad16-786c20412cea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:25.198730 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8c5e7ee1-b1ac-41f0-ad16-786c20412cea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.248615 Sep 14 19:44:25.200072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 202/463] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:24 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:25.204957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a58931c2-f72f-414a-8411-e791a8956ec7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:25.208784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a58931c2-f72f-414a-8411-e791a8956ec7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:25.216684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a58931c2-f72f-414a-8411-e791a8956ec7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:25.217301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a58931c2-f72f-414a-8411-e791a8956ec7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:25.218814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a58931c2-f72f-414a-8411-e791a8956ec7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:25.219391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a58931c2-f72f-414a-8411-e791a8956ec7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:25.270991 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-abd8894f-e384-4e46-ae8d-8ccc1b71a4a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:25.282398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-abd8894f-e384-4e46-ae8d-8ccc1b71a4a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1277 microversion: 2.1 time: 0.168109 Sep 14 19:44:25.283304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 262/464] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:25 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:25.299194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1b5acf3c-ce5d-428d-999c-027a55aa89d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:25.300405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1b5acf3c-ce5d-428d-999c-027a55aa89d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:25.310548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b5acf3c-ce5d-428d-999c-027a55aa89d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:25.311116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b5acf3c-ce5d-428d-999c-027a55aa89d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:25.312788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b5acf3c-ce5d-428d-999c-027a55aa89d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:25.312788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b5acf3c-ce5d-428d-999c-027a55aa89d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:25.399052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a58931c2-f72f-414a-8411-e791a8956ec7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:25.408736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a58931c2-f72f-414a-8411-e791a8956ec7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.207268 Sep 14 19:44:25.409416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 203/465] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:25 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:25.411144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1b5acf3c-ce5d-428d-999c-027a55aa89d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 25465 microversion: 2.1 time: 0.126434 Sep 14 19:44:25.411877 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 263/466] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:25 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 25465 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:25.604045 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a41266a8-ed22-4024-b4bb-b54382ea25c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:25.604649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a41266a8-ed22-4024-b4bb-b54382ea25c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:25.610563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a41266a8-ed22-4024-b4bb-b54382ea25c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:25.611002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a41266a8-ed22-4024-b4bb-b54382ea25c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:25.611754 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a41266a8-ed22-4024-b4bb-b54382ea25c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:25.612177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a41266a8-ed22-4024-b4bb-b54382ea25c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:25.753096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a41266a8-ed22-4024-b4bb-b54382ea25c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:25.758141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a41266a8-ed22-4024-b4bb-b54382ea25c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:25.759648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a41266a8-ed22-4024-b4bb-b54382ea25c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:25.760810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a41266a8-ed22-4024-b4bb-b54382ea25c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1720 microversion: 2.20 time: 0.160508 Sep 14 19:44:25.761362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 204/467] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:26.217870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fcd6c352-a170-4f3b-ac36-3fab26c4d834 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:26.219941 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fcd6c352-a170-4f3b-ac36-3fab26c4d834 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:26.231424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fcd6c352-a170-4f3b-ac36-3fab26c4d834 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.231879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fcd6c352-a170-4f3b-ac36-3fab26c4d834 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:26.232952 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fcd6c352-a170-4f3b-ac36-3fab26c4d834 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.233712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fcd6c352-a170-4f3b-ac36-3fab26c4d834 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:26.299995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3b53b159-556b-41ec-9698-8fd37abdb943 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:26.308900 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3b53b159-556b-41ec-9698-8fd37abdb943 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:26.318870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b53b159-556b-41ec-9698-8fd37abdb943 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.319704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b53b159-556b-41ec-9698-8fd37abdb943 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:26.320560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b53b159-556b-41ec-9698-8fd37abdb943 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.321242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b53b159-556b-41ec-9698-8fd37abdb943 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:26.556228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-fcd6c352-a170-4f3b-ac36-3fab26c4d834 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:26.569269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fcd6c352-a170-4f3b-ac36-3fab26c4d834 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.355936 Sep 14 19:44:26.572855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 264/468] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:26 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:26.577953 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3b53b159-556b-41ec-9698-8fd37abdb943 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:26.588714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3b53b159-556b-41ec-9698-8fd37abdb943 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.293261 Sep 14 19:44:26.599674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ec498b21-4c67-4563-883b-38a3dd97bc00 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:26.599674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ec498b21-4c67-4563-883b-38a3dd97bc00 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:26.602040 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 205/469] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:26 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:26.604492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec498b21-4c67-4563-883b-38a3dd97bc00 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.604953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec498b21-4c67-4563-883b-38a3dd97bc00 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:26.605907 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec498b21-4c67-4563-883b-38a3dd97bc00 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.606221 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec498b21-4c67-4563-883b-38a3dd97bc00 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:26.610773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-644f505e-c4eb-4bbc-845b-faafaef37312 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:26.611410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-644f505e-c4eb-4bbc-845b-faafaef37312 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:26.618439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-644f505e-c4eb-4bbc-845b-faafaef37312 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.619336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-644f505e-c4eb-4bbc-845b-faafaef37312 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:26.620120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-644f505e-c4eb-4bbc-845b-faafaef37312 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.620546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-644f505e-c4eb-4bbc-845b-faafaef37312 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:26.696209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ec498b21-4c67-4563-883b-38a3dd97bc00 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 26335 microversion: 2.1 time: 0.123493 Sep 14 19:44:26.697152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 265/470] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:26 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 26335 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:26.771637 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-bb18119f-dd07-4dd3-b212-ca0dbd489a23 req-5e58980d-facb-4d30-bb95-3f8bb861b4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a26129-f7fb-4755-979a-968cdf0c7d34", "name": "network-vif-unplugged", "status": "completed", "tag": "f0babfc4-e4f0-41d5-9206-dc7125b0b10e"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:26.786701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:44:26.786701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:44:26.786701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-bb18119f-dd07-4dd3-b212-ca0dbd489a23 req-5e58980d-facb-4d30-bb95-3f8bb861b4c0 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.786701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-bb18119f-dd07-4dd3-b212-ca0dbd489a23 req-5e58980d-facb-4d30-bb95-3f8bb861b4c0 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:26.800968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-bb18119f-dd07-4dd3-b212-ca0dbd489a23 req-5e58980d-facb-4d30-bb95-3f8bb861b4c0 service nova] Creating event network-vif-unplugged:f0babfc4-e4f0-41d5-9206-dc7125b0b10e for instance 72a26129-f7fb-4755-979a-968cdf0c7d34 on hv-cinder-80588 Sep 14 19:44:26.817729 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-644f505e-c4eb-4bbc-845b-faafaef37312 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:26.827736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-bb18119f-dd07-4dd3-b212-ca0dbd489a23 req-5e58980d-facb-4d30-bb95-3f8bb861b4c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059857 Sep 14 19:44:26.827736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 266/471] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:44:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:44:26.830319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-644f505e-c4eb-4bbc-845b-faafaef37312 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.226876 Sep 14 19:44:26.839465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8fb25c34-0506-4e24-bde1-d70758afc015 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:26.840282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8fb25c34-0506-4e24-bde1-d70758afc015 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:26.847066 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 206/472] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:26 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:26.876169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8fb25c34-0506-4e24-bde1-d70758afc015 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.890639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8fb25c34-0506-4e24-bde1-d70758afc015 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:26.890639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8fb25c34-0506-4e24-bde1-d70758afc015 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:26.890639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8fb25c34-0506-4e24-bde1-d70758afc015 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:27.292843 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8fb25c34-0506-4e24-bde1-d70758afc015 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:27.304202 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8fb25c34-0506-4e24-bde1-d70758afc015 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:27.313416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8fb25c34-0506-4e24-bde1-d70758afc015 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:27.319757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8fb25c34-0506-4e24-bde1-d70758afc015 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1663 microversion: 2.20 time: 0.491959 Sep 14 19:44:27.320882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 267/473] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1663 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:27.342079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1616dcf3-8444-46b1-969e-e6c9a17e4dd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcf88e46-dac7-4d2d-a557-f0e5def18821"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:27.346026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1616dcf3-8444-46b1-969e-e6c9a17e4dd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:27.374653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1616dcf3-8444-46b1-969e-e6c9a17e4dd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:27.375913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1616dcf3-8444-46b1-969e-e6c9a17e4dd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:27.377323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1616dcf3-8444-46b1-969e-e6c9a17e4dd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:27.377948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1616dcf3-8444-46b1-969e-e6c9a17e4dd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:27.588788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0bc63794-8e3d-41ac-937d-0f58dd5a4a2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:27.595628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0bc63794-8e3d-41ac-937d-0f58dd5a4a2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:27.601879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bc63794-8e3d-41ac-937d-0f58dd5a4a2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:27.602638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bc63794-8e3d-41ac-937d-0f58dd5a4a2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:27.604698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bc63794-8e3d-41ac-937d-0f58dd5a4a2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:27.604698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bc63794-8e3d-41ac-937d-0f58dd5a4a2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:27.827352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0bc63794-8e3d-41ac-937d-0f58dd5a4a2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:27.850080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0bc63794-8e3d-41ac-937d-0f58dd5a4a2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.265444 Sep 14 19:44:27.852378 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 268/474] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:27 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:27.857897 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2486a8d4-12da-40de-bca6-b7104f4b432d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:27.859130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2486a8d4-12da-40de-bca6-b7104f4b432d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:27.865993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2486a8d4-12da-40de-bca6-b7104f4b432d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:27.870910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2486a8d4-12da-40de-bca6-b7104f4b432d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:27.870910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2486a8d4-12da-40de-bca6-b7104f4b432d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:27.870910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2486a8d4-12da-40de-bca6-b7104f4b432d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:28.048666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2486a8d4-12da-40de-bca6-b7104f4b432d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:28.061424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2486a8d4-12da-40de-bca6-b7104f4b432d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.204273 Sep 14 19:44:28.061424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 269/475] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:27 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:28.078107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-17bf5a3b-3c3d-4761-8b60-a1349c370488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:28.078107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-17bf5a3b-3c3d-4761-8b60-a1349c370488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:28.086911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17bf5a3b-3c3d-4761-8b60-a1349c370488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:28.087386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17bf5a3b-3c3d-4761-8b60-a1349c370488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:28.088275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17bf5a3b-3c3d-4761-8b60-a1349c370488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:28.088735 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17bf5a3b-3c3d-4761-8b60-a1349c370488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:28.190134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-17bf5a3b-3c3d-4761-8b60-a1349c370488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 27112 microversion: 2.1 time: 0.117883 Sep 14 19:44:28.196030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 270/476] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:28 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 27112 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:28.205327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8cb233c4-3b0f-4b90-9950-fb893a882232 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:28.206553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8cb233c4-3b0f-4b90-9950-fb893a882232 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:28.219632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cb233c4-3b0f-4b90-9950-fb893a882232 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:28.220173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cb233c4-3b0f-4b90-9950-fb893a882232 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:28.223962 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cb233c4-3b0f-4b90-9950-fb893a882232 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:28.230814 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cb233c4-3b0f-4b90-9950-fb893a882232 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:28.562339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8cb233c4-3b0f-4b90-9950-fb893a882232 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:28.570869 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8cb233c4-3b0f-4b90-9950-fb893a882232 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.375902 Sep 14 19:44:28.573143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 271/477] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:28 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:28.584419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-be4dfc48-0461-4834-a9ef-b8b212065a4f req-88893f9b-c0b9-4366-ad67-0480abda12d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6", "tag": "eca1d51d-fcb7-4c11-a66d-106f9d4745be"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:28.589338 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:44:28.589338 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:44:28.610793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-be4dfc48-0461-4834-a9ef-b8b212065a4f req-88893f9b-c0b9-4366-ad67-0480abda12d6 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:28.612767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-be4dfc48-0461-4834-a9ef-b8b212065a4f req-88893f9b-c0b9-4366-ad67-0480abda12d6 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:28.639673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-be4dfc48-0461-4834-a9ef-b8b212065a4f req-88893f9b-c0b9-4366-ad67-0480abda12d6 service nova] Creating event network-changed:eca1d51d-fcb7-4c11-a66d-106f9d4745be for instance 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 on hv-cinder-80588 Sep 14 19:44:28.648937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-be4dfc48-0461-4834-a9ef-b8b212065a4f req-88893f9b-c0b9-4366-ad67-0480abda12d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073144 Sep 14 19:44:28.649559 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 272/478] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:44:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:44:28.821855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1616dcf3-8444-46b1-969e-e6c9a17e4dd1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.486664 Sep 14 19:44:28.827037 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 207/479] 10.222.0.58 () {62 vars in 1364 bytes} [Tue Sep 14 19:44:27 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 188 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:28.869563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2c5f0806-1436-4b63-bf94-dadd258d6dbc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:28.870410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2c5f0806-1436-4b63-bf94-dadd258d6dbc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:28.877043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c5f0806-1436-4b63-bf94-dadd258d6dbc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:28.882326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c5f0806-1436-4b63-bf94-dadd258d6dbc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:28.882326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c5f0806-1436-4b63-bf94-dadd258d6dbc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:28.882326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c5f0806-1436-4b63-bf94-dadd258d6dbc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:28.988833 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3954b628-e897-442c-92f1-d27a2e42c756 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:28.992000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3954b628-e897-442c-92f1-d27a2e42c756 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:29.001188 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3954b628-e897-442c-92f1-d27a2e42c756 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:29.002013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3954b628-e897-442c-92f1-d27a2e42c756 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:29.003148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3954b628-e897-442c-92f1-d27a2e42c756 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:29.003872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3954b628-e897-442c-92f1-d27a2e42c756 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:29.109318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2c5f0806-1436-4b63-bf94-dadd258d6dbc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:29.125678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2c5f0806-1436-4b63-bf94-dadd258d6dbc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.260233 Sep 14 19:44:29.136360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 273/480] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:28 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:29.141810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ac99b734-c3dd-4606-b2d8-cbe690c2e67b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:29.143295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ac99b734-c3dd-4606-b2d8-cbe690c2e67b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:29.150623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac99b734-c3dd-4606-b2d8-cbe690c2e67b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:29.151175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac99b734-c3dd-4606-b2d8-cbe690c2e67b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:29.152149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac99b734-c3dd-4606-b2d8-cbe690c2e67b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:29.152698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac99b734-c3dd-4606-b2d8-cbe690c2e67b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:29.383892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3954b628-e897-442c-92f1-d27a2e42c756 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 202 len: 0 microversion: 2.20 time: 0.402453 Sep 14 19:44:29.390350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 208/481] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:44:28 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:44:29.431749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ac99b734-c3dd-4606-b2d8-cbe690c2e67b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:29.432325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-232e95ef-b603-435d-bae1-a2e4b21c3882 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:29.438494 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-232e95ef-b603-435d-bae1-a2e4b21c3882 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:29.439892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ac99b734-c3dd-4606-b2d8-cbe690c2e67b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.302314 Sep 14 19:44:29.450854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 274/482] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:29 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:29.456414 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-65969d17-5704-4798-a767-18c337629a0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:29.457259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-65969d17-5704-4798-a767-18c337629a0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:29.463679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65969d17-5704-4798-a767-18c337629a0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:29.464390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65969d17-5704-4798-a767-18c337629a0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:29.465347 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65969d17-5704-4798-a767-18c337629a0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:29.465978 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65969d17-5704-4798-a767-18c337629a0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:29.468284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-232e95ef-b603-435d-bae1-a2e4b21c3882 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:29.468759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-232e95ef-b603-435d-bae1-a2e4b21c3882 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:29.472887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-232e95ef-b603-435d-bae1-a2e4b21c3882 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:29.474925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-232e95ef-b603-435d-bae1-a2e4b21c3882 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:29.625687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-232e95ef-b603-435d-bae1-a2e4b21c3882 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 27755 microversion: 2.1 time: 0.233547 Sep 14 19:44:29.626357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 209/483] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:29 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 27755 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:29.644547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-99fe5850-7c97-4ad5-8be4-a26aac3462d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:29.645266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-99fe5850-7c97-4ad5-8be4-a26aac3462d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:29.667731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99fe5850-7c97-4ad5-8be4-a26aac3462d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:29.672142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99fe5850-7c97-4ad5-8be4-a26aac3462d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:29.684196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99fe5850-7c97-4ad5-8be4-a26aac3462d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:29.685820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99fe5850-7c97-4ad5-8be4-a26aac3462d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:29.807446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-65969d17-5704-4798-a767-18c337629a0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:29.825088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-65969d17-5704-4798-a767-18c337629a0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:29.825618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-65969d17-5704-4798-a767-18c337629a0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:29.845255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-65969d17-5704-4798-a767-18c337629a0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1749 microversion: 2.20 time: 0.392979 Sep 14 19:44:29.846819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 275/484] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:29 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1749 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:29.906416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-99fe5850-7c97-4ad5-8be4-a26aac3462d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:29.914209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-99fe5850-7c97-4ad5-8be4-a26aac3462d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.283093 Sep 14 19:44:29.914797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 210/485] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:29 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:30.143792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5a5eb0d2-fec4-4c5f-8392-fb6f685f14ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:30.144521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5a5eb0d2-fec4-4c5f-8392-fb6f685f14ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:30.150881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a5eb0d2-fec4-4c5f-8392-fb6f685f14ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:30.151329 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a5eb0d2-fec4-4c5f-8392-fb6f685f14ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:30.152111 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a5eb0d2-fec4-4c5f-8392-fb6f685f14ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:30.152539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a5eb0d2-fec4-4c5f-8392-fb6f685f14ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:30.348105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5a5eb0d2-fec4-4c5f-8392-fb6f685f14ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:30.356800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5a5eb0d2-fec4-4c5f-8392-fb6f685f14ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.217236 Sep 14 19:44:30.357376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 276/486] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:30 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:30.457724 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-95bd3c02-20b8-4043-accc-4dedccade99c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:30.458284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-95bd3c02-20b8-4043-accc-4dedccade99c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:30.464472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-95bd3c02-20b8-4043-accc-4dedccade99c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:30.464939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-95bd3c02-20b8-4043-accc-4dedccade99c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:30.465753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-95bd3c02-20b8-4043-accc-4dedccade99c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:30.466180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-95bd3c02-20b8-4043-accc-4dedccade99c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:30.599249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-95bd3c02-20b8-4043-accc-4dedccade99c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:30.608041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-95bd3c02-20b8-4043-accc-4dedccade99c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.154075 Sep 14 19:44:30.609125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 211/487] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:30 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:30.637199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e625c034-05aa-466d-8f55-69f107fbd501 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:30.638223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e625c034-05aa-466d-8f55-69f107fbd501 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:30.644076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e625c034-05aa-466d-8f55-69f107fbd501 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:30.644602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e625c034-05aa-466d-8f55-69f107fbd501 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:30.645368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e625c034-05aa-466d-8f55-69f107fbd501 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:30.645826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e625c034-05aa-466d-8f55-69f107fbd501 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:30.854441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e625c034-05aa-466d-8f55-69f107fbd501 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 27990 microversion: 2.1 time: 0.220708 Sep 14 19:44:30.855170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 277/488] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:30 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 27990 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:30.864553 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2c5df744-a622-45c0-9dd9-b39c57429141 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:30.865521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2c5df744-a622-45c0-9dd9-b39c57429141 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:30.871951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2c5df744-a622-45c0-9dd9-b39c57429141 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:30.872458 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2c5df744-a622-45c0-9dd9-b39c57429141 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:30.873437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2c5df744-a622-45c0-9dd9-b39c57429141 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:30.874538 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2c5df744-a622-45c0-9dd9-b39c57429141 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:30.939045 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-55093b70-3f5b-4d88-a559-3bafeb7d57c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:30.939755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-55093b70-3f5b-4d88-a559-3bafeb7d57c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:30.946238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55093b70-3f5b-4d88-a559-3bafeb7d57c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:30.946941 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55093b70-3f5b-4d88-a559-3bafeb7d57c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:30.947918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55093b70-3f5b-4d88-a559-3bafeb7d57c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:30.948518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55093b70-3f5b-4d88-a559-3bafeb7d57c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:31.007804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2c5df744-a622-45c0-9dd9-b39c57429141 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:31.017266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2c5df744-a622-45c0-9dd9-b39c57429141 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:31.019706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2c5df744-a622-45c0-9dd9-b39c57429141 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:31.021053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2c5df744-a622-45c0-9dd9-b39c57429141 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1749 microversion: 2.20 time: 0.160141 Sep 14 19:44:31.033572 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 212/489] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:30 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:31.102366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-55093b70-3f5b-4d88-a559-3bafeb7d57c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:31.114743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-55093b70-3f5b-4d88-a559-3bafeb7d57c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.185061 Sep 14 19:44:31.115343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 278/490] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:30 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:31.373531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e4dac7e5-e09e-4c97-abe0-a10d7c2f3c5a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:31.374212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e4dac7e5-e09e-4c97-abe0-a10d7c2f3c5a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:31.380317 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4dac7e5-e09e-4c97-abe0-a10d7c2f3c5a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:31.380675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4dac7e5-e09e-4c97-abe0-a10d7c2f3c5a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:31.381438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4dac7e5-e09e-4c97-abe0-a10d7c2f3c5a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:31.381896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4dac7e5-e09e-4c97-abe0-a10d7c2f3c5a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:31.505906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e4dac7e5-e09e-4c97-abe0-a10d7c2f3c5a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:31.514083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e4dac7e5-e09e-4c97-abe0-a10d7c2f3c5a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.144180 Sep 14 19:44:31.515173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 213/491] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:31 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:31.628331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a17a4b20-2974-410e-94b6-db39b31e9044 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:31.629449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a17a4b20-2974-410e-94b6-db39b31e9044 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:31.642298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a17a4b20-2974-410e-94b6-db39b31e9044 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:31.643369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a17a4b20-2974-410e-94b6-db39b31e9044 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:31.644536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a17a4b20-2974-410e-94b6-db39b31e9044 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:31.645130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a17a4b20-2974-410e-94b6-db39b31e9044 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:31.646782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3f14a698-22e3-4fed-ab1d-bc782de3046c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Action: 'create', calling method: .version_select at 0x7fd0c85e01f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1428796221"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:31.667555 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-3f14a698-22e3-4fed-ab1d-bc782de3046c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Getting quotas for project 14259a781e8c4dbeafab6f1777646286. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:44:31.673681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-3f14a698-22e3-4fed-ab1d-bc782de3046c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Getting quotas for user 31cb4a2e6b0146d897917fe76dcc6565 and project 14259a781e8c4dbeafab6f1777646286. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:44:31.803151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a17a4b20-2974-410e-94b6-db39b31e9044 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:31.811782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a17a4b20-2974-410e-94b6-db39b31e9044 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.189083 Sep 14 19:44:31.812367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 279/492] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:31 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:31.867208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6a6982ca-e6a3-4a25-8df4-a83a1cb43eae tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:31.868224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6a6982ca-e6a3-4a25-8df4-a83a1cb43eae tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:31.874563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6a6982ca-e6a3-4a25-8df4-a83a1cb43eae tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:31.875017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6a6982ca-e6a3-4a25-8df4-a83a1cb43eae tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:31.875792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6a6982ca-e6a3-4a25-8df4-a83a1cb43eae tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:31.876233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6a6982ca-e6a3-4a25-8df4-a83a1cb43eae tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:31.885191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-3f14a698-22e3-4fed-ab1d-bc782de3046c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Getting quotas for project 14259a781e8c4dbeafab6f1777646286. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:44:31.888948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-3f14a698-22e3-4fed-ab1d-bc782de3046c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Getting quotas for user 31cb4a2e6b0146d897917fe76dcc6565 and project 14259a781e8c4dbeafab6f1777646286. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:44:31.902650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3f14a698-22e3-4fed-ab1d-bc782de3046c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.260064 Sep 14 19:44:31.903242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 214/493] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Sep 14 19:44:31 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:31.949622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-947699795", "imageRef": "a1301001-14c1-42a2-9d1a-fb8d3a53d16c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1428796221", "networks": [{"uuid": "93cf6beb-655e-446e-b1c0-b00530796d2d"}]}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:32.001297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] validate_networks() for [('93cf6beb-655e-446e-b1c0-b00530796d2d', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:44:32.394534 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:44:32.395114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:44:32.395340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:44:32.395746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:44:32.396147 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:44:32.404694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:32.405132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:32.405959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:32.406385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:32.422031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Getting quotas for project 14259a781e8c4dbeafab6f1777646286. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:44:32.425825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Getting quotas for user 31cb4a2e6b0146d897917fe76dcc6565 and project 14259a781e8c4dbeafab6f1777646286. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:44:32.437111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:44:32.439391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a1301001-14c1-42a2-9d1a-fb8d3a53d16c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:44:32.631261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-05609eb9-0ee6-48e6-b067-b548442501fd tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685345 Sep 14 19:44:32.631645 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 215/494] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:44:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 19:44:32.639053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cbfe0178-bf98-4dd5-92be-cb17c464f8ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:32.640430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cbfe0178-bf98-4dd5-92be-cb17c464f8ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:32.648322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbfe0178-bf98-4dd5-92be-cb17c464f8ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:32.648798 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbfe0178-bf98-4dd5-92be-cb17c464f8ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:32.649663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbfe0178-bf98-4dd5-92be-cb17c464f8ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:32.650098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbfe0178-bf98-4dd5-92be-cb17c464f8ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:32.788263 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cbfe0178-bf98-4dd5-92be-cb17c464f8ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:32.804119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cbfe0178-bf98-4dd5-92be-cb17c464f8ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:32.804119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cbfe0178-bf98-4dd5-92be-cb17c464f8ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:32.804119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cbfe0178-bf98-4dd5-92be-cb17c464f8ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1749 microversion: 2.20 time: 0.164860 Sep 14 19:44:32.804391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 216/495] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:32 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:32.810961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-506b08ec-eab1-4e44-a0cc-9d6f64e6a32c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:32.813074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-506b08ec-eab1-4e44-a0cc-9d6f64e6a32c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:32.818819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-506b08ec-eab1-4e44-a0cc-9d6f64e6a32c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:32.819362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-506b08ec-eab1-4e44-a0cc-9d6f64e6a32c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:32.820314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-506b08ec-eab1-4e44-a0cc-9d6f64e6a32c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:32.820827 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-506b08ec-eab1-4e44-a0cc-9d6f64e6a32c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:32.944832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-506b08ec-eab1-4e44-a0cc-9d6f64e6a32c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:32.952877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-506b08ec-eab1-4e44-a0cc-9d6f64e6a32c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.151217 Sep 14 19:44:32.953449 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 217/496] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:32 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:32.957722 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c3463029-227d-4ce9-af99-681b6249063b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:32.958361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c3463029-227d-4ce9-af99-681b6249063b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:32.964229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3463029-227d-4ce9-af99-681b6249063b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:32.964686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3463029-227d-4ce9-af99-681b6249063b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:32.965445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3463029-227d-4ce9-af99-681b6249063b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:32.965902 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3463029-227d-4ce9-af99-681b6249063b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:33.092179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c3463029-227d-4ce9-af99-681b6249063b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:33.101613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c3463029-227d-4ce9-af99-681b6249063b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.147107 Sep 14 19:44:33.110009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 218/497] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:32 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:33.110009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a0a39f70-07ff-429f-863e-f4056e5325e1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:33.110009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a0a39f70-07ff-429f-863e-f4056e5325e1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:33.165863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a0a39f70-07ff-429f-863e-f4056e5325e1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:33.173153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a0a39f70-07ff-429f-863e-f4056e5325e1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1258 microversion: 2.1 time: 0.069407 Sep 14 19:44:33.173745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 219/498] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:33 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:33.177961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-23ad75dd-db16-4c2d-80a4-97eb6e6e3b6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:33.181709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-23ad75dd-db16-4c2d-80a4-97eb6e6e3b6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:33.185589 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23ad75dd-db16-4c2d-80a4-97eb6e6e3b6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:33.186066 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23ad75dd-db16-4c2d-80a4-97eb6e6e3b6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:33.186842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23ad75dd-db16-4c2d-80a4-97eb6e6e3b6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:33.187303 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23ad75dd-db16-4c2d-80a4-97eb6e6e3b6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:33.323896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-23ad75dd-db16-4c2d-80a4-97eb6e6e3b6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:33.331979 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-23ad75dd-db16-4c2d-80a4-97eb6e6e3b6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.157222 Sep 14 19:44:33.332678 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 220/499] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:33 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:33.406773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-88a77d2a-d47d-4d9c-ac08-cb7a7682cc67 req-23bdd1fb-66e9-4de6-b787-6bd69ada0966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7745385c-e705-4e0e-8fc7-c96f398b93d9", "name": "network-vif-plugged", "status": "completed", "tag": "ffccccb6-d608-41f3-af2c-a06ebc5fa625"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:33.408433 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:44:33.408433 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:44:33.415931 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-88a77d2a-d47d-4d9c-ac08-cb7a7682cc67 req-23bdd1fb-66e9-4de6-b787-6bd69ada0966 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:33.416318 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-88a77d2a-d47d-4d9c-ac08-cb7a7682cc67 req-23bdd1fb-66e9-4de6-b787-6bd69ada0966 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:33.427834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-88a77d2a-d47d-4d9c-ac08-cb7a7682cc67 req-23bdd1fb-66e9-4de6-b787-6bd69ada0966 service nova] Creating event network-vif-plugged:ffccccb6-d608-41f3-af2c-a06ebc5fa625 for instance 7745385c-e705-4e0e-8fc7-c96f398b93d9 on hv-cinder-80588 Sep 14 19:44:33.432797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-88a77d2a-d47d-4d9c-ac08-cb7a7682cc67 req-23bdd1fb-66e9-4de6-b787-6bd69ada0966 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029499 Sep 14 19:44:33.433279 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 221/500] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:44:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:44:33.819358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4dc59371-a706-4357-b3bf-c4b54a3c6c19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:33.820193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4dc59371-a706-4357-b3bf-c4b54a3c6c19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:33.827294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4dc59371-a706-4357-b3bf-c4b54a3c6c19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:33.827914 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4dc59371-a706-4357-b3bf-c4b54a3c6c19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:33.828760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4dc59371-a706-4357-b3bf-c4b54a3c6c19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:33.829592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4dc59371-a706-4357-b3bf-c4b54a3c6c19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:33.956947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4dc59371-a706-4357-b3bf-c4b54a3c6c19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:33.966201 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4dc59371-a706-4357-b3bf-c4b54a3c6c19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:33.967992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4dc59371-a706-4357-b3bf-c4b54a3c6c19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:33.969579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4dc59371-a706-4357-b3bf-c4b54a3c6c19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1749 microversion: 2.20 time: 0.154232 Sep 14 19:44:33.975296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 222/501] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:33 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:33.975296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d89fe8a7-f36c-44c5-8456-210b86637d4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:33.975296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d89fe8a7-f36c-44c5-8456-210b86637d4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:33.980428 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d89fe8a7-f36c-44c5-8456-210b86637d4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:33.980869 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d89fe8a7-f36c-44c5-8456-210b86637d4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:33.981651 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d89fe8a7-f36c-44c5-8456-210b86637d4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:33.982086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d89fe8a7-f36c-44c5-8456-210b86637d4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:34.105823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d89fe8a7-f36c-44c5-8456-210b86637d4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:34.113342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d89fe8a7-f36c-44c5-8456-210b86637d4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.142213 Sep 14 19:44:34.113957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 223/502] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:33 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:34.119209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cbb17a6e-9a84-4660-9b82-5b2b49e0b1ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:34.119805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cbb17a6e-9a84-4660-9b82-5b2b49e0b1ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:34.126030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbb17a6e-9a84-4660-9b82-5b2b49e0b1ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:34.126474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbb17a6e-9a84-4660-9b82-5b2b49e0b1ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:34.127238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbb17a6e-9a84-4660-9b82-5b2b49e0b1ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:34.127701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbb17a6e-9a84-4660-9b82-5b2b49e0b1ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:34.212416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6a6982ca-e6a3-4a25-8df4-a83a1cb43eae tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 28176 microversion: 2.1 time: 2.348714 Sep 14 19:44:34.213118 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 280/503] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:31 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 28176 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:44:34.221685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bc57ab0c-59e8-4bc5-9d62-246c29d632c6 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:34.222476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bc57ab0c-59e8-4bc5-9d62-246c29d632c6 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:34.229242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc57ab0c-59e8-4bc5-9d62-246c29d632c6 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:34.229746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc57ab0c-59e8-4bc5-9d62-246c29d632c6 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:34.230528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc57ab0c-59e8-4bc5-9d62-246c29d632c6 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:34.230967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc57ab0c-59e8-4bc5-9d62-246c29d632c6 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:34.263024 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cbb17a6e-9a84-4660-9b82-5b2b49e0b1ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:34.278014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cbb17a6e-9a84-4660-9b82-5b2b49e0b1ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.162029 Sep 14 19:44:34.278613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 224/504] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:34 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:34.294717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bc57ab0c-59e8-4bc5-9d62-246c29d632c6 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:34.303039 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bc57ab0c-59e8-4bc5-9d62-246c29d632c6 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1262 microversion: 2.1 time: 0.088537 Sep 14 19:44:34.303642 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 281/505] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:34 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:34.350040 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d3d3ef19-290b-4051-a7bb-ec88e3091350 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:34.350629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d3d3ef19-290b-4051-a7bb-ec88e3091350 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:34.356350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3d3ef19-290b-4051-a7bb-ec88e3091350 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:34.359214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3d3ef19-290b-4051-a7bb-ec88e3091350 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:34.359214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3d3ef19-290b-4051-a7bb-ec88e3091350 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:34.359214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3d3ef19-290b-4051-a7bb-ec88e3091350 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:34.486553 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d3d3ef19-290b-4051-a7bb-ec88e3091350 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:34.495970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d3d3ef19-290b-4051-a7bb-ec88e3091350 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.149439 Sep 14 19:44:34.496559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 225/506] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:34 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:34.988320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1b0e1ff0-e43e-41c7-8fd9-091d0958f3d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:34.988923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1b0e1ff0-e43e-41c7-8fd9-091d0958f3d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:34.994758 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b0e1ff0-e43e-41c7-8fd9-091d0958f3d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:34.995204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b0e1ff0-e43e-41c7-8fd9-091d0958f3d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:34.995980 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b0e1ff0-e43e-41c7-8fd9-091d0958f3d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:34.996414 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b0e1ff0-e43e-41c7-8fd9-091d0958f3d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.123023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1b0e1ff0-e43e-41c7-8fd9-091d0958f3d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:35.129916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-566b0038-43c1-4c2a-8b5d-0fede102a130 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:35.130567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-566b0038-43c1-4c2a-8b5d-0fede102a130 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:35.131753 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1b0e1ff0-e43e-41c7-8fd9-091d0958f3d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:35.133251 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1b0e1ff0-e43e-41c7-8fd9-091d0958f3d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:35.134456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1b0e1ff0-e43e-41c7-8fd9-091d0958f3d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.150161 Sep 14 19:44:35.135303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 282/507] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:34 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:35.139819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-566b0038-43c1-4c2a-8b5d-0fede102a130 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:35.140335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-566b0038-43c1-4c2a-8b5d-0fede102a130 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.141263 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-566b0038-43c1-4c2a-8b5d-0fede102a130 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:35.141799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-566b0038-43c1-4c2a-8b5d-0fede102a130 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.224726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-88b801ad-41c7-4a10-94c4-a8ef0a31b4a8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:35.225773 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-88b801ad-41c7-4a10-94c4-a8ef0a31b4a8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:35.232053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88b801ad-41c7-4a10-94c4-a8ef0a31b4a8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:35.232495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88b801ad-41c7-4a10-94c4-a8ef0a31b4a8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.233265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88b801ad-41c7-4a10-94c4-a8ef0a31b4a8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:35.233730 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88b801ad-41c7-4a10-94c4-a8ef0a31b4a8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.265633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-566b0038-43c1-4c2a-8b5d-0fede102a130 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:35.272994 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-566b0038-43c1-4c2a-8b5d-0fede102a130 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.146725 Sep 14 19:44:35.273606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 226/508] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:35 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:35.294680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7e747bae-3ac7-419c-9fe8-92403c4ed828 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:35.295560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7e747bae-3ac7-419c-9fe8-92403c4ed828 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:35.301844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e747bae-3ac7-419c-9fe8-92403c4ed828 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:35.302318 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e747bae-3ac7-419c-9fe8-92403c4ed828 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.303123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e747bae-3ac7-419c-9fe8-92403c4ed828 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:35.303646 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e747bae-3ac7-419c-9fe8-92403c4ed828 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.373446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-88b801ad-41c7-4a10-94c4-a8ef0a31b4a8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 28176 microversion: 2.1 time: 0.152202 Sep 14 19:44:35.374918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 283/509] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:35 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 28176 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:35.379727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-04b94402-7cc3-445e-8554-9c401fec7bc1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:35.380425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-04b94402-7cc3-445e-8554-9c401fec7bc1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:35.386746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04b94402-7cc3-445e-8554-9c401fec7bc1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:35.387193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04b94402-7cc3-445e-8554-9c401fec7bc1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.387972 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04b94402-7cc3-445e-8554-9c401fec7bc1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:35.388405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04b94402-7cc3-445e-8554-9c401fec7bc1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.435600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7e747bae-3ac7-419c-9fe8-92403c4ed828 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:35.444208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7e747bae-3ac7-419c-9fe8-92403c4ed828 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.153019 Sep 14 19:44:35.444789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 227/510] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:35 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:35.453965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-04b94402-7cc3-445e-8554-9c401fec7bc1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:35.459608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-04b94402-7cc3-445e-8554-9c401fec7bc1 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1310 microversion: 2.1 time: 0.083640 Sep 14 19:44:35.460290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 284/511] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:35 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:35.512666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4fdefc1f-cee5-4ce4-ad9f-a15ca5de3c4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:35.515664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4fdefc1f-cee5-4ce4-ad9f-a15ca5de3c4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:35.519915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fdefc1f-cee5-4ce4-ad9f-a15ca5de3c4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:35.520356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fdefc1f-cee5-4ce4-ad9f-a15ca5de3c4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.521186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fdefc1f-cee5-4ce4-ad9f-a15ca5de3c4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:35.521702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fdefc1f-cee5-4ce4-ad9f-a15ca5de3c4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:35.644117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4fdefc1f-cee5-4ce4-ad9f-a15ca5de3c4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:35.652229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4fdefc1f-cee5-4ce4-ad9f-a15ca5de3c4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.143116 Sep 14 19:44:35.654601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 228/512] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:35 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:36.153329 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-65cc2f1b-9561-43ee-b29b-279dc1bd714c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:36.154160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-65cc2f1b-9561-43ee-b29b-279dc1bd714c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:36.160274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65cc2f1b-9561-43ee-b29b-279dc1bd714c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.161004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65cc2f1b-9561-43ee-b29b-279dc1bd714c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.162007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65cc2f1b-9561-43ee-b29b-279dc1bd714c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.167005 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65cc2f1b-9561-43ee-b29b-279dc1bd714c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.290163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-77a6fe03-5328-4070-86d4-9e7b127f4b67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:36.290769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-77a6fe03-5328-4070-86d4-9e7b127f4b67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:36.297105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77a6fe03-5328-4070-86d4-9e7b127f4b67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.298432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77a6fe03-5328-4070-86d4-9e7b127f4b67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.298755 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77a6fe03-5328-4070-86d4-9e7b127f4b67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.299199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77a6fe03-5328-4070-86d4-9e7b127f4b67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.356671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-65cc2f1b-9561-43ee-b29b-279dc1bd714c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:36.366977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-65cc2f1b-9561-43ee-b29b-279dc1bd714c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:36.368756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-65cc2f1b-9561-43ee-b29b-279dc1bd714c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:36.370236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-65cc2f1b-9561-43ee-b29b-279dc1bd714c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.220700 Sep 14 19:44:36.371026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 285/513] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:36 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:36.387204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-94dfed09-9a51-4a44-91aa-ab2ec348601c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:36.389222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-94dfed09-9a51-4a44-91aa-ab2ec348601c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:36.396842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94dfed09-9a51-4a44-91aa-ab2ec348601c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.398049 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94dfed09-9a51-4a44-91aa-ab2ec348601c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.398277 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94dfed09-9a51-4a44-91aa-ab2ec348601c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.398782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94dfed09-9a51-4a44-91aa-ab2ec348601c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.452726 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-77a6fe03-5328-4070-86d4-9e7b127f4b67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:36.462019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-77a6fe03-5328-4070-86d4-9e7b127f4b67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1260 microversion: 2.1 time: 0.175413 Sep 14 19:44:36.462603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 229/514] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:36 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:36.474760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5b2a81f5-df28-44de-a581-625019aeadb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:36.475371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5b2a81f5-df28-44de-a581-625019aeadb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:36.484855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b2a81f5-df28-44de-a581-625019aeadb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.485310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b2a81f5-df28-44de-a581-625019aeadb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.486129 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b2a81f5-df28-44de-a581-625019aeadb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.486568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b2a81f5-df28-44de-a581-625019aeadb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.531442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-94dfed09-9a51-4a44-91aa-ab2ec348601c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 28176 microversion: 2.1 time: 0.147647 Sep 14 19:44:36.532490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 286/515] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:36 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 28176 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:36.537523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3b980a1b-c691-442f-9efd-ed35eb63e525 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:36.538316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3b980a1b-c691-442f-9efd-ed35eb63e525 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:36.545331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b980a1b-c691-442f-9efd-ed35eb63e525 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.545855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b980a1b-c691-442f-9efd-ed35eb63e525 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.547170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b980a1b-c691-442f-9efd-ed35eb63e525 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.547835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b980a1b-c691-442f-9efd-ed35eb63e525 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.649440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5b2a81f5-df28-44de-a581-625019aeadb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:36.660843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5b2a81f5-df28-44de-a581-625019aeadb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.196713 Sep 14 19:44:36.662088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 230/516] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:36 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:36.669282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3b2b64b1-ec36-4b66-9940-a220c2e013d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:36.670240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3b2b64b1-ec36-4b66-9940-a220c2e013d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:36.681966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b2b64b1-ec36-4b66-9940-a220c2e013d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.682499 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b2b64b1-ec36-4b66-9940-a220c2e013d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.683870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b2b64b1-ec36-4b66-9940-a220c2e013d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:36.684392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b2b64b1-ec36-4b66-9940-a220c2e013d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:36.704376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3b980a1b-c691-442f-9efd-ed35eb63e525 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:36.718759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3b980a1b-c691-442f-9efd-ed35eb63e525 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1316 microversion: 2.1 time: 0.184950 Sep 14 19:44:36.722649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 287/517] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:36 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:36.882029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3b2b64b1-ec36-4b66-9940-a220c2e013d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:36.892223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3b2b64b1-ec36-4b66-9940-a220c2e013d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.226964 Sep 14 19:44:36.894217 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 231/518] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:36 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:37.387918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-29b1e7ec-f4ac-403e-a6af-a799040163d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:37.388535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-29b1e7ec-f4ac-403e-a6af-a799040163d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:37.399210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29b1e7ec-f4ac-403e-a6af-a799040163d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:37.399669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29b1e7ec-f4ac-403e-a6af-a799040163d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:37.400463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29b1e7ec-f4ac-403e-a6af-a799040163d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:37.400902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29b1e7ec-f4ac-403e-a6af-a799040163d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:37.480870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-915d6b8f-51f2-4140-9e53-f507a727284e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:37.482043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-915d6b8f-51f2-4140-9e53-f507a727284e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:37.493808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-915d6b8f-51f2-4140-9e53-f507a727284e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:37.494302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-915d6b8f-51f2-4140-9e53-f507a727284e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:37.501186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-915d6b8f-51f2-4140-9e53-f507a727284e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:37.501186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-915d6b8f-51f2-4140-9e53-f507a727284e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:37.561236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-29b1e7ec-f4ac-403e-a6af-a799040163d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:37.571710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-29b1e7ec-f4ac-403e-a6af-a799040163d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:37.573657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-29b1e7ec-f4ac-403e-a6af-a799040163d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:37.575304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-29b1e7ec-f4ac-403e-a6af-a799040163d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.191135 Sep 14 19:44:37.576616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 288/519] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:37.594143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dbc11b82-9408-4a2c-884e-8ed16c95c92b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:37.595956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dbc11b82-9408-4a2c-884e-8ed16c95c92b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:37.609479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dbc11b82-9408-4a2c-884e-8ed16c95c92b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:37.610029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dbc11b82-9408-4a2c-884e-8ed16c95c92b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:37.610907 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dbc11b82-9408-4a2c-884e-8ed16c95c92b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:37.612045 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dbc11b82-9408-4a2c-884e-8ed16c95c92b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:37.654569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-915d6b8f-51f2-4140-9e53-f507a727284e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:37.664524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-915d6b8f-51f2-4140-9e53-f507a727284e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1443 microversion: 2.1 time: 0.188771 Sep 14 19:44:37.677238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 232/520] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:37 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1443 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:37.682564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ba007a74-69b6-4fdc-9f3b-55156a05be52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:37.683489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ba007a74-69b6-4fdc-9f3b-55156a05be52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:37.690388 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba007a74-69b6-4fdc-9f3b-55156a05be52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:37.691193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba007a74-69b6-4fdc-9f3b-55156a05be52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:37.692055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba007a74-69b6-4fdc-9f3b-55156a05be52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:37.692563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba007a74-69b6-4fdc-9f3b-55156a05be52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:37.830252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ba007a74-69b6-4fdc-9f3b-55156a05be52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:37.839560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ba007a74-69b6-4fdc-9f3b-55156a05be52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.160737 Sep 14 19:44:37.840677 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 233/521] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:37 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:37.844474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f4f22e6b-3628-4313-a9b2-8ac82c0a2c5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:37.845071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f4f22e6b-3628-4313-a9b2-8ac82c0a2c5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:37.850897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f4f22e6b-3628-4313-a9b2-8ac82c0a2c5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:37.851334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f4f22e6b-3628-4313-a9b2-8ac82c0a2c5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:37.852136 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f4f22e6b-3628-4313-a9b2-8ac82c0a2c5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:37.852562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f4f22e6b-3628-4313-a9b2-8ac82c0a2c5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:37.985749 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f4f22e6b-3628-4313-a9b2-8ac82c0a2c5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:37.993424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f4f22e6b-3628-4313-a9b2-8ac82c0a2c5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1443 microversion: 2.1 time: 0.152276 Sep 14 19:44:37.994050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 234/522] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:37 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:37.998276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7a318cbf-2929-4b90-8fff-7345e3e519b7 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:37.999450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7a318cbf-2929-4b90-8fff-7345e3e519b7 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:38.006172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7a318cbf-2929-4b90-8fff-7345e3e519b7 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:38.006349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7a318cbf-2929-4b90-8fff-7345e3e519b7 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:38.007270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7a318cbf-2929-4b90-8fff-7345e3e519b7 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:38.007923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7a318cbf-2929-4b90-8fff-7345e3e519b7 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:38.168823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7a318cbf-2929-4b90-8fff-7345e3e519b7 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:38.178576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7a318cbf-2929-4b90-8fff-7345e3e519b7 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.183474 Sep 14 19:44:38.179171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 235/523] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:37 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:38.188970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bc576adb-8fc3-41b5-9d0d-9d4330428159 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:38.190290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bc576adb-8fc3-41b5-9d0d-9d4330428159 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:38.211139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc576adb-8fc3-41b5-9d0d-9d4330428159 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:38.211139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc576adb-8fc3-41b5-9d0d-9d4330428159 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:38.211330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc576adb-8fc3-41b5-9d0d-9d4330428159 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:38.211767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc576adb-8fc3-41b5-9d0d-9d4330428159 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:38.345796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bc576adb-8fc3-41b5-9d0d-9d4330428159 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:38.353621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bc576adb-8fc3-41b5-9d0d-9d4330428159 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.173367 Sep 14 19:44:38.354198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 236/524] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:38 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:38.594882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5db42406-1ff6-4b48-9a92-c3b6a75e841a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:38.595789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5db42406-1ff6-4b48-9a92-c3b6a75e841a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:38.602160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5db42406-1ff6-4b48-9a92-c3b6a75e841a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:38.604035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5db42406-1ff6-4b48-9a92-c3b6a75e841a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:38.604035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5db42406-1ff6-4b48-9a92-c3b6a75e841a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:38.604249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5db42406-1ff6-4b48-9a92-c3b6a75e841a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:38.736791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5db42406-1ff6-4b48-9a92-c3b6a75e841a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:38.744863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5db42406-1ff6-4b48-9a92-c3b6a75e841a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:38.746378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5db42406-1ff6-4b48-9a92-c3b6a75e841a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:38.747521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5db42406-1ff6-4b48-9a92-c3b6a75e841a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.157382 Sep 14 19:44:38.748077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 237/525] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:38 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:38.874112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1edb5abf-bb59-498b-9b3b-f36d692cd035 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:38.878113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1edb5abf-bb59-498b-9b3b-f36d692cd035 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:38.893314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1edb5abf-bb59-498b-9b3b-f36d692cd035 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:38.894767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1edb5abf-bb59-498b-9b3b-f36d692cd035 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:38.896841 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1edb5abf-bb59-498b-9b3b-f36d692cd035 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:38.897540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1edb5abf-bb59-498b-9b3b-f36d692cd035 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:39.028089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1edb5abf-bb59-498b-9b3b-f36d692cd035 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:39.038493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1edb5abf-bb59-498b-9b3b-f36d692cd035 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.176328 Sep 14 19:44:39.039697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 238/526] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:38 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:39.196251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-00a1ead2-805f-496f-b52e-9f4a0ebb82e8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:39.197089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-00a1ead2-805f-496f-b52e-9f4a0ebb82e8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:39.205719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00a1ead2-805f-496f-b52e-9f4a0ebb82e8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:39.206196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00a1ead2-805f-496f-b52e-9f4a0ebb82e8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:39.207007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00a1ead2-805f-496f-b52e-9f4a0ebb82e8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:39.207454 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00a1ead2-805f-496f-b52e-9f4a0ebb82e8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:39.364860 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-00a1ead2-805f-496f-b52e-9f4a0ebb82e8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:39.372257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-00a1ead2-805f-496f-b52e-9f4a0ebb82e8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.180271 Sep 14 19:44:39.372830 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 239/527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:39 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:39.377087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-df8291fc-ac9d-42c6-8f51-74435f274662 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:39.377715 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-df8291fc-ac9d-42c6-8f51-74435f274662 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:39.383194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df8291fc-ac9d-42c6-8f51-74435f274662 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:39.383645 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df8291fc-ac9d-42c6-8f51-74435f274662 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:39.384407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df8291fc-ac9d-42c6-8f51-74435f274662 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:39.384843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df8291fc-ac9d-42c6-8f51-74435f274662 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:39.537308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-df8291fc-ac9d-42c6-8f51-74435f274662 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:39.547115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-df8291fc-ac9d-42c6-8f51-74435f274662 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.173021 Sep 14 19:44:39.547667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 240/528] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:39 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:39.765389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-30a9df61-b85d-4518-bced-30b219f8d3dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:39.766743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-30a9df61-b85d-4518-bced-30b219f8d3dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:39.782696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30a9df61-b85d-4518-bced-30b219f8d3dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:39.783403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30a9df61-b85d-4518-bced-30b219f8d3dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:39.784193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30a9df61-b85d-4518-bced-30b219f8d3dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:39.784632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30a9df61-b85d-4518-bced-30b219f8d3dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:39.913614 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-30a9df61-b85d-4518-bced-30b219f8d3dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:39.930300 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-30a9df61-b85d-4518-bced-30b219f8d3dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:39.934707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-30a9df61-b85d-4518-bced-30b219f8d3dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:39.937647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-30a9df61-b85d-4518-bced-30b219f8d3dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.176350 Sep 14 19:44:39.946858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 241/529] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:39 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:40.056480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7c13515c-2ee2-4035-86b8-2c18e38c4889 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:40.057837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7c13515c-2ee2-4035-86b8-2c18e38c4889 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:40.073232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7c13515c-2ee2-4035-86b8-2c18e38c4889 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:40.080186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7c13515c-2ee2-4035-86b8-2c18e38c4889 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:40.083022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7c13515c-2ee2-4035-86b8-2c18e38c4889 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:40.083022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7c13515c-2ee2-4035-86b8-2c18e38c4889 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:40.245143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7c13515c-2ee2-4035-86b8-2c18e38c4889 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:40.264934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7c13515c-2ee2-4035-86b8-2c18e38c4889 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.212010 Sep 14 19:44:40.265556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 242/530] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:40 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:40.393216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-41466c8e-e142-479f-94b0-45f5721e02f5 req-b0f120d2-6cca-4119-be47-b037a9b64afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7745385c-e705-4e0e-8fc7-c96f398b93d9", "tag": "ffccccb6-d608-41f3-af2c-a06ebc5fa625"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:40.394851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:44:40.394851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:44:40.411020 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-41466c8e-e142-479f-94b0-45f5721e02f5 req-b0f120d2-6cca-4119-be47-b037a9b64afc service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:40.411919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-41466c8e-e142-479f-94b0-45f5721e02f5 req-b0f120d2-6cca-4119-be47-b037a9b64afc service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:40.423413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-41466c8e-e142-479f-94b0-45f5721e02f5 req-b0f120d2-6cca-4119-be47-b037a9b64afc service nova] Creating event network-changed:ffccccb6-d608-41f3-af2c-a06ebc5fa625 for instance 7745385c-e705-4e0e-8fc7-c96f398b93d9 on hv-cinder-80588 Sep 14 19:44:40.428782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-41466c8e-e142-479f-94b0-45f5721e02f5 req-b0f120d2-6cca-4119-be47-b037a9b64afc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046144 Sep 14 19:44:40.429595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 243/531] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:44:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:44:40.434336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e77c2e92-3426-43b6-878c-fea6d633cf6c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:40.435021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e77c2e92-3426-43b6-878c-fea6d633cf6c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:40.445961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e77c2e92-3426-43b6-878c-fea6d633cf6c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:40.446415 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e77c2e92-3426-43b6-878c-fea6d633cf6c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:40.447413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e77c2e92-3426-43b6-878c-fea6d633cf6c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:40.447844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e77c2e92-3426-43b6-878c-fea6d633cf6c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:40.584701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e77c2e92-3426-43b6-878c-fea6d633cf6c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:40.593762 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e77c2e92-3426-43b6-878c-fea6d633cf6c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.163069 Sep 14 19:44:40.594942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 244/532] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:40 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:40.599469 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ea414c9b-3bd8-4347-8990-2775967281d2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:40.600155 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ea414c9b-3bd8-4347-8990-2775967281d2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:40.608190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea414c9b-3bd8-4347-8990-2775967281d2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:40.608809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea414c9b-3bd8-4347-8990-2775967281d2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:40.609805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea414c9b-3bd8-4347-8990-2775967281d2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:40.610349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea414c9b-3bd8-4347-8990-2775967281d2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:40.809308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ea414c9b-3bd8-4347-8990-2775967281d2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:40.821880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ea414c9b-3bd8-4347-8990-2775967281d2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.224572 Sep 14 19:44:40.824814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 245/533] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:40 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:40.922630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-66383300-b27f-4f79-b78e-50e1ecc3eeec req-1d6c21db-bb30-4873-8c10-20976237fa7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6", "name": "network-vif-plugged", "status": "completed", "tag": "eca1d51d-fcb7-4c11-a66d-106f9d4745be"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:40.924190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:44:40.924190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:44:40.931088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-66383300-b27f-4f79-b78e-50e1ecc3eeec req-1d6c21db-bb30-4873-8c10-20976237fa7e service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:40.931525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-66383300-b27f-4f79-b78e-50e1ecc3eeec req-1d6c21db-bb30-4873-8c10-20976237fa7e service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:40.944605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-66383300-b27f-4f79-b78e-50e1ecc3eeec req-1d6c21db-bb30-4873-8c10-20976237fa7e service nova] Creating event network-vif-plugged:eca1d51d-fcb7-4c11-a66d-106f9d4745be for instance 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 on hv-cinder-80588 Sep 14 19:44:40.949626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-66383300-b27f-4f79-b78e-50e1ecc3eeec req-1d6c21db-bb30-4873-8c10-20976237fa7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031003 Sep 14 19:44:40.950448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 246/534] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:44:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:44:40.957219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4b62c806-62d7-412b-a98d-69c93bcfeeaf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:40.958063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4b62c806-62d7-412b-a98d-69c93bcfeeaf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:40.974560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b62c806-62d7-412b-a98d-69c93bcfeeaf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:40.975040 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b62c806-62d7-412b-a98d-69c93bcfeeaf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:40.975854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b62c806-62d7-412b-a98d-69c93bcfeeaf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:40.976459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b62c806-62d7-412b-a98d-69c93bcfeeaf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:41.132119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4b62c806-62d7-412b-a98d-69c93bcfeeaf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:41.141824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4b62c806-62d7-412b-a98d-69c93bcfeeaf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:41.143675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4b62c806-62d7-412b-a98d-69c93bcfeeaf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:41.144908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4b62c806-62d7-412b-a98d-69c93bcfeeaf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.193026 Sep 14 19:44:41.145473 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 247/535] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:41.283469 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fc9637e4-3e2b-4443-9499-a34de1963c30 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:41.284161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fc9637e4-3e2b-4443-9499-a34de1963c30 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:41.290075 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc9637e4-3e2b-4443-9499-a34de1963c30 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:41.290523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc9637e4-3e2b-4443-9499-a34de1963c30 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:41.291321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc9637e4-3e2b-4443-9499-a34de1963c30 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:41.291759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc9637e4-3e2b-4443-9499-a34de1963c30 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:41.428611 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fc9637e4-3e2b-4443-9499-a34de1963c30 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:41.436704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fc9637e4-3e2b-4443-9499-a34de1963c30 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.156927 Sep 14 19:44:41.437279 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 248/536] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:41 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:41.611103 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2633a9e0-17e5-4cd0-aa2e-612013637420 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:41.611665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2633a9e0-17e5-4cd0-aa2e-612013637420 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:41.617597 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2633a9e0-17e5-4cd0-aa2e-612013637420 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:41.618060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2633a9e0-17e5-4cd0-aa2e-612013637420 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:41.618853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2633a9e0-17e5-4cd0-aa2e-612013637420 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:41.619430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2633a9e0-17e5-4cd0-aa2e-612013637420 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:41.749606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2633a9e0-17e5-4cd0-aa2e-612013637420 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:41.757767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2633a9e0-17e5-4cd0-aa2e-612013637420 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.150939 Sep 14 19:44:41.758762 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 249/537] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:41 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:41.841112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4e673d59-c2b1-4cc3-8b13-4f21274c151e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:41.841766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4e673d59-c2b1-4cc3-8b13-4f21274c151e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:41.848286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e673d59-c2b1-4cc3-8b13-4f21274c151e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:41.848735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e673d59-c2b1-4cc3-8b13-4f21274c151e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:41.849519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e673d59-c2b1-4cc3-8b13-4f21274c151e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:41.849975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e673d59-c2b1-4cc3-8b13-4f21274c151e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:41.977470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4e673d59-c2b1-4cc3-8b13-4f21274c151e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:41.984907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4e673d59-c2b1-4cc3-8b13-4f21274c151e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.147524 Sep 14 19:44:41.985464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 250/538] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:41 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:42.163466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dbc40098-832d-4ba6-b985-4ec9b34c0d93 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:42.164076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dbc40098-832d-4ba6-b985-4ec9b34c0d93 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:42.171464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbc40098-832d-4ba6-b985-4ec9b34c0d93 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:42.171910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbc40098-832d-4ba6-b985-4ec9b34c0d93 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:42.178262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbc40098-832d-4ba6-b985-4ec9b34c0d93 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:42.178527 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbc40098-832d-4ba6-b985-4ec9b34c0d93 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:42.304919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dbc40098-832d-4ba6-b985-4ec9b34c0d93 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:42.314132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dbc40098-832d-4ba6-b985-4ec9b34c0d93 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:42.315627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dbc40098-832d-4ba6-b985-4ec9b34c0d93 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:42.316794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dbc40098-832d-4ba6-b985-4ec9b34c0d93 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.157035 Sep 14 19:44:42.317361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 251/539] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:42 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:42.460928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ee4de3cd-8eb0-465c-96e3-a9928f116a0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:42.460928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ee4de3cd-8eb0-465c-96e3-a9928f116a0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:42.461569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee4de3cd-8eb0-465c-96e3-a9928f116a0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:42.462025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee4de3cd-8eb0-465c-96e3-a9928f116a0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:42.462811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee4de3cd-8eb0-465c-96e3-a9928f116a0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:42.463249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee4de3cd-8eb0-465c-96e3-a9928f116a0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:42.598982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ee4de3cd-8eb0-465c-96e3-a9928f116a0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:42.606003 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ee4de3cd-8eb0-465c-96e3-a9928f116a0c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.155553 Sep 14 19:44:42.607184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 252/540] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:42 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:42.776225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-870f63ec-a983-4aca-9206-d482986b44c5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:42.776834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-870f63ec-a983-4aca-9206-d482986b44c5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:42.785007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-870f63ec-a983-4aca-9206-d482986b44c5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:42.785449 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-870f63ec-a983-4aca-9206-d482986b44c5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:42.786251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-870f63ec-a983-4aca-9206-d482986b44c5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:42.790285 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-870f63ec-a983-4aca-9206-d482986b44c5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:42.948748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-870f63ec-a983-4aca-9206-d482986b44c5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:42.957252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-870f63ec-a983-4aca-9206-d482986b44c5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.184871 Sep 14 19:44:42.957934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 253/541] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:42 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:43.001551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ad34c0bc-304e-4ace-9084-4545de999679 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:43.002154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ad34c0bc-304e-4ace-9084-4545de999679 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:43.008250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad34c0bc-304e-4ace-9084-4545de999679 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:43.008842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad34c0bc-304e-4ace-9084-4545de999679 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:43.009850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad34c0bc-304e-4ace-9084-4545de999679 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:43.010289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad34c0bc-304e-4ace-9084-4545de999679 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:43.142120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ad34c0bc-304e-4ace-9084-4545de999679 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:43.149279 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ad34c0bc-304e-4ace-9084-4545de999679 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.151414 Sep 14 19:44:43.149878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 254/542] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:42 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:43.335329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-52662f71-dede-4dfa-9366-697e203208e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:43.336033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-52662f71-dede-4dfa-9366-697e203208e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:43.342413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-52662f71-dede-4dfa-9366-697e203208e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:43.342948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-52662f71-dede-4dfa-9366-697e203208e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:43.343802 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-52662f71-dede-4dfa-9366-697e203208e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:43.344306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-52662f71-dede-4dfa-9366-697e203208e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:43.471296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-52662f71-dede-4dfa-9366-697e203208e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:43.479739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-52662f71-dede-4dfa-9366-697e203208e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:43.481294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-52662f71-dede-4dfa-9366-697e203208e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:43.482542 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-52662f71-dede-4dfa-9366-697e203208e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.151009 Sep 14 19:44:43.484779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 255/543] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:43.624769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7f1e1cb9-d716-461d-951f-27a6207c3dde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:43.625486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7f1e1cb9-d716-461d-951f-27a6207c3dde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:43.634644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f1e1cb9-d716-461d-951f-27a6207c3dde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:43.635280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f1e1cb9-d716-461d-951f-27a6207c3dde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:43.636252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f1e1cb9-d716-461d-951f-27a6207c3dde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:43.636691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f1e1cb9-d716-461d-951f-27a6207c3dde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:43.761126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7f1e1cb9-d716-461d-951f-27a6207c3dde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:43.769355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7f1e1cb9-d716-461d-951f-27a6207c3dde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.149652 Sep 14 19:44:43.769967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 256/544] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:43 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:43.974407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-00f93679-2529-4127-814b-59680f69643d tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:43.975064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-00f93679-2529-4127-814b-59680f69643d tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:43.980987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00f93679-2529-4127-814b-59680f69643d tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:43.981433 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00f93679-2529-4127-814b-59680f69643d tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:43.982269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00f93679-2529-4127-814b-59680f69643d tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:43.982707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00f93679-2529-4127-814b-59680f69643d tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:44.111972 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-00f93679-2529-4127-814b-59680f69643d tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:44.119423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-00f93679-2529-4127-814b-59680f69643d tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.148749 Sep 14 19:44:44.119993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 257/545] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:43 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:44.166883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c77760a5-5538-4ed1-9d9f-a4041fff1085 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:44.168603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c77760a5-5538-4ed1-9d9f-a4041fff1085 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:44.175337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c77760a5-5538-4ed1-9d9f-a4041fff1085 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:44.175786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c77760a5-5538-4ed1-9d9f-a4041fff1085 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:44.176571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c77760a5-5538-4ed1-9d9f-a4041fff1085 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:44.177009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c77760a5-5538-4ed1-9d9f-a4041fff1085 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:44.302764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c77760a5-5538-4ed1-9d9f-a4041fff1085 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:44.312131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c77760a5-5538-4ed1-9d9f-a4041fff1085 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.149344 Sep 14 19:44:44.312753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 258/546] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:44 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:44.503696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3b8ad6a3-8ec5-43e0-8730-5592fb495e06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:44.504459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3b8ad6a3-8ec5-43e0-8730-5592fb495e06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:44.511504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b8ad6a3-8ec5-43e0-8730-5592fb495e06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:44.511714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b8ad6a3-8ec5-43e0-8730-5592fb495e06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:44.512523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b8ad6a3-8ec5-43e0-8730-5592fb495e06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:44.513049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b8ad6a3-8ec5-43e0-8730-5592fb495e06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:44.658245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3b8ad6a3-8ec5-43e0-8730-5592fb495e06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:44.679207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3b8ad6a3-8ec5-43e0-8730-5592fb495e06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:44.682360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3b8ad6a3-8ec5-43e0-8730-5592fb495e06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:44.683855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3b8ad6a3-8ec5-43e0-8730-5592fb495e06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.186498 Sep 14 19:44:44.684800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 259/547] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:44.786568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-de3e141a-c219-4d4d-8a48-bc3dfcb84946 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:44.787100 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-de3e141a-c219-4d4d-8a48-bc3dfcb84946 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:44.792985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de3e141a-c219-4d4d-8a48-bc3dfcb84946 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:44.793433 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de3e141a-c219-4d4d-8a48-bc3dfcb84946 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:44.794238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de3e141a-c219-4d4d-8a48-bc3dfcb84946 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:44.794672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de3e141a-c219-4d4d-8a48-bc3dfcb84946 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:44.922286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-de3e141a-c219-4d4d-8a48-bc3dfcb84946 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:44.930296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-de3e141a-c219-4d4d-8a48-bc3dfcb84946 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.147466 Sep 14 19:44:44.930877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 260/548] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:44 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:45.135968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-86ed43b5-756d-4679-989b-9389faf7078b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:45.136656 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-86ed43b5-756d-4679-989b-9389faf7078b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:45.142909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86ed43b5-756d-4679-989b-9389faf7078b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:45.143373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86ed43b5-756d-4679-989b-9389faf7078b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:45.144136 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86ed43b5-756d-4679-989b-9389faf7078b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:45.144569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86ed43b5-756d-4679-989b-9389faf7078b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:45.273243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-86ed43b5-756d-4679-989b-9389faf7078b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:45.281132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-86ed43b5-756d-4679-989b-9389faf7078b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.148865 Sep 14 19:44:45.282186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 261/549] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:45 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:45.331107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c5769e75-f5fc-4be0-97bc-33385a1c810d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:45.331862 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c5769e75-f5fc-4be0-97bc-33385a1c810d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:45.340117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5769e75-f5fc-4be0-97bc-33385a1c810d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:45.340668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5769e75-f5fc-4be0-97bc-33385a1c810d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:45.341966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5769e75-f5fc-4be0-97bc-33385a1c810d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:45.342875 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5769e75-f5fc-4be0-97bc-33385a1c810d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:45.483648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c5769e75-f5fc-4be0-97bc-33385a1c810d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:45.491117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c5769e75-f5fc-4be0-97bc-33385a1c810d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.164274 Sep 14 19:44:45.491690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 262/550] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:45 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:45.703506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f3751b3c-23ff-4780-b254-297944ac8aa0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:45.704035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f3751b3c-23ff-4780-b254-297944ac8aa0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:45.710102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3751b3c-23ff-4780-b254-297944ac8aa0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:45.710554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3751b3c-23ff-4780-b254-297944ac8aa0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:45.711328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3751b3c-23ff-4780-b254-297944ac8aa0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:45.711827 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3751b3c-23ff-4780-b254-297944ac8aa0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:45.847701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f3751b3c-23ff-4780-b254-297944ac8aa0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:45.859756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f3751b3c-23ff-4780-b254-297944ac8aa0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:45.862222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f3751b3c-23ff-4780-b254-297944ac8aa0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:45.863867 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f3751b3c-23ff-4780-b254-297944ac8aa0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.164911 Sep 14 19:44:45.865713 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 263/551] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:45.947951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d4d2018d-c87c-4eae-a4dd-ebb9471a2ab7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:45.948676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d4d2018d-c87c-4eae-a4dd-ebb9471a2ab7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:45.955773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4d2018d-c87c-4eae-a4dd-ebb9471a2ab7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:45.956151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4d2018d-c87c-4eae-a4dd-ebb9471a2ab7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:45.956934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4d2018d-c87c-4eae-a4dd-ebb9471a2ab7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:45.957392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4d2018d-c87c-4eae-a4dd-ebb9471a2ab7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:46.093474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d4d2018d-c87c-4eae-a4dd-ebb9471a2ab7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:46.101516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d4d2018d-c87c-4eae-a4dd-ebb9471a2ab7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.157555 Sep 14 19:44:46.102284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 264/552] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:45 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:46.299785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-405d1709-0dc1-49c4-820a-d68c38e6bae8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:46.300477 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-405d1709-0dc1-49c4-820a-d68c38e6bae8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:46.306364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-405d1709-0dc1-49c4-820a-d68c38e6bae8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:46.306815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-405d1709-0dc1-49c4-820a-d68c38e6bae8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:46.307591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-405d1709-0dc1-49c4-820a-d68c38e6bae8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:46.308025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-405d1709-0dc1-49c4-820a-d68c38e6bae8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:46.465345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-405d1709-0dc1-49c4-820a-d68c38e6bae8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:46.472869 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-405d1709-0dc1-49c4-820a-d68c38e6bae8 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.177024 Sep 14 19:44:46.473436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 265/553] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:46 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:46.507723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-09207282-1cf2-4031-b5c8-de49b12d9a47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:46.508321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-09207282-1cf2-4031-b5c8-de49b12d9a47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:46.514129 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09207282-1cf2-4031-b5c8-de49b12d9a47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:46.515155 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09207282-1cf2-4031-b5c8-de49b12d9a47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:46.515370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09207282-1cf2-4031-b5c8-de49b12d9a47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:46.515812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09207282-1cf2-4031-b5c8-de49b12d9a47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:46.658167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-09207282-1cf2-4031-b5c8-de49b12d9a47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:46.665609 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-09207282-1cf2-4031-b5c8-de49b12d9a47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.161443 Sep 14 19:44:46.666180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 266/554] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:46 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:46.883531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-094190a4-4816-4622-9c04-9a82cc04c908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:46.884138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-094190a4-4816-4622-9c04-9a82cc04c908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:46.891852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-094190a4-4816-4622-9c04-9a82cc04c908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:46.892301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-094190a4-4816-4622-9c04-9a82cc04c908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:46.893081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-094190a4-4816-4622-9c04-9a82cc04c908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:46.893526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-094190a4-4816-4622-9c04-9a82cc04c908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:47.024802 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-094190a4-4816-4622-9c04-9a82cc04c908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:47.034495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-094190a4-4816-4622-9c04-9a82cc04c908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:47.036015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-094190a4-4816-4622-9c04-9a82cc04c908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:47.037401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-094190a4-4816-4622-9c04-9a82cc04c908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.157901 Sep 14 19:44:47.038589 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 267/555] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:47.191757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-097d1b1a-b110-4417-a882-1d445e28b89a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:47.191757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-097d1b1a-b110-4417-a882-1d445e28b89a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:47.191757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-097d1b1a-b110-4417-a882-1d445e28b89a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:47.191757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-097d1b1a-b110-4417-a882-1d445e28b89a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:47.192362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-097d1b1a-b110-4417-a882-1d445e28b89a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:47.192362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-097d1b1a-b110-4417-a882-1d445e28b89a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:47.276581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-097d1b1a-b110-4417-a882-1d445e28b89a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:47.277655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-097d1b1a-b110-4417-a882-1d445e28b89a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.162241 Sep 14 19:44:47.278611 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 268/556] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:47 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:47.491037 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bb5d0809-6249-4101-955f-fcc4f060890e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:47.491861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bb5d0809-6249-4101-955f-fcc4f060890e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:47.500075 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb5d0809-6249-4101-955f-fcc4f060890e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:47.500586 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb5d0809-6249-4101-955f-fcc4f060890e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:47.503180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb5d0809-6249-4101-955f-fcc4f060890e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:47.503850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb5d0809-6249-4101-955f-fcc4f060890e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:47.662677 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bb5d0809-6249-4101-955f-fcc4f060890e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:47.670306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bb5d0809-6249-4101-955f-fcc4f060890e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.183750 Sep 14 19:44:47.670887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 269/557] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:47 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:47.675947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1677093e-37e5-451d-8d8e-e193d9143fc1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36bd72e3-08dc-4ac4-b4a0-72d4b49aab9d", "device": "/dev/sdb"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:47.677743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1677093e-37e5-451d-8d8e-e193d9143fc1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:47.683972 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1677093e-37e5-451d-8d8e-e193d9143fc1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:47.684424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1677093e-37e5-451d-8d8e-e193d9143fc1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:47.685187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1677093e-37e5-451d-8d8e-e193d9143fc1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:47.686210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1677093e-37e5-451d-8d8e-e193d9143fc1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:50.620965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dbc11b82-9408-4a2c-884e-8ed16c95c92b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 29348 microversion: 2.1 time: 13.042145 Sep 14 19:44:50.622101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 289/558] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:37 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 29348 bytes in 13044 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:50.628001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b7956bb0-2c03-4a40-8647-e7979edb5eb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:50.628697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b7956bb0-2c03-4a40-8647-e7979edb5eb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:50.635687 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7956bb0-2c03-4a40-8647-e7979edb5eb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:50.641445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7956bb0-2c03-4a40-8647-e7979edb5eb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:50.641445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7956bb0-2c03-4a40-8647-e7979edb5eb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:50.641445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7956bb0-2c03-4a40-8647-e7979edb5eb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:51.067465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b7956bb0-2c03-4a40-8647-e7979edb5eb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:51.075390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b7956bb0-2c03-4a40-8647-e7979edb5eb4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.451818 Sep 14 19:44:51.076623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 290/559] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:50 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:51.095826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4f9b0ff5-8d8d-4bdd-b587-793ef2715530 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:51.096740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4f9b0ff5-8d8d-4bdd-b587-793ef2715530 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:51.103890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f9b0ff5-8d8d-4bdd-b587-793ef2715530 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:51.104620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f9b0ff5-8d8d-4bdd-b587-793ef2715530 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:51.105677 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f9b0ff5-8d8d-4bdd-b587-793ef2715530 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:51.106318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f9b0ff5-8d8d-4bdd-b587-793ef2715530 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:51.264930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4f9b0ff5-8d8d-4bdd-b587-793ef2715530 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:51.281857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4f9b0ff5-8d8d-4bdd-b587-793ef2715530 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:51.285095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4f9b0ff5-8d8d-4bdd-b587-793ef2715530 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:51.287122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4f9b0ff5-8d8d-4bdd-b587-793ef2715530 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1751 microversion: 2.20 time: 0.209072 Sep 14 19:44:51.288864 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 291/560] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:51 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:51.298272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2ff92f9d-5489-427b-8ed1-fe938bcf3c4a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:51.299813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2ff92f9d-5489-427b-8ed1-fe938bcf3c4a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:51.312876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ff92f9d-5489-427b-8ed1-fe938bcf3c4a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:51.313913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ff92f9d-5489-427b-8ed1-fe938bcf3c4a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:51.315743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ff92f9d-5489-427b-8ed1-fe938bcf3c4a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:51.317126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ff92f9d-5489-427b-8ed1-fe938bcf3c4a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:51.550301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1677093e-37e5-451d-8d8e-e193d9143fc1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "POST /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.876775 Sep 14 19:44:51.552090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 270/561] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Sep 14 19:44:47 2021] POST /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e/os-volume_attachments => generated 194 bytes in 3880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:44:51.565206 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5d62887e-caf0-4098-8ac9-b5ec2e4c4557 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:51.566526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5d62887e-caf0-4098-8ac9-b5ec2e4c4557 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:51.583125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d62887e-caf0-4098-8ac9-b5ec2e4c4557 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:51.584441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d62887e-caf0-4098-8ac9-b5ec2e4c4557 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:51.585599 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d62887e-caf0-4098-8ac9-b5ec2e4c4557 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:51.586262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d62887e-caf0-4098-8ac9-b5ec2e4c4557 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:51.804828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5d62887e-caf0-4098-8ac9-b5ec2e4c4557 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:51.814247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5d62887e-caf0-4098-8ac9-b5ec2e4c4557 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.260603 Sep 14 19:44:51.815138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 271/562] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:51 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:51.819748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-18a592f9-f16d-4c4a-8aec-e1b49cfd2d84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:51.821133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-18a592f9-f16d-4c4a-8aec-e1b49cfd2d84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:51.827719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18a592f9-f16d-4c4a-8aec-e1b49cfd2d84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:51.828161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18a592f9-f16d-4c4a-8aec-e1b49cfd2d84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:51.828945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18a592f9-f16d-4c4a-8aec-e1b49cfd2d84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:51.829773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18a592f9-f16d-4c4a-8aec-e1b49cfd2d84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:51.930830 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2ff92f9d-5489-427b-8ed1-fe938bcf3c4a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:51.943459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2ff92f9d-5489-427b-8ed1-fe938bcf3c4a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.652751 Sep 14 19:44:51.944473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 292/563] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:51 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:51.976198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-18a592f9-f16d-4c4a-8aec-e1b49cfd2d84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 30517 microversion: 2.1 time: 0.159379 Sep 14 19:44:51.977248 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 272/564] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:51 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 30517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:52.092624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fdb247f2-e307-44ae-9d63-c318381c1251 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:52.093251 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fdb247f2-e307-44ae-9d63-c318381c1251 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:52.099986 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdb247f2-e307-44ae-9d63-c318381c1251 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:52.100439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdb247f2-e307-44ae-9d63-c318381c1251 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:52.101297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdb247f2-e307-44ae-9d63-c318381c1251 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:52.101774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdb247f2-e307-44ae-9d63-c318381c1251 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:52.289660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-90589db5-8bce-4cf0-919e-cfd1fa62d879 req-f2846fa6-44da-418a-b588-a31bc7ff5d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281", "tag": "69da7992-0bf2-4642-a9ae-536e8e8fa62f"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:52.298686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:44:52.298686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:44:52.322687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-90589db5-8bce-4cf0-919e-cfd1fa62d879 req-f2846fa6-44da-418a-b588-a31bc7ff5d6f service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:52.323616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-90589db5-8bce-4cf0-919e-cfd1fa62d879 req-f2846fa6-44da-418a-b588-a31bc7ff5d6f service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:52.346007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-90589db5-8bce-4cf0-919e-cfd1fa62d879 req-f2846fa6-44da-418a-b588-a31bc7ff5d6f service nova] Creating event network-changed:69da7992-0bf2-4642-a9ae-536e8e8fa62f for instance c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 on hv-cinder-80588 Sep 14 19:44:52.356158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-90589db5-8bce-4cf0-919e-cfd1fa62d879 req-f2846fa6-44da-418a-b588-a31bc7ff5d6f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087113 Sep 14 19:44:52.356467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-fdb247f2-e307-44ae-9d63-c318381c1251 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:52.357081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 273/565] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:44:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:44:52.363910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b25f55fe-a177-4bea-9977-2452b66301ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:52.368224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fdb247f2-e307-44ae-9d63-c318381c1251 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.279263 Sep 14 19:44:52.369652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 293/566] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:52 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:52.371158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b25f55fe-a177-4bea-9977-2452b66301ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:52.377886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b25f55fe-a177-4bea-9977-2452b66301ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:52.378596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b25f55fe-a177-4bea-9977-2452b66301ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:52.379570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b25f55fe-a177-4bea-9977-2452b66301ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:52.381099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b25f55fe-a177-4bea-9977-2452b66301ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:52.532961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b25f55fe-a177-4bea-9977-2452b66301ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:52.543165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b25f55fe-a177-4bea-9977-2452b66301ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:52.545881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b25f55fe-a177-4bea-9977-2452b66301ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:52.547822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b25f55fe-a177-4bea-9977-2452b66301ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.188627 Sep 14 19:44:52.548998 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 274/567] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:52.833135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-40d0c6b9-5f5f-4748-8497-71c1df730591 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:52.833953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-40d0c6b9-5f5f-4748-8497-71c1df730591 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:52.844413 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40d0c6b9-5f5f-4748-8497-71c1df730591 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:52.845225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40d0c6b9-5f5f-4748-8497-71c1df730591 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:52.846657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40d0c6b9-5f5f-4748-8497-71c1df730591 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:52.847491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40d0c6b9-5f5f-4748-8497-71c1df730591 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:52.962297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-269870a0-b445-4269-81ad-7aaa389c0786 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:52.963104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-269870a0-b445-4269-81ad-7aaa389c0786 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:52.970234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-269870a0-b445-4269-81ad-7aaa389c0786 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:52.971049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-269870a0-b445-4269-81ad-7aaa389c0786 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:52.971922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-269870a0-b445-4269-81ad-7aaa389c0786 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:52.972518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-269870a0-b445-4269-81ad-7aaa389c0786 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.155736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-40d0c6b9-5f5f-4748-8497-71c1df730591 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:53.163827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-40d0c6b9-5f5f-4748-8497-71c1df730591 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.334004 Sep 14 19:44:53.165322 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 294/568] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:52 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:53.170417 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-59e53c28-c9e6-4656-93a9-a317eaf04052 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:53.172011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-59e53c28-c9e6-4656-93a9-a317eaf04052 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:53.179026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59e53c28-c9e6-4656-93a9-a317eaf04052 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.179473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59e53c28-c9e6-4656-93a9-a317eaf04052 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.180259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59e53c28-c9e6-4656-93a9-a317eaf04052 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.180763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59e53c28-c9e6-4656-93a9-a317eaf04052 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.192411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-269870a0-b445-4269-81ad-7aaa389c0786 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:53.203974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-269870a0-b445-4269-81ad-7aaa389c0786 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1548 microversion: 2.1 time: 0.246333 Sep 14 19:44:53.205074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 275/569] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:52 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1548 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:53.230067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bc35bfe2-0b0e-4c28-afe9-8685f261eff5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:53.230953 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bc35bfe2-0b0e-4c28-afe9-8685f261eff5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:53.242480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc35bfe2-0b0e-4c28-afe9-8685f261eff5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.243175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc35bfe2-0b0e-4c28-afe9-8685f261eff5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.244566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc35bfe2-0b0e-4c28-afe9-8685f261eff5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.245351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc35bfe2-0b0e-4c28-afe9-8685f261eff5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.301821 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-59e53c28-c9e6-4656-93a9-a317eaf04052 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 31503 microversion: 2.1 time: 0.136008 Sep 14 19:44:53.302464 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 295/570] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:53 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 31503 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:53.393782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-572ccdaa-d1af-4910-959e-07d48863aa3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:53.394885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-572ccdaa-d1af-4910-959e-07d48863aa3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:53.406755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-572ccdaa-d1af-4910-959e-07d48863aa3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.407713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-572ccdaa-d1af-4910-959e-07d48863aa3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.409481 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-572ccdaa-d1af-4910-959e-07d48863aa3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.410657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-572ccdaa-d1af-4910-959e-07d48863aa3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.411319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-bc35bfe2-0b0e-4c28-afe9-8685f261eff5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] HTTP exception thrown: Cannot 'detach_volume' instance 0b9185a2-5afd-4c39-bb28-beb531d58eb0 while it is in vm_state rescued Sep 14 19:44:53.412095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bc35bfe2-0b0e-4c28-afe9-8685f261eff5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Returning 409 to user: Cannot 'detach_volume' instance 0b9185a2-5afd-4c39-bb28-beb531d58eb0 while it is in vm_state rescued {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:44:53.413009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bc35bfe2-0b0e-4c28-afe9-8685f261eff5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments/84a2e904-704f-4ae0-aa81-f36e65581850" status: 409 len: 152 microversion: 2.1 time: 0.190388 Sep 14 19:44:53.414719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 276/571] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Sep 14 19:44:53 2021] DELETE /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments/84a2e904-704f-4ae0-aa81-f36e65581850 => generated 152 bytes in 193 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 19:44:53.430700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-22c27696-7a7b-42f1-861a-d8cbc138aba9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:53.431628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-22c27696-7a7b-42f1-861a-d8cbc138aba9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:53.440237 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22c27696-7a7b-42f1-861a-d8cbc138aba9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.441034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22c27696-7a7b-42f1-861a-d8cbc138aba9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.442942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22c27696-7a7b-42f1-861a-d8cbc138aba9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.443723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22c27696-7a7b-42f1-861a-d8cbc138aba9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.709625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-22c27696-7a7b-42f1-861a-d8cbc138aba9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/action" status: 202 len: 0 microversion: 2.1 time: 0.285351 Sep 14 19:44:53.714745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 277/572] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:53 2021] POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:44:53.721744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3a792c09-c236-4ce3-a6c8-2be46ee67805 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:53.722964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3a792c09-c236-4ce3-a6c8-2be46ee67805 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:53.731652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a792c09-c236-4ce3-a6c8-2be46ee67805 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.732101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a792c09-c236-4ce3-a6c8-2be46ee67805 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.733616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a792c09-c236-4ce3-a6c8-2be46ee67805 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.734088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a792c09-c236-4ce3-a6c8-2be46ee67805 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.859158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-572ccdaa-d1af-4910-959e-07d48863aa3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:53.869345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-572ccdaa-d1af-4910-959e-07d48863aa3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1317 microversion: 2.1 time: 0.480275 Sep 14 19:44:53.870025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 296/573] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:53 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:53.876649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-13b58c33-c44e-4a21-8607-a6da717740d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:53.877314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-13b58c33-c44e-4a21-8607-a6da717740d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:53.889317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13b58c33-c44e-4a21-8607-a6da717740d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.889317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13b58c33-c44e-4a21-8607-a6da717740d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.889317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13b58c33-c44e-4a21-8607-a6da717740d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:53.889317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13b58c33-c44e-4a21-8607-a6da717740d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:53.956935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3a792c09-c236-4ce3-a6c8-2be46ee67805 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:53.956935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3a792c09-c236-4ce3-a6c8-2be46ee67805 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:53.957154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3a792c09-c236-4ce3-a6c8-2be46ee67805 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:53.957154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3a792c09-c236-4ce3-a6c8-2be46ee67805 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.239606 Sep 14 19:44:53.964945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 278/574] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:53 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:54.130582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-13b58c33-c44e-4a21-8607-a6da717740d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:54.140386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-13b58c33-c44e-4a21-8607-a6da717740d8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1556 microversion: 2.1 time: 0.268958 Sep 14 19:44:54.141349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 297/575] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:53 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1556 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:54.181558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b8ca3036-3f6c-49da-9d14-c1761388bf3e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:54.182181 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b8ca3036-3f6c-49da-9d14-c1761388bf3e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:54.189366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b8ca3036-3f6c-49da-9d14-c1761388bf3e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:54.189366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b8ca3036-3f6c-49da-9d14-c1761388bf3e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:54.189774 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b8ca3036-3f6c-49da-9d14-c1761388bf3e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:54.190247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b8ca3036-3f6c-49da-9d14-c1761388bf3e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:54.316848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c09b2077-a234-473e-87e2-5f5283993d0e tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:54.318056 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c09b2077-a234-473e-87e2-5f5283993d0e tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:54.328999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c09b2077-a234-473e-87e2-5f5283993d0e tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:54.357770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c09b2077-a234-473e-87e2-5f5283993d0e tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:54.357770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c09b2077-a234-473e-87e2-5f5283993d0e tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:54.357770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c09b2077-a234-473e-87e2-5f5283993d0e tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:54.403320 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b8ca3036-3f6c-49da-9d14-c1761388bf3e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:54.414818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b8ca3036-3f6c-49da-9d14-c1761388bf3e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.236858 Sep 14 19:44:54.416441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 279/576] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:54 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:44:54.470955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c09b2077-a234-473e-87e2-5f5283993d0e tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 32496 microversion: 2.1 time: 0.157457 Sep 14 19:44:54.503868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 298/577] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:54 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 32496 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:44:54.888308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-36d7a8c8-d1e2-4028-b571-321fab936586 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:54.889856 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-36d7a8c8-d1e2-4028-b571-321fab936586 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:54.908370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36d7a8c8-d1e2-4028-b571-321fab936586 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:54.908957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36d7a8c8-d1e2-4028-b571-321fab936586 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:54.909906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36d7a8c8-d1e2-4028-b571-321fab936586 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:54.910477 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36d7a8c8-d1e2-4028-b571-321fab936586 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:54.992095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-53a62ebb-dd76-4bae-8493-f82818b828ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:54.997678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-53a62ebb-dd76-4bae-8493-f82818b828ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:55.022611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-53a62ebb-dd76-4bae-8493-f82818b828ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:55.023767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-53a62ebb-dd76-4bae-8493-f82818b828ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:55.025442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-53a62ebb-dd76-4bae-8493-f82818b828ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:55.026540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-53a62ebb-dd76-4bae-8493-f82818b828ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:55.156856 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-36d7a8c8-d1e2-4028-b571-321fab936586 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:55.171611 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-36d7a8c8-d1e2-4028-b571-321fab936586 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1508 microversion: 2.1 time: 0.285337 Sep 14 19:44:55.184105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 280/578] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:54 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:55.184105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7f9699e9-2bf1-4bbd-b369-0f951e215b45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:55.184105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7f9699e9-2bf1-4bbd-b369-0f951e215b45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:55.191313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f9699e9-2bf1-4bbd-b369-0f951e215b45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:55.191773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f9699e9-2bf1-4bbd-b369-0f951e215b45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:55.192588 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f9699e9-2bf1-4bbd-b369-0f951e215b45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:55.193027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f9699e9-2bf1-4bbd-b369-0f951e215b45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:55.248694 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-53a62ebb-dd76-4bae-8493-f82818b828ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:55.261212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-53a62ebb-dd76-4bae-8493-f82818b828ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:55.263156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-53a62ebb-dd76-4bae-8493-f82818b828ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:55.265112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-53a62ebb-dd76-4bae-8493-f82818b828ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.284975 Sep 14 19:44:55.266372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 299/579] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:44:55.384202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7f9699e9-2bf1-4bbd-b369-0f951e215b45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:55.392445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7f9699e9-2bf1-4bbd-b369-0f951e215b45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1556 microversion: 2.1 time: 0.213452 Sep 14 19:44:55.393035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 281/580] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:55 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:55.436958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f27a640c-4a7f-410e-ac5a-a12a11c14c04 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:55.439286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f27a640c-4a7f-410e-ac5a-a12a11c14c04 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:55.450897 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f27a640c-4a7f-410e-ac5a-a12a11c14c04 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:55.452339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f27a640c-4a7f-410e-ac5a-a12a11c14c04 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:55.454470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f27a640c-4a7f-410e-ac5a-a12a11c14c04 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:55.455294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f27a640c-4a7f-410e-ac5a-a12a11c14c04 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:55.488065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dfa4809b-98ca-48c9-b5b8-ba0cfde43668 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:55.489940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dfa4809b-98ca-48c9-b5b8-ba0cfde43668 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:55.500606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dfa4809b-98ca-48c9-b5b8-ba0cfde43668 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:55.501774 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dfa4809b-98ca-48c9-b5b8-ba0cfde43668 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:55.503134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dfa4809b-98ca-48c9-b5b8-ba0cfde43668 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:55.503849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dfa4809b-98ca-48c9-b5b8-ba0cfde43668 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:55.631320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f27a640c-4a7f-410e-ac5a-a12a11c14c04 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:55.639464 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f27a640c-4a7f-410e-ac5a-a12a11c14c04 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.209828 Sep 14 19:44:55.640074 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 300/581] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:55 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:56.285240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b149b370-8bcd-4b34-a2a1-dc7af82a7ca4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:56.285977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b149b370-8bcd-4b34-a2a1-dc7af82a7ca4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:56.292802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b149b370-8bcd-4b34-a2a1-dc7af82a7ca4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:56.293252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b149b370-8bcd-4b34-a2a1-dc7af82a7ca4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:56.294091 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b149b370-8bcd-4b34-a2a1-dc7af82a7ca4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:56.295204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b149b370-8bcd-4b34-a2a1-dc7af82a7ca4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:56.457429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b149b370-8bcd-4b34-a2a1-dc7af82a7ca4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:56.466165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b149b370-8bcd-4b34-a2a1-dc7af82a7ca4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:56.481411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b149b370-8bcd-4b34-a2a1-dc7af82a7ca4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:56.481411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b149b370-8bcd-4b34-a2a1-dc7af82a7ca4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.188550 Sep 14 19:44:56.481411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 301/582] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:44:56 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:44:56.481411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5869ae47-bf18-40b8-8c2c-08f51767c699 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:56.481883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5869ae47-bf18-40b8-8c2c-08f51767c699 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:56.481883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5869ae47-bf18-40b8-8c2c-08f51767c699 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:56.481883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5869ae47-bf18-40b8-8c2c-08f51767c699 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:56.482713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5869ae47-bf18-40b8-8c2c-08f51767c699 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:56.483146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5869ae47-bf18-40b8-8c2c-08f51767c699 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:56.660404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5869ae47-bf18-40b8-8c2c-08f51767c699 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:56.670076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5869ae47-bf18-40b8-8c2c-08f51767c699 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1556 microversion: 2.1 time: 0.198622 Sep 14 19:44:56.670542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 302/583] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:56 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1556 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:56.675362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-43b25d4b-e13c-4f14-ad25-d7d2d6548f8f tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:44:56.675974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-43b25d4b-e13c-4f14-ad25-d7d2d6548f8f tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:56.683424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-43b25d4b-e13c-4f14-ad25-d7d2d6548f8f tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:56.683937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-43b25d4b-e13c-4f14-ad25-d7d2d6548f8f tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:56.685103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-43b25d4b-e13c-4f14-ad25-d7d2d6548f8f tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:56.686299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-43b25d4b-e13c-4f14-ad25-d7d2d6548f8f tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:56.855140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-43b25d4b-e13c-4f14-ad25-d7d2d6548f8f tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:44:56.864368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-43b25d4b-e13c-4f14-ad25-d7d2d6548f8f tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.192705 Sep 14 19:44:56.865022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 303/584] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:44:56 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:44:56.885037 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-317cd30e-de16-48c4-92fc-9f95b1049aa2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8158e22-8c89-4115-bde6-48f56d640235"}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:44:56.886282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-317cd30e-de16-48c4-92fc-9f95b1049aa2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:44:56.892870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-317cd30e-de16-48c4-92fc-9f95b1049aa2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:56.893324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-317cd30e-de16-48c4-92fc-9f95b1049aa2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:44:56.894252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-317cd30e-de16-48c4-92fc-9f95b1049aa2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:44:56.894710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-317cd30e-de16-48c4-92fc-9f95b1049aa2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:09.053322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dfa4809b-98ca-48c9-b5b8-ba0cfde43668 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action" status: 200 len: 38239 microversion: 2.1 time: 13.569101 Sep 14 19:45:09.054236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 282/585] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:44:55 2021] POST /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/action => generated 38239 bytes in 13572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:45:09.059286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4b019fe8-b863-40a0-aafe-21faa6b3eb67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:09.063766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4b019fe8-b863-40a0-aafe-21faa6b3eb67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:09.068079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b019fe8-b863-40a0-aafe-21faa6b3eb67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:09.068536 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b019fe8-b863-40a0-aafe-21faa6b3eb67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:09.069333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b019fe8-b863-40a0-aafe-21faa6b3eb67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:09.069801 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b019fe8-b863-40a0-aafe-21faa6b3eb67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:09.200362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4b019fe8-b863-40a0-aafe-21faa6b3eb67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:09.209732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4b019fe8-b863-40a0-aafe-21faa6b3eb67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:09.211279 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4b019fe8-b863-40a0-aafe-21faa6b3eb67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:09.212547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4b019fe8-b863-40a0-aafe-21faa6b3eb67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.157120 Sep 14 19:45:09.213207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 283/586] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:09.219293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b587d44f-a2af-420c-a72e-2081f82c5451 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:09.220693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b587d44f-a2af-420c-a72e-2081f82c5451 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:09.238436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b587d44f-a2af-420c-a72e-2081f82c5451 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:09.238916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b587d44f-a2af-420c-a72e-2081f82c5451 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:09.239737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b587d44f-a2af-420c-a72e-2081f82c5451 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:09.240472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b587d44f-a2af-420c-a72e-2081f82c5451 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:09.380463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b587d44f-a2af-420c-a72e-2081f82c5451 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:09.388987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b587d44f-a2af-420c-a72e-2081f82c5451 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1556 microversion: 2.1 time: 0.174343 Sep 14 19:45:09.389593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 284/587] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:09 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:09.393967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-751b8f7c-9608-4173-96cc-cc357ecfda64 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:09.401260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-751b8f7c-9608-4173-96cc-cc357ecfda64 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:09.401260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-751b8f7c-9608-4173-96cc-cc357ecfda64 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:09.401260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-751b8f7c-9608-4173-96cc-cc357ecfda64 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:09.401965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-751b8f7c-9608-4173-96cc-cc357ecfda64 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:09.402425 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-751b8f7c-9608-4173-96cc-cc357ecfda64 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:09.544511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-751b8f7c-9608-4173-96cc-cc357ecfda64 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:09.556999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-751b8f7c-9608-4173-96cc-cc357ecfda64 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.166225 Sep 14 19:45:09.557653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 285/588] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:09 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:09.562179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-865a6464-67ff-4d15-b4b7-5082ad0b1f21 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:09.562667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-865a6464-67ff-4d15-b4b7-5082ad0b1f21 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:09.569854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-865a6464-67ff-4d15-b4b7-5082ad0b1f21 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:09.570307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-865a6464-67ff-4d15-b4b7-5082ad0b1f21 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:09.571096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-865a6464-67ff-4d15-b4b7-5082ad0b1f21 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:09.571529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-865a6464-67ff-4d15-b4b7-5082ad0b1f21 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:09.597800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-865a6464-67ff-4d15-b4b7-5082ad0b1f21 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/ips" status: 200 len: 145 microversion: 2.1 time: 0.038062 Sep 14 19:45:09.597800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 286/589] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Sep 14 19:45:09 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:09.713416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-317cd30e-de16-48c4-92fc-9f95b1049aa2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "POST /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.832100 Sep 14 19:45:09.714236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 304/590] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Sep 14 19:44:56 2021] POST /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 194 bytes in 12834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:45:10.240548 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3af210d4-2ef9-4da5-947d-b7d4e0b7198c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:10.241146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3af210d4-2ef9-4da5-947d-b7d4e0b7198c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:10.248063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3af210d4-2ef9-4da5-947d-b7d4e0b7198c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:10.248509 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3af210d4-2ef9-4da5-947d-b7d4e0b7198c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:10.249268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3af210d4-2ef9-4da5-947d-b7d4e0b7198c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:10.249728 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3af210d4-2ef9-4da5-947d-b7d4e0b7198c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:10.369577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3af210d4-2ef9-4da5-947d-b7d4e0b7198c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:10.378431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3af210d4-2ef9-4da5-947d-b7d4e0b7198c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:10.379893 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3af210d4-2ef9-4da5-947d-b7d4e0b7198c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:10.381046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3af210d4-2ef9-4da5-947d-b7d4e0b7198c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.144249 Sep 14 19:45:10.381623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 287/591] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:10.406699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-675b9a2a-db6f-4703-9ce6-9aa59c201f45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:10.407401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-675b9a2a-db6f-4703-9ce6-9aa59c201f45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:10.414720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-675b9a2a-db6f-4703-9ce6-9aa59c201f45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:10.415173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-675b9a2a-db6f-4703-9ce6-9aa59c201f45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:10.416245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-675b9a2a-db6f-4703-9ce6-9aa59c201f45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:10.416686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-675b9a2a-db6f-4703-9ce6-9aa59c201f45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:10.541253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-675b9a2a-db6f-4703-9ce6-9aa59c201f45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:10.549943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-675b9a2a-db6f-4703-9ce6-9aa59c201f45 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1556 microversion: 2.1 time: 0.147943 Sep 14 19:45:10.557036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 305/592] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:10 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1556 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:10.573563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-aa1e764d-723a-43f7-85dc-59e16ff9c636 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:10.574174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-aa1e764d-723a-43f7-85dc-59e16ff9c636 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:10.580708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa1e764d-723a-43f7-85dc-59e16ff9c636 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:10.581154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa1e764d-723a-43f7-85dc-59e16ff9c636 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:10.581987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa1e764d-723a-43f7-85dc-59e16ff9c636 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:10.582421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa1e764d-723a-43f7-85dc-59e16ff9c636 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:10.707056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-aa1e764d-723a-43f7-85dc-59e16ff9c636 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:10.714356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-aa1e764d-723a-43f7-85dc-59e16ff9c636 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.144403 Sep 14 19:45:10.714933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 288/593] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:10 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:11.399736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1e256ef5-40f6-4564-a2f1-71b61653efb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:11.400349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1e256ef5-40f6-4564-a2f1-71b61653efb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:11.406675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e256ef5-40f6-4564-a2f1-71b61653efb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:11.407134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e256ef5-40f6-4564-a2f1-71b61653efb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:11.407920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e256ef5-40f6-4564-a2f1-71b61653efb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:11.408582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e256ef5-40f6-4564-a2f1-71b61653efb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:11.558975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1e256ef5-40f6-4564-a2f1-71b61653efb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:11.569103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1e256ef5-40f6-4564-a2f1-71b61653efb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:11.570632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1e256ef5-40f6-4564-a2f1-71b61653efb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:11.572566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1e256ef5-40f6-4564-a2f1-71b61653efb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.176660 Sep 14 19:45:11.573277 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 306/594] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:11 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:11.579049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-943e01ca-f62f-4132-a6ee-5f2404a4d452 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:11.581740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-943e01ca-f62f-4132-a6ee-5f2404a4d452 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:11.601961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-943e01ca-f62f-4132-a6ee-5f2404a4d452 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:11.602408 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-943e01ca-f62f-4132-a6ee-5f2404a4d452 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:11.603855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-943e01ca-f62f-4132-a6ee-5f2404a4d452 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:11.604289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-943e01ca-f62f-4132-a6ee-5f2404a4d452 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:11.732244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2938ff87-9aca-40e0-aa05-346596e3e4ff tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:11.733166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2938ff87-9aca-40e0-aa05-346596e3e4ff tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:11.734348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-943e01ca-f62f-4132-a6ee-5f2404a4d452 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:11.740595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2938ff87-9aca-40e0-aa05-346596e3e4ff tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:11.741159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2938ff87-9aca-40e0-aa05-346596e3e4ff tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:11.742247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2938ff87-9aca-40e0-aa05-346596e3e4ff tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:11.742856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2938ff87-9aca-40e0-aa05-346596e3e4ff tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:11.747122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-943e01ca-f62f-4132-a6ee-5f2404a4d452 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1556 microversion: 2.1 time: 0.183971 Sep 14 19:45:11.748597 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 289/595] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:45:11.883842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2938ff87-9aca-40e0-aa05-346596e3e4ff tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:11.891770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2938ff87-9aca-40e0-aa05-346596e3e4ff tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.164503 Sep 14 19:45:11.892349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 307/596] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:11 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:45:12.601223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-806a53bd-f09a-465a-bb0a-dbd069fdf281 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:12.601855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-806a53bd-f09a-465a-bb0a-dbd069fdf281 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:12.608284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-806a53bd-f09a-465a-bb0a-dbd069fdf281 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:12.608731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-806a53bd-f09a-465a-bb0a-dbd069fdf281 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:12.609529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-806a53bd-f09a-465a-bb0a-dbd069fdf281 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:12.609980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-806a53bd-f09a-465a-bb0a-dbd069fdf281 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:12.732984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-806a53bd-f09a-465a-bb0a-dbd069fdf281 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:12.741525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-806a53bd-f09a-465a-bb0a-dbd069fdf281 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:12.743057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-806a53bd-f09a-465a-bb0a-dbd069fdf281 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:12.744277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-806a53bd-f09a-465a-bb0a-dbd069fdf281 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.146848 Sep 14 19:45:12.745049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 290/597] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:12 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:12.775643 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-76b26343-262a-4bbc-9043-9b96a857f18a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:12.776672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-76b26343-262a-4bbc-9043-9b96a857f18a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:12.788241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76b26343-262a-4bbc-9043-9b96a857f18a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:12.789058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76b26343-262a-4bbc-9043-9b96a857f18a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:12.790506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76b26343-262a-4bbc-9043-9b96a857f18a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:12.791309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76b26343-262a-4bbc-9043-9b96a857f18a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:12.908399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2457ffc0-e9ab-4e59-97c7-0dbda51d5e05 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:12.909310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2457ffc0-e9ab-4e59-97c7-0dbda51d5e05 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:12.915240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2457ffc0-e9ab-4e59-97c7-0dbda51d5e05 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:12.915965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2457ffc0-e9ab-4e59-97c7-0dbda51d5e05 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:12.916951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2457ffc0-e9ab-4e59-97c7-0dbda51d5e05 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:12.917595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2457ffc0-e9ab-4e59-97c7-0dbda51d5e05 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:12.936401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-76b26343-262a-4bbc-9043-9b96a857f18a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:12.947895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-76b26343-262a-4bbc-9043-9b96a857f18a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1562 microversion: 2.1 time: 0.178988 Sep 14 19:45:12.956585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 308/598] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:12 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:12.990960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-1e8e68c3-c4f0-4e2f-a112-6ef8879ed0ad req-59aa523e-ee6f-4798-966d-cefc141d3c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281", "name": "network-vif-plugged", "status": "completed", "tag": "69da7992-0bf2-4642-a9ae-536e8e8fa62f"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:45:12.992833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:45:12.992833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:45:13.001127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-1e8e68c3-c4f0-4e2f-a112-6ef8879ed0ad req-59aa523e-ee6f-4798-966d-cefc141d3c47 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:13.001938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-1e8e68c3-c4f0-4e2f-a112-6ef8879ed0ad req-59aa523e-ee6f-4798-966d-cefc141d3c47 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:13.014655 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-1e8e68c3-c4f0-4e2f-a112-6ef8879ed0ad req-59aa523e-ee6f-4798-966d-cefc141d3c47 service nova] Creating event network-vif-plugged:69da7992-0bf2-4642-a9ae-536e8e8fa62f for instance c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 on hv-cinder-80588 Sep 14 19:45:13.022605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-1e8e68c3-c4f0-4e2f-a112-6ef8879ed0ad req-59aa523e-ee6f-4798-966d-cefc141d3c47 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035497 Sep 14 19:45:13.024023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 309/599] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:45:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:45:13.031651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-98900dc7-df77-4583-941b-fbbd7ff723ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:13.032235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-98900dc7-df77-4583-941b-fbbd7ff723ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:13.039360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98900dc7-df77-4583-941b-fbbd7ff723ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:13.039961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98900dc7-df77-4583-941b-fbbd7ff723ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:13.040842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98900dc7-df77-4583-941b-fbbd7ff723ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:13.041359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98900dc7-df77-4583-941b-fbbd7ff723ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:13.069897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2457ffc0-e9ab-4e59-97c7-0dbda51d5e05 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:13.078087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2457ffc0-e9ab-4e59-97c7-0dbda51d5e05 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.173543 Sep 14 19:45:13.078664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 291/600] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:12 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:45:13.134529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-98900dc7-df77-4583-941b-fbbd7ff723ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lazy-loading 'services' on Instance uuid 0b9185a2-5afd-4c39-bb28-beb531d58eb0 {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:45:13.388705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-98900dc7-df77-4583-941b-fbbd7ff723ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments/84a2e904-704f-4ae0-aa81-f36e65581850" status: 202 len: 0 microversion: 2.1 time: 0.360665 Sep 14 19:45:13.389316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 310/601] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Sep 14 19:45:13 2021] DELETE /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments/84a2e904-704f-4ae0-aa81-f36e65581850 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:45:13.397765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5be5242c-1635-4dce-9012-82058459a36f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:13.398786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5be5242c-1635-4dce-9012-82058459a36f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:13.404703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5be5242c-1635-4dce-9012-82058459a36f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:13.424386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5be5242c-1635-4dce-9012-82058459a36f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:13.424386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5be5242c-1635-4dce-9012-82058459a36f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:13.424386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5be5242c-1635-4dce-9012-82058459a36f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:13.437970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5be5242c-1635-4dce-9012-82058459a36f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 Sep 14 19:45:13.438565 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 292/602] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:13 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:13.762791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ca547657-c862-42ab-bb33-60620f2ea312 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:13.763488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ca547657-c862-42ab-bb33-60620f2ea312 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:13.769617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca547657-c862-42ab-bb33-60620f2ea312 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:13.770065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca547657-c862-42ab-bb33-60620f2ea312 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:13.770835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca547657-c862-42ab-bb33-60620f2ea312 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:13.771271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca547657-c862-42ab-bb33-60620f2ea312 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:13.897908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ca547657-c862-42ab-bb33-60620f2ea312 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:13.907084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ca547657-c862-42ab-bb33-60620f2ea312 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:13.908497 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ca547657-c862-42ab-bb33-60620f2ea312 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:13.909697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ca547657-c862-42ab-bb33-60620f2ea312 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.151021 Sep 14 19:45:13.910267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 311/603] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:14.095336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f5426ba4-a25b-4ea0-8618-f9952692acf3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:14.096030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f5426ba4-a25b-4ea0-8618-f9952692acf3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:14.102746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5426ba4-a25b-4ea0-8618-f9952692acf3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:14.103195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5426ba4-a25b-4ea0-8618-f9952692acf3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:14.103977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5426ba4-a25b-4ea0-8618-f9952692acf3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:14.104415 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5426ba4-a25b-4ea0-8618-f9952692acf3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:14.225658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f5426ba4-a25b-4ea0-8618-f9952692acf3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:14.234447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f5426ba4-a25b-4ea0-8618-f9952692acf3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.143233 Sep 14 19:45:14.235031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 293/604] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:14 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:14.449815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7a23f51f-d78d-400f-b665-2428bb38703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:14.450863 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7a23f51f-d78d-400f-b665-2428bb38703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:14.456821 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7a23f51f-d78d-400f-b665-2428bb38703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:14.457263 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7a23f51f-d78d-400f-b665-2428bb38703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:14.460050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7a23f51f-d78d-400f-b665-2428bb38703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:14.460050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7a23f51f-d78d-400f-b665-2428bb38703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:14.489250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7a23f51f-d78d-400f-b665-2428bb38703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043263 Sep 14 19:45:14.489836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 312/605] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:14 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:14.928340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-54eadf3d-ef73-463a-9474-f2df5d5e043e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:14.928946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-54eadf3d-ef73-463a-9474-f2df5d5e043e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:14.935575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54eadf3d-ef73-463a-9474-f2df5d5e043e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:14.936026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54eadf3d-ef73-463a-9474-f2df5d5e043e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:14.936819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54eadf3d-ef73-463a-9474-f2df5d5e043e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:14.937252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54eadf3d-ef73-463a-9474-f2df5d5e043e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:15.091845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-54eadf3d-ef73-463a-9474-f2df5d5e043e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:15.099975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-54eadf3d-ef73-463a-9474-f2df5d5e043e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:15.101480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-54eadf3d-ef73-463a-9474-f2df5d5e043e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:15.102643 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-54eadf3d-ef73-463a-9474-f2df5d5e043e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.178186 Sep 14 19:45:15.103195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 294/606] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:14 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:15.252313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4fe52e54-d0ab-4cab-96bb-72a11dfacfa9 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:15.252955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4fe52e54-d0ab-4cab-96bb-72a11dfacfa9 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:15.259095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4fe52e54-d0ab-4cab-96bb-72a11dfacfa9 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:15.259554 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4fe52e54-d0ab-4cab-96bb-72a11dfacfa9 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:15.260355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4fe52e54-d0ab-4cab-96bb-72a11dfacfa9 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:15.260795 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4fe52e54-d0ab-4cab-96bb-72a11dfacfa9 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:15.391428 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4fe52e54-d0ab-4cab-96bb-72a11dfacfa9 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:15.399271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4fe52e54-d0ab-4cab-96bb-72a11dfacfa9 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.152055 Sep 14 19:45:15.399845 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 313/607] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:15 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:15.500463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-79d3df83-dd73-4e20-96bb-8b962d73b4fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:15.501397 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-79d3df83-dd73-4e20-96bb-8b962d73b4fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:15.507621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79d3df83-dd73-4e20-96bb-8b962d73b4fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:15.508076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79d3df83-dd73-4e20-96bb-8b962d73b4fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:15.508931 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79d3df83-dd73-4e20-96bb-8b962d73b4fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:15.509365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79d3df83-dd73-4e20-96bb-8b962d73b4fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:15.540860 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-79d3df83-dd73-4e20-96bb-8b962d73b4fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044150 Sep 14 19:45:15.541433 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 295/608] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:15 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:16.120107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d02ad35f-045d-4822-becd-76f07073e47e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:16.120721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d02ad35f-045d-4822-becd-76f07073e47e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:16.126598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d02ad35f-045d-4822-becd-76f07073e47e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:16.127125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d02ad35f-045d-4822-becd-76f07073e47e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:16.127917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d02ad35f-045d-4822-becd-76f07073e47e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:16.128358 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d02ad35f-045d-4822-becd-76f07073e47e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:16.247297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d02ad35f-045d-4822-becd-76f07073e47e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:16.255470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d02ad35f-045d-4822-becd-76f07073e47e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:16.256969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d02ad35f-045d-4822-becd-76f07073e47e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:16.258190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d02ad35f-045d-4822-becd-76f07073e47e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.141839 Sep 14 19:45:16.258763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 314/609] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:16 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:16.415981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a308a35a-df1b-4b19-9c6d-48e388ed673e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:16.416697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a308a35a-df1b-4b19-9c6d-48e388ed673e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:16.423087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a308a35a-df1b-4b19-9c6d-48e388ed673e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:16.423606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a308a35a-df1b-4b19-9c6d-48e388ed673e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:16.424455 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a308a35a-df1b-4b19-9c6d-48e388ed673e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:16.424895 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a308a35a-df1b-4b19-9c6d-48e388ed673e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:16.550459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a308a35a-df1b-4b19-9c6d-48e388ed673e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:16.553200 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9f065353-e5bf-4558-a457-9bd99c5495e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:16.554195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9f065353-e5bf-4558-a457-9bd99c5495e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:16.558289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a308a35a-df1b-4b19-9c6d-48e388ed673e tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.145863 Sep 14 19:45:16.558881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 296/610] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:16 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:16.561751 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f065353-e5bf-4558-a457-9bd99c5495e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:16.562214 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f065353-e5bf-4558-a457-9bd99c5495e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:16.563101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f065353-e5bf-4558-a457-9bd99c5495e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:16.563565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f065353-e5bf-4558-a457-9bd99c5495e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:16.594638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9f065353-e5bf-4558-a457-9bd99c5495e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Sep 14 19:45:16.595216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 315/611] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:16 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:17.276033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0933eeb9-c868-4e85-8c54-48edc12d66f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:17.276709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0933eeb9-c868-4e85-8c54-48edc12d66f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:17.283289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0933eeb9-c868-4e85-8c54-48edc12d66f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:17.283744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0933eeb9-c868-4e85-8c54-48edc12d66f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:17.284532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0933eeb9-c868-4e85-8c54-48edc12d66f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:17.284964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0933eeb9-c868-4e85-8c54-48edc12d66f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:17.409549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0933eeb9-c868-4e85-8c54-48edc12d66f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:17.417760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0933eeb9-c868-4e85-8c54-48edc12d66f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:17.419859 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0933eeb9-c868-4e85-8c54-48edc12d66f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:17.421020 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0933eeb9-c868-4e85-8c54-48edc12d66f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.148815 Sep 14 19:45:17.421871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 297/612] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:17 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:17.576206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7ad18b22-2aca-48aa-b03a-7c065d922463 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:17.576826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7ad18b22-2aca-48aa-b03a-7c065d922463 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:17.583446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7ad18b22-2aca-48aa-b03a-7c065d922463 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:17.583891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7ad18b22-2aca-48aa-b03a-7c065d922463 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:17.584671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7ad18b22-2aca-48aa-b03a-7c065d922463 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:17.585102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7ad18b22-2aca-48aa-b03a-7c065d922463 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:17.606097 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e1a8f83b-612f-49a8-88ea-7d072bada717 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:17.607124 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e1a8f83b-612f-49a8-88ea-7d072bada717 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:17.613392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1a8f83b-612f-49a8-88ea-7d072bada717 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:17.613872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1a8f83b-612f-49a8-88ea-7d072bada717 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:17.614663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1a8f83b-612f-49a8-88ea-7d072bada717 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:17.615096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1a8f83b-612f-49a8-88ea-7d072bada717 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:17.648267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e1a8f83b-612f-49a8-88ea-7d072bada717 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046387 Sep 14 19:45:17.648893 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 298/613] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:17 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:17.718912 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7ad18b22-2aca-48aa-b03a-7c065d922463 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:17.726887 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7ad18b22-2aca-48aa-b03a-7c065d922463 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1358 microversion: 2.1 time: 0.154969 Sep 14 19:45:17.727509 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 316/614] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:17 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:18.439122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-53a0cbe7-3f08-46d2-8f44-4de08a42336d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:18.439785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-53a0cbe7-3f08-46d2-8f44-4de08a42336d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:18.447700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-53a0cbe7-3f08-46d2-8f44-4de08a42336d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:18.448142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-53a0cbe7-3f08-46d2-8f44-4de08a42336d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:18.448912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-53a0cbe7-3f08-46d2-8f44-4de08a42336d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:18.449338 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-53a0cbe7-3f08-46d2-8f44-4de08a42336d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:18.586353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-53a0cbe7-3f08-46d2-8f44-4de08a42336d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:18.597163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-53a0cbe7-3f08-46d2-8f44-4de08a42336d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:18.598715 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-53a0cbe7-3f08-46d2-8f44-4de08a42336d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:18.599932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-53a0cbe7-3f08-46d2-8f44-4de08a42336d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.164678 Sep 14 19:45:18.600514 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 299/615] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:18 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:18.661184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0e3b5bcf-ff96-42ed-ab0d-bd7e107b1e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:18.662601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0e3b5bcf-ff96-42ed-ab0d-bd7e107b1e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:18.668940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e3b5bcf-ff96-42ed-ab0d-bd7e107b1e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:18.669397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e3b5bcf-ff96-42ed-ab0d-bd7e107b1e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:18.670312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e3b5bcf-ff96-42ed-ab0d-bd7e107b1e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:18.670753 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e3b5bcf-ff96-42ed-ab0d-bd7e107b1e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:18.703911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0e3b5bcf-ff96-42ed-ab0d-bd7e107b1e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046699 Sep 14 19:45:18.704490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 317/616] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:18 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:18.744121 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-81234fd0-ac82-4618-abda-f5b62d1a4675 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:18.744673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-81234fd0-ac82-4618-abda-f5b62d1a4675 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:18.750680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81234fd0-ac82-4618-abda-f5b62d1a4675 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:18.751189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81234fd0-ac82-4618-abda-f5b62d1a4675 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:18.751970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81234fd0-ac82-4618-abda-f5b62d1a4675 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:18.752401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81234fd0-ac82-4618-abda-f5b62d1a4675 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:18.879439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-81234fd0-ac82-4618-abda-f5b62d1a4675 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:18.892564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-81234fd0-ac82-4618-abda-f5b62d1a4675 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1549 microversion: 2.1 time: 0.146650 Sep 14 19:45:18.892564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 300/617] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:18 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:18.904097 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6c9ee509-1b4e-4724-976a-04068bdf8f1c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:18.904705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6c9ee509-1b4e-4724-976a-04068bdf8f1c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:18.910744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c9ee509-1b4e-4724-976a-04068bdf8f1c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:18.911198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c9ee509-1b4e-4724-976a-04068bdf8f1c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:18.912036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c9ee509-1b4e-4724-976a-04068bdf8f1c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:18.912507 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c9ee509-1b4e-4724-976a-04068bdf8f1c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:19.040730 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6c9ee509-1b4e-4724-976a-04068bdf8f1c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:19.049039 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6c9ee509-1b4e-4724-976a-04068bdf8f1c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1549 microversion: 2.1 time: 0.149131 Sep 14 19:45:19.049629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 318/618] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:18 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:19.064836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9b9598a1-ae7e-49cf-b26a-15aaf88269a3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:19.068092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:45:19.068092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:45:19.069059 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9b9598a1-ae7e-49cf-b26a-15aaf88269a3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:19.069742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9b9598a1-ae7e-49cf-b26a-15aaf88269a3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Searching by: {'deleted': False, 'project_id': '14259a781e8c4dbeafab6f1777646286'} {{(pid=115679) get_all /opt/stack/nova/nova/compute/api.py:2905}} Sep 14 19:45:19.076633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b9598a1-ae7e-49cf-b26a-15aaf88269a3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:19.077110 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b9598a1-ae7e-49cf-b26a-15aaf88269a3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:19.077972 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b9598a1-ae7e-49cf-b26a-15aaf88269a3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:19.078433 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b9598a1-ae7e-49cf-b26a-15aaf88269a3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:19.171725 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.multi_cell_list [None req-9b9598a1-ae7e-49cf-b26a-15aaf88269a3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Sep 14 19:45:19.272717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9b9598a1-ae7e-49cf-b26a-15aaf88269a3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211001 Sep 14 19:45:19.273663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 301/619] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Sep 14 19:45:19 2021] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:19.290098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-41be578d-970d-4b11-95ee-e67e4c0da4b3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:19.291101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-41be578d-970d-4b11-95ee-e67e4c0da4b3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:19.300523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41be578d-970d-4b11-95ee-e67e4c0da4b3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:19.301232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41be578d-970d-4b11-95ee-e67e4c0da4b3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:19.302489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41be578d-970d-4b11-95ee-e67e4c0da4b3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:19.303196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41be578d-970d-4b11-95ee-e67e4c0da4b3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:19.430995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-41be578d-970d-4b11-95ee-e67e4c0da4b3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:19.438453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-41be578d-970d-4b11-95ee-e67e4c0da4b3 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1549 microversion: 2.1 time: 0.154211 Sep 14 19:45:19.439021 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 319/620] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:45:19 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:45:19.618369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-530074c5-4f44-41aa-98b8-3e02401e0a05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:19.624266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-530074c5-4f44-41aa-98b8-3e02401e0a05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:19.625849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-530074c5-4f44-41aa-98b8-3e02401e0a05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:19.626302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-530074c5-4f44-41aa-98b8-3e02401e0a05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:19.627091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-530074c5-4f44-41aa-98b8-3e02401e0a05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:19.627533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-530074c5-4f44-41aa-98b8-3e02401e0a05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:19.716029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b992b749-f1b9-4b4d-9d30-cdc0a393d86b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:19.716954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b992b749-f1b9-4b4d-9d30-cdc0a393d86b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:19.722976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b992b749-f1b9-4b4d-9d30-cdc0a393d86b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:19.723427 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b992b749-f1b9-4b4d-9d30-cdc0a393d86b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:19.724285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b992b749-f1b9-4b4d-9d30-cdc0a393d86b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:19.724718 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b992b749-f1b9-4b4d-9d30-cdc0a393d86b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:19.754669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-530074c5-4f44-41aa-98b8-3e02401e0a05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:19.758539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b992b749-f1b9-4b4d-9d30-cdc0a393d86b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Sep 14 19:45:19.758875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 320/621] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:45:19.764714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-530074c5-4f44-41aa-98b8-3e02401e0a05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:19.766181 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-530074c5-4f44-41aa-98b8-3e02401e0a05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:19.767352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-530074c5-4f44-41aa-98b8-3e02401e0a05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.152931 Sep 14 19:45:19.767922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 302/622] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:20.769353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-84bce45f-d5b8-4714-aaca-124d9be47a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:20.770300 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-84bce45f-d5b8-4714-aaca-124d9be47a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:20.777160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-84bce45f-d5b8-4714-aaca-124d9be47a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:20.777780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-84bce45f-d5b8-4714-aaca-124d9be47a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:20.778752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-84bce45f-d5b8-4714-aaca-124d9be47a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:20.779308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-84bce45f-d5b8-4714-aaca-124d9be47a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:20.785767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b925361a-e2bf-4bbd-94d6-264b87bc5dcc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:20.786437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b925361a-e2bf-4bbd-94d6-264b87bc5dcc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:20.792271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b925361a-e2bf-4bbd-94d6-264b87bc5dcc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:20.792722 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b925361a-e2bf-4bbd-94d6-264b87bc5dcc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:20.793549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b925361a-e2bf-4bbd-94d6-264b87bc5dcc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:20.794638 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b925361a-e2bf-4bbd-94d6-264b87bc5dcc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:20.835276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-84bce45f-d5b8-4714-aaca-124d9be47a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069602 Sep 14 19:45:20.836535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 321/623] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:20 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:20.948535 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b925361a-e2bf-4bbd-94d6-264b87bc5dcc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:20.957235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b925361a-e2bf-4bbd-94d6-264b87bc5dcc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:20.958768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b925361a-e2bf-4bbd-94d6-264b87bc5dcc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:20.959963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b925361a-e2bf-4bbd-94d6-264b87bc5dcc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.178128 Sep 14 19:45:20.960624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 303/624] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:45:21.849856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3897fca9-8b7e-4a08-a0c0-164393101a35 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:21.850783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3897fca9-8b7e-4a08-a0c0-164393101a35 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:21.857207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3897fca9-8b7e-4a08-a0c0-164393101a35 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:21.857707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3897fca9-8b7e-4a08-a0c0-164393101a35 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:21.858512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3897fca9-8b7e-4a08-a0c0-164393101a35 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:21.859068 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3897fca9-8b7e-4a08-a0c0-164393101a35 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:21.891913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3897fca9-8b7e-4a08-a0c0-164393101a35 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045875 Sep 14 19:45:21.892498 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 322/625] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:21 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:21.978682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e50712e6-bda0-4750-9eef-e2e487e1419b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:21.979238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e50712e6-bda0-4750-9eef-e2e487e1419b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:21.985876 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e50712e6-bda0-4750-9eef-e2e487e1419b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:21.993091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e50712e6-bda0-4750-9eef-e2e487e1419b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:21.993091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e50712e6-bda0-4750-9eef-e2e487e1419b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:21.993091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e50712e6-bda0-4750-9eef-e2e487e1419b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:22.120227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e50712e6-bda0-4750-9eef-e2e487e1419b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:22.129342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e50712e6-bda0-4750-9eef-e2e487e1419b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:22.130866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e50712e6-bda0-4750-9eef-e2e487e1419b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:22.132036 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e50712e6-bda0-4750-9eef-e2e487e1419b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.157385 Sep 14 19:45:22.132603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 304/626] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:21 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:22.907963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5d4ed4ad-085a-4f9d-bfd7-ee313b5f9cd6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:22.908865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5d4ed4ad-085a-4f9d-bfd7-ee313b5f9cd6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:22.915005 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d4ed4ad-085a-4f9d-bfd7-ee313b5f9cd6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:22.915455 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d4ed4ad-085a-4f9d-bfd7-ee313b5f9cd6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:22.916229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d4ed4ad-085a-4f9d-bfd7-ee313b5f9cd6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:22.916664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d4ed4ad-085a-4f9d-bfd7-ee313b5f9cd6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:22.949828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5d4ed4ad-085a-4f9d-bfd7-ee313b5f9cd6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Sep 14 19:45:22.950482 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 323/627] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:22 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:23.150012 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-70990bf5-7c44-4646-b5a7-cf54c4beb9f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:23.150610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-70990bf5-7c44-4646-b5a7-cf54c4beb9f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:23.157464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70990bf5-7c44-4646-b5a7-cf54c4beb9f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:23.157946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70990bf5-7c44-4646-b5a7-cf54c4beb9f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:23.158723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70990bf5-7c44-4646-b5a7-cf54c4beb9f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:23.159151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70990bf5-7c44-4646-b5a7-cf54c4beb9f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:23.279880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-70990bf5-7c44-4646-b5a7-cf54c4beb9f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:23.288444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-70990bf5-7c44-4646-b5a7-cf54c4beb9f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:23.289898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-70990bf5-7c44-4646-b5a7-cf54c4beb9f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:23.291109 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-70990bf5-7c44-4646-b5a7-cf54c4beb9f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.145066 Sep 14 19:45:23.291673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 305/628] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:23.961673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e6d09b23-a16a-4247-87e7-cfa6758f1912 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:23.962615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e6d09b23-a16a-4247-87e7-cfa6758f1912 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:23.968540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e6d09b23-a16a-4247-87e7-cfa6758f1912 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:23.968988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e6d09b23-a16a-4247-87e7-cfa6758f1912 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:23.969876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e6d09b23-a16a-4247-87e7-cfa6758f1912 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:23.970310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e6d09b23-a16a-4247-87e7-cfa6758f1912 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:24.001172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e6d09b23-a16a-4247-87e7-cfa6758f1912 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Sep 14 19:45:24.001807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 324/629] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:23 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:24.309627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-84ebd576-c3b1-4919-b615-597fa0069bf8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:24.310253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-84ebd576-c3b1-4919-b615-597fa0069bf8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:24.316826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84ebd576-c3b1-4919-b615-597fa0069bf8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:24.317221 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84ebd576-c3b1-4919-b615-597fa0069bf8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:24.318042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84ebd576-c3b1-4919-b615-597fa0069bf8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:24.318484 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84ebd576-c3b1-4919-b615-597fa0069bf8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:24.449218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-84ebd576-c3b1-4919-b615-597fa0069bf8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:24.459633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-84ebd576-c3b1-4919-b615-597fa0069bf8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:24.461124 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-84ebd576-c3b1-4919-b615-597fa0069bf8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:24.462323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-84ebd576-c3b1-4919-b615-597fa0069bf8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.156503 Sep 14 19:45:24.462889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 306/630] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:45:25.012469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-81431339-dbe2-429e-830a-f93e99cfcd2d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:25.013936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-81431339-dbe2-429e-830a-f93e99cfcd2d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:25.019991 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-81431339-dbe2-429e-830a-f93e99cfcd2d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:25.020499 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-81431339-dbe2-429e-830a-f93e99cfcd2d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:25.021293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-81431339-dbe2-429e-830a-f93e99cfcd2d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:25.021770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-81431339-dbe2-429e-830a-f93e99cfcd2d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:25.052152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-81431339-dbe2-429e-830a-f93e99cfcd2d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043587 Sep 14 19:45:25.052707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 325/631] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:25 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:45:25.481640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6b9119bc-97c7-4edc-9788-9b378c3376d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:25.482259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6b9119bc-97c7-4edc-9788-9b378c3376d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:25.489121 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b9119bc-97c7-4edc-9788-9b378c3376d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:25.489605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b9119bc-97c7-4edc-9788-9b378c3376d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:25.490396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b9119bc-97c7-4edc-9788-9b378c3376d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:25.490834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b9119bc-97c7-4edc-9788-9b378c3376d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:25.630162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6b9119bc-97c7-4edc-9788-9b378c3376d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:25.639067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6b9119bc-97c7-4edc-9788-9b378c3376d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:25.640548 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6b9119bc-97c7-4edc-9788-9b378c3376d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:25.641757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6b9119bc-97c7-4edc-9788-9b378c3376d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.164319 Sep 14 19:45:25.642333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 307/632] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:26.063840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-523d61bb-4ca4-4db2-8e91-f13fbfebcfe2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:26.064758 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-523d61bb-4ca4-4db2-8e91-f13fbfebcfe2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:26.071706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-523d61bb-4ca4-4db2-8e91-f13fbfebcfe2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:26.072159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-523d61bb-4ca4-4db2-8e91-f13fbfebcfe2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:26.072946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-523d61bb-4ca4-4db2-8e91-f13fbfebcfe2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:26.073420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-523d61bb-4ca4-4db2-8e91-f13fbfebcfe2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:26.105920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-523d61bb-4ca4-4db2-8e91-f13fbfebcfe2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Sep 14 19:45:26.106405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 326/633] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:26 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:26.660274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c85be6a7-bc90-4e5d-8aec-69d3a0d3a787 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:26.660865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c85be6a7-bc90-4e5d-8aec-69d3a0d3a787 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:26.666723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c85be6a7-bc90-4e5d-8aec-69d3a0d3a787 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:26.667162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c85be6a7-bc90-4e5d-8aec-69d3a0d3a787 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:26.667920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c85be6a7-bc90-4e5d-8aec-69d3a0d3a787 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:26.668345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c85be6a7-bc90-4e5d-8aec-69d3a0d3a787 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:26.794529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c85be6a7-bc90-4e5d-8aec-69d3a0d3a787 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:26.804120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c85be6a7-bc90-4e5d-8aec-69d3a0d3a787 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:26.805635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c85be6a7-bc90-4e5d-8aec-69d3a0d3a787 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:26.806816 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c85be6a7-bc90-4e5d-8aec-69d3a0d3a787 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.150257 Sep 14 19:45:26.807381 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 308/634] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:27.118052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e0c5921d-6a5f-4838-886d-1a549fa4078f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:27.118970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e0c5921d-6a5f-4838-886d-1a549fa4078f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:27.125453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0c5921d-6a5f-4838-886d-1a549fa4078f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:27.125936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0c5921d-6a5f-4838-886d-1a549fa4078f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:27.126719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0c5921d-6a5f-4838-886d-1a549fa4078f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:27.127161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0c5921d-6a5f-4838-886d-1a549fa4078f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:27.160269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e0c5921d-6a5f-4838-886d-1a549fa4078f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046197 Sep 14 19:45:27.163205 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 327/635] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:27 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:27.825697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9b2f57cf-df28-4434-8d5d-3206955b5ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:27.826270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9b2f57cf-df28-4434-8d5d-3206955b5ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:27.832649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b2f57cf-df28-4434-8d5d-3206955b5ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:27.833120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b2f57cf-df28-4434-8d5d-3206955b5ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:27.833965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b2f57cf-df28-4434-8d5d-3206955b5ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:27.834403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b2f57cf-df28-4434-8d5d-3206955b5ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:27.955550 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9b2f57cf-df28-4434-8d5d-3206955b5ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:27.964381 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9b2f57cf-df28-4434-8d5d-3206955b5ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:27.966426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9b2f57cf-df28-4434-8d5d-3206955b5ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:27.967618 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9b2f57cf-df28-4434-8d5d-3206955b5ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.145902 Sep 14 19:45:27.968189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 309/636] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:27 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:45:28.173900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3f1d331c-5600-4526-a40d-b80998508840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:28.174948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3f1d331c-5600-4526-a40d-b80998508840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:28.180907 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f1d331c-5600-4526-a40d-b80998508840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:28.181442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f1d331c-5600-4526-a40d-b80998508840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:28.182272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f1d331c-5600-4526-a40d-b80998508840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:28.183181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f1d331c-5600-4526-a40d-b80998508840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:28.212532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3f1d331c-5600-4526-a40d-b80998508840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Sep 14 19:45:28.213108 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 328/637] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:28 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:28.986440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cec1c229-a754-4c59-b21b-f62e33148ba4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:28.986996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cec1c229-a754-4c59-b21b-f62e33148ba4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:28.992872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cec1c229-a754-4c59-b21b-f62e33148ba4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:28.993311 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cec1c229-a754-4c59-b21b-f62e33148ba4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:28.994109 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cec1c229-a754-4c59-b21b-f62e33148ba4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:28.994534 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cec1c229-a754-4c59-b21b-f62e33148ba4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:29.124246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cec1c229-a754-4c59-b21b-f62e33148ba4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:29.131594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cec1c229-a754-4c59-b21b-f62e33148ba4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:29.133130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cec1c229-a754-4c59-b21b-f62e33148ba4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:29.134458 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cec1c229-a754-4c59-b21b-f62e33148ba4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.151751 Sep 14 19:45:29.135031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 310/638] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:28 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:29.223769 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b2d32e89-6d72-4f03-8bcf-ad193a117a42 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:29.224800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b2d32e89-6d72-4f03-8bcf-ad193a117a42 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:29.230790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2d32e89-6d72-4f03-8bcf-ad193a117a42 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:29.231501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2d32e89-6d72-4f03-8bcf-ad193a117a42 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:29.232280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2d32e89-6d72-4f03-8bcf-ad193a117a42 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:29.232722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2d32e89-6d72-4f03-8bcf-ad193a117a42 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:29.261900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b2d32e89-6d72-4f03-8bcf-ad193a117a42 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041870 Sep 14 19:45:29.262883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 329/639] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:29 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:30.152797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-becfe266-bcf1-4e88-8432-f46592994882 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:30.153714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-becfe266-bcf1-4e88-8432-f46592994882 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:30.159784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-becfe266-bcf1-4e88-8432-f46592994882 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:30.160109 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-becfe266-bcf1-4e88-8432-f46592994882 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:30.160897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-becfe266-bcf1-4e88-8432-f46592994882 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:30.161336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-becfe266-bcf1-4e88-8432-f46592994882 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:30.274249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8d358dde-2f0e-44d9-b27c-93eb5083a9f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:30.275310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8d358dde-2f0e-44d9-b27c-93eb5083a9f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:30.281486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8d358dde-2f0e-44d9-b27c-93eb5083a9f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:30.281966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8d358dde-2f0e-44d9-b27c-93eb5083a9f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:30.282840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8d358dde-2f0e-44d9-b27c-93eb5083a9f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:30.283282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8d358dde-2f0e-44d9-b27c-93eb5083a9f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:30.300385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-becfe266-bcf1-4e88-8432-f46592994882 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:30.312633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-becfe266-bcf1-4e88-8432-f46592994882 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:30.314657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-becfe266-bcf1-4e88-8432-f46592994882 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:30.315613 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8d358dde-2f0e-44d9-b27c-93eb5083a9f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045238 Sep 14 19:45:30.316203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 330/640] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:30 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:45:30.316480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-becfe266-bcf1-4e88-8432-f46592994882 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.167359 Sep 14 19:45:30.317173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 311/641] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:30 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:31.327656 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-031e2c04-57eb-407a-b2c0-00cb8580bd43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:31.328567 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-031e2c04-57eb-407a-b2c0-00cb8580bd43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:31.334573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-031e2c04-57eb-407a-b2c0-00cb8580bd43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:31.335028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-031e2c04-57eb-407a-b2c0-00cb8580bd43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:31.335413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7be145b9-a8fd-4dd5-9fc5-d1f24571693a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:31.335846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-031e2c04-57eb-407a-b2c0-00cb8580bd43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:31.336083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7be145b9-a8fd-4dd5-9fc5-d1f24571693a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:31.336235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-031e2c04-57eb-407a-b2c0-00cb8580bd43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:31.342051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7be145b9-a8fd-4dd5-9fc5-d1f24571693a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:31.342497 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7be145b9-a8fd-4dd5-9fc5-d1f24571693a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:31.343266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7be145b9-a8fd-4dd5-9fc5-d1f24571693a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:31.343695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7be145b9-a8fd-4dd5-9fc5-d1f24571693a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:31.366771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-031e2c04-57eb-407a-b2c0-00cb8580bd43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042792 Sep 14 19:45:31.367333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 331/642] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:31 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:31.465052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7be145b9-a8fd-4dd5-9fc5-d1f24571693a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:31.473684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7be145b9-a8fd-4dd5-9fc5-d1f24571693a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:31.475518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7be145b9-a8fd-4dd5-9fc5-d1f24571693a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:31.476681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7be145b9-a8fd-4dd5-9fc5-d1f24571693a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.144983 Sep 14 19:45:31.477325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 312/643] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:31 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:45:32.379061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ddfac536-626e-4d71-b28e-102008433295 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:32.380018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ddfac536-626e-4d71-b28e-102008433295 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:32.386487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ddfac536-626e-4d71-b28e-102008433295 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:32.386929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ddfac536-626e-4d71-b28e-102008433295 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:32.388370 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ddfac536-626e-4d71-b28e-102008433295 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:32.388803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ddfac536-626e-4d71-b28e-102008433295 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:32.424058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ddfac536-626e-4d71-b28e-102008433295 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049047 Sep 14 19:45:32.424647 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 332/644] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:32 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:32.495546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-72d64f96-9de4-44c3-add0-2ef92fd97422 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:32.496099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-72d64f96-9de4-44c3-add0-2ef92fd97422 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:32.502715 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-72d64f96-9de4-44c3-add0-2ef92fd97422 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:32.503166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-72d64f96-9de4-44c3-add0-2ef92fd97422 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:32.503937 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-72d64f96-9de4-44c3-add0-2ef92fd97422 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:32.504364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-72d64f96-9de4-44c3-add0-2ef92fd97422 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:32.834617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-72d64f96-9de4-44c3-add0-2ef92fd97422 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:32.843666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-72d64f96-9de4-44c3-add0-2ef92fd97422 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:32.844982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-72d64f96-9de4-44c3-add0-2ef92fd97422 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:32.849067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-72d64f96-9de4-44c3-add0-2ef92fd97422 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.357379 Sep 14 19:45:32.849789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 313/645] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:32 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:33.435713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2c7becbd-18dd-4533-9da3-52fac4880b52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:33.436623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2c7becbd-18dd-4533-9da3-52fac4880b52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:33.442584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c7becbd-18dd-4533-9da3-52fac4880b52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:33.443037 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c7becbd-18dd-4533-9da3-52fac4880b52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:33.443808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c7becbd-18dd-4533-9da3-52fac4880b52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:33.444251 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c7becbd-18dd-4533-9da3-52fac4880b52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:33.473460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2c7becbd-18dd-4533-9da3-52fac4880b52 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041514 Sep 14 19:45:33.474064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 333/646] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:33 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:33.867458 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-97344bdd-11dc-4fc2-accc-7d7fe41de1c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:33.868088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-97344bdd-11dc-4fc2-accc-7d7fe41de1c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:33.874581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97344bdd-11dc-4fc2-accc-7d7fe41de1c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:33.875034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97344bdd-11dc-4fc2-accc-7d7fe41de1c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:33.875823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97344bdd-11dc-4fc2-accc-7d7fe41de1c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:33.876258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97344bdd-11dc-4fc2-accc-7d7fe41de1c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:34.003852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-97344bdd-11dc-4fc2-accc-7d7fe41de1c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:34.013267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-97344bdd-11dc-4fc2-accc-7d7fe41de1c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:34.014813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-97344bdd-11dc-4fc2-accc-7d7fe41de1c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:34.015997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-97344bdd-11dc-4fc2-accc-7d7fe41de1c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.152922 Sep 14 19:45:34.016567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 314/647] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:33 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:34.485641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-27727170-e314-422f-ab33-5bf3c65034fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:34.486568 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-27727170-e314-422f-ab33-5bf3c65034fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:34.492672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-27727170-e314-422f-ab33-5bf3c65034fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:34.493119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-27727170-e314-422f-ab33-5bf3c65034fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:34.493944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-27727170-e314-422f-ab33-5bf3c65034fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:34.494379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-27727170-e314-422f-ab33-5bf3c65034fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:34.600284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-27727170-e314-422f-ab33-5bf3c65034fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118388 Sep 14 19:45:34.600860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 334/648] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:34 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:35.034301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-86c1137d-f6e5-4a94-95bb-f0390d0f268b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:35.034939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-86c1137d-f6e5-4a94-95bb-f0390d0f268b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:35.041143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86c1137d-f6e5-4a94-95bb-f0390d0f268b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:35.041630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86c1137d-f6e5-4a94-95bb-f0390d0f268b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:35.042414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86c1137d-f6e5-4a94-95bb-f0390d0f268b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:35.042851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86c1137d-f6e5-4a94-95bb-f0390d0f268b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:35.166985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-86c1137d-f6e5-4a94-95bb-f0390d0f268b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:35.178707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-86c1137d-f6e5-4a94-95bb-f0390d0f268b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:35.180211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-86c1137d-f6e5-4a94-95bb-f0390d0f268b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:35.181560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-86c1137d-f6e5-4a94-95bb-f0390d0f268b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.150896 Sep 14 19:45:35.182158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 315/649] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:35 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:35.613062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a2a10eb4-2271-4a5c-8513-0856f9c86e51 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:35.614035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a2a10eb4-2271-4a5c-8513-0856f9c86e51 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:35.622174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2a10eb4-2271-4a5c-8513-0856f9c86e51 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:35.622897 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2a10eb4-2271-4a5c-8513-0856f9c86e51 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:35.624075 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2a10eb4-2271-4a5c-8513-0856f9c86e51 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:35.624741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2a10eb4-2271-4a5c-8513-0856f9c86e51 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:35.659415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a2a10eb4-2271-4a5c-8513-0856f9c86e51 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050061 Sep 14 19:45:35.659970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 335/650] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:35 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:36.200319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b4c9f3bb-2052-42a9-9eed-d6d5c0f721b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:36.200926 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b4c9f3bb-2052-42a9-9eed-d6d5c0f721b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:36.207302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4c9f3bb-2052-42a9-9eed-d6d5c0f721b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:36.207787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4c9f3bb-2052-42a9-9eed-d6d5c0f721b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:36.208579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4c9f3bb-2052-42a9-9eed-d6d5c0f721b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:36.209019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4c9f3bb-2052-42a9-9eed-d6d5c0f721b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:36.338981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b4c9f3bb-2052-42a9-9eed-d6d5c0f721b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:36.347397 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b4c9f3bb-2052-42a9-9eed-d6d5c0f721b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:36.348874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b4c9f3bb-2052-42a9-9eed-d6d5c0f721b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:36.350063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b4c9f3bb-2052-42a9-9eed-d6d5c0f721b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.154047 Sep 14 19:45:36.350623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 316/651] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:36 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:36.671737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2f0fc67e-8f89-44d5-99b3-7f0146e40858 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:36.672853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2f0fc67e-8f89-44d5-99b3-7f0146e40858 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:36.679267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f0fc67e-8f89-44d5-99b3-7f0146e40858 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:36.679720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f0fc67e-8f89-44d5-99b3-7f0146e40858 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:36.680516 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f0fc67e-8f89-44d5-99b3-7f0146e40858 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:36.680952 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f0fc67e-8f89-44d5-99b3-7f0146e40858 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:36.712174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2f0fc67e-8f89-44d5-99b3-7f0146e40858 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Sep 14 19:45:36.712742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 336/652] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:36 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:37.369351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ffbd6cae-a98c-4f5d-872c-d2ea61bc89b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:37.370115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ffbd6cae-a98c-4f5d-872c-d2ea61bc89b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:37.377513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ffbd6cae-a98c-4f5d-872c-d2ea61bc89b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:37.378109 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ffbd6cae-a98c-4f5d-872c-d2ea61bc89b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:37.378914 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ffbd6cae-a98c-4f5d-872c-d2ea61bc89b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:37.379348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ffbd6cae-a98c-4f5d-872c-d2ea61bc89b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:37.500956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ffbd6cae-a98c-4f5d-872c-d2ea61bc89b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:37.509584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ffbd6cae-a98c-4f5d-872c-d2ea61bc89b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:37.511079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ffbd6cae-a98c-4f5d-872c-d2ea61bc89b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:37.512810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ffbd6cae-a98c-4f5d-872c-d2ea61bc89b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.148713 Sep 14 19:45:37.513290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 317/653] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:37.724271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b2b8cb80-f562-43e0-ba82-3dcd23012432 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:37.725113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b2b8cb80-f562-43e0-ba82-3dcd23012432 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:37.731109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2b8cb80-f562-43e0-ba82-3dcd23012432 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:37.731563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2b8cb80-f562-43e0-ba82-3dcd23012432 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:37.732337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2b8cb80-f562-43e0-ba82-3dcd23012432 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:37.732810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2b8cb80-f562-43e0-ba82-3dcd23012432 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:37.763416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b2b8cb80-f562-43e0-ba82-3dcd23012432 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 Sep 14 19:45:37.764029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 337/654] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:37 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:38.531496 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ed447825-93b5-4c08-85bc-92a5f5d8018b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:38.532126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ed447825-93b5-4c08-85bc-92a5f5d8018b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:38.538143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed447825-93b5-4c08-85bc-92a5f5d8018b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:38.538591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed447825-93b5-4c08-85bc-92a5f5d8018b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:38.539391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed447825-93b5-4c08-85bc-92a5f5d8018b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:38.539818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed447825-93b5-4c08-85bc-92a5f5d8018b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:38.662735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ed447825-93b5-4c08-85bc-92a5f5d8018b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:38.672161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ed447825-93b5-4c08-85bc-92a5f5d8018b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:38.673745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ed447825-93b5-4c08-85bc-92a5f5d8018b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:38.674906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ed447825-93b5-4c08-85bc-92a5f5d8018b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.147741 Sep 14 19:45:38.675488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 318/655] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:38 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:38.776523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-df90ff4d-cdab-4245-841d-450de089270f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:38.778281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-df90ff4d-cdab-4245-841d-450de089270f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:38.784467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-df90ff4d-cdab-4245-841d-450de089270f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:38.784910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-df90ff4d-cdab-4245-841d-450de089270f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:38.785722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-df90ff4d-cdab-4245-841d-450de089270f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:38.786163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-df90ff4d-cdab-4245-841d-450de089270f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:38.815739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-df90ff4d-cdab-4245-841d-450de089270f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Sep 14 19:45:38.816299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 338/656] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:38 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:39.693017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0acfb8ea-867f-4059-9acb-7f3c3568bfa8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:39.693644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0acfb8ea-867f-4059-9acb-7f3c3568bfa8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:39.699671 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0acfb8ea-867f-4059-9acb-7f3c3568bfa8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:39.700044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0acfb8ea-867f-4059-9acb-7f3c3568bfa8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:39.700831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0acfb8ea-867f-4059-9acb-7f3c3568bfa8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:39.701278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0acfb8ea-867f-4059-9acb-7f3c3568bfa8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:39.826630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f4ed40cb-7ae5-487a-8308-de22be9820c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:39.827710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f4ed40cb-7ae5-487a-8308-de22be9820c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:39.830403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0acfb8ea-867f-4059-9acb-7f3c3568bfa8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:39.833991 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4ed40cb-7ae5-487a-8308-de22be9820c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:39.834652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4ed40cb-7ae5-487a-8308-de22be9820c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:39.835616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4ed40cb-7ae5-487a-8308-de22be9820c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:39.836194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4ed40cb-7ae5-487a-8308-de22be9820c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:39.838868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0acfb8ea-867f-4059-9acb-7f3c3568bfa8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:39.840372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0acfb8ea-867f-4059-9acb-7f3c3568bfa8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:39.841668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0acfb8ea-867f-4059-9acb-7f3c3568bfa8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.152341 Sep 14 19:45:39.842267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 319/657] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:39 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:45:39.866633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f4ed40cb-7ae5-487a-8308-de22be9820c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043710 Sep 14 19:45:39.867196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 339/658] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:39 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:45:40.859642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-68a3b0c2-29bf-4a75-82b9-99a4df1db3eb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:40.860239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-68a3b0c2-29bf-4a75-82b9-99a4df1db3eb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:40.866169 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-68a3b0c2-29bf-4a75-82b9-99a4df1db3eb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:40.866612 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-68a3b0c2-29bf-4a75-82b9-99a4df1db3eb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:40.867368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-68a3b0c2-29bf-4a75-82b9-99a4df1db3eb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:40.867793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-68a3b0c2-29bf-4a75-82b9-99a4df1db3eb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:40.878316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-11e7c4ea-1912-44e8-8a64-a056f2ff84af tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:40.879361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-11e7c4ea-1912-44e8-8a64-a056f2ff84af tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:40.885241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11e7c4ea-1912-44e8-8a64-a056f2ff84af tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:40.885715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11e7c4ea-1912-44e8-8a64-a056f2ff84af tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:40.886482 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11e7c4ea-1912-44e8-8a64-a056f2ff84af tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:40.887543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11e7c4ea-1912-44e8-8a64-a056f2ff84af tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:40.916196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-11e7c4ea-1912-44e8-8a64-a056f2ff84af tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041576 Sep 14 19:45:40.916774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 340/659] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:40 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:45:40.991914 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-68a3b0c2-29bf-4a75-82b9-99a4df1db3eb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:41.001005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-68a3b0c2-29bf-4a75-82b9-99a4df1db3eb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:41.002556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-68a3b0c2-29bf-4a75-82b9-99a4df1db3eb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:41.003710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-68a3b0c2-29bf-4a75-82b9-99a4df1db3eb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.147742 Sep 14 19:45:41.004269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 320/660] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:41.928042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d6117593-9f01-483f-9f5e-af1b4d38742a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:41.928941 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d6117593-9f01-483f-9f5e-af1b4d38742a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:41.935165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6117593-9f01-483f-9f5e-af1b4d38742a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:41.935610 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6117593-9f01-483f-9f5e-af1b4d38742a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:41.936384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6117593-9f01-483f-9f5e-af1b4d38742a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:41.936818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6117593-9f01-483f-9f5e-af1b4d38742a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:41.966609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d6117593-9f01-483f-9f5e-af1b4d38742a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 Sep 14 19:45:41.967164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 341/661] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:41 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:42.021780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-236824ff-0d6d-46aa-8e27-bccfe0ffb319 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:42.022368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-236824ff-0d6d-46aa-8e27-bccfe0ffb319 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:42.029478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-236824ff-0d6d-46aa-8e27-bccfe0ffb319 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:42.029951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-236824ff-0d6d-46aa-8e27-bccfe0ffb319 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:42.030736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-236824ff-0d6d-46aa-8e27-bccfe0ffb319 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:42.031195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-236824ff-0d6d-46aa-8e27-bccfe0ffb319 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:42.151815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-236824ff-0d6d-46aa-8e27-bccfe0ffb319 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:42.159909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-236824ff-0d6d-46aa-8e27-bccfe0ffb319 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:42.161384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-236824ff-0d6d-46aa-8e27-bccfe0ffb319 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:42.162550 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-236824ff-0d6d-46aa-8e27-bccfe0ffb319 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.144513 Sep 14 19:45:42.163106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 321/662] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:42 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:42.977635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-88728b41-79c3-4720-b819-3b8162222bde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:42.978557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-88728b41-79c3-4720-b819-3b8162222bde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:42.986087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88728b41-79c3-4720-b819-3b8162222bde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:42.986550 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88728b41-79c3-4720-b819-3b8162222bde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:42.987336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88728b41-79c3-4720-b819-3b8162222bde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:42.987778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88728b41-79c3-4720-b819-3b8162222bde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:43.017936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-88728b41-79c3-4720-b819-3b8162222bde tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Sep 14 19:45:43.018425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 342/663] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:42 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:43.180901 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d35f7380-0fab-4409-990b-038dcefae9c4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:43.181516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d35f7380-0fab-4409-990b-038dcefae9c4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:43.187349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d35f7380-0fab-4409-990b-038dcefae9c4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:43.187785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d35f7380-0fab-4409-990b-038dcefae9c4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:43.188541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d35f7380-0fab-4409-990b-038dcefae9c4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:43.188968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d35f7380-0fab-4409-990b-038dcefae9c4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:43.314839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d35f7380-0fab-4409-990b-038dcefae9c4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:43.323244 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d35f7380-0fab-4409-990b-038dcefae9c4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:43.325281 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d35f7380-0fab-4409-990b-038dcefae9c4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:43.326470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d35f7380-0fab-4409-990b-038dcefae9c4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.149357 Sep 14 19:45:43.327033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 322/664] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:44.029358 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7336ed15-15b0-4cfa-819f-947dd37a8cc5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:44.030327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7336ed15-15b0-4cfa-819f-947dd37a8cc5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:44.036230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7336ed15-15b0-4cfa-819f-947dd37a8cc5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:44.036727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7336ed15-15b0-4cfa-819f-947dd37a8cc5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:44.037518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7336ed15-15b0-4cfa-819f-947dd37a8cc5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:44.037966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7336ed15-15b0-4cfa-819f-947dd37a8cc5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:44.069125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7336ed15-15b0-4cfa-819f-947dd37a8cc5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043443 Sep 14 19:45:44.069626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 343/665] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:44 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:44.345206 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-20e10b07-f1de-4e4f-b09c-fb24808c5fbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:44.345838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-20e10b07-f1de-4e4f-b09c-fb24808c5fbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:44.351639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20e10b07-f1de-4e4f-b09c-fb24808c5fbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:44.352086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20e10b07-f1de-4e4f-b09c-fb24808c5fbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:44.352850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20e10b07-f1de-4e4f-b09c-fb24808c5fbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:44.353281 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20e10b07-f1de-4e4f-b09c-fb24808c5fbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:44.485664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-20e10b07-f1de-4e4f-b09c-fb24808c5fbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:44.494760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-20e10b07-f1de-4e4f-b09c-fb24808c5fbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:44.496293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-20e10b07-f1de-4e4f-b09c-fb24808c5fbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:44.497480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-20e10b07-f1de-4e4f-b09c-fb24808c5fbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.156097 Sep 14 19:45:44.503344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 323/666] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:45.081284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8850b1ac-9b1b-4e5a-9a2a-2250abeb8be7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:45.082148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8850b1ac-9b1b-4e5a-9a2a-2250abeb8be7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:45.087993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8850b1ac-9b1b-4e5a-9a2a-2250abeb8be7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:45.088442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8850b1ac-9b1b-4e5a-9a2a-2250abeb8be7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:45.089221 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8850b1ac-9b1b-4e5a-9a2a-2250abeb8be7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:45.090420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8850b1ac-9b1b-4e5a-9a2a-2250abeb8be7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:45.119090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8850b1ac-9b1b-4e5a-9a2a-2250abeb8be7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041621 Sep 14 19:45:45.120076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 344/667] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:45 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:45.519380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1a43f78c-88e7-437e-9d7a-2e3f1e81bb45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:45.519982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1a43f78c-88e7-437e-9d7a-2e3f1e81bb45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:45.529958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a43f78c-88e7-437e-9d7a-2e3f1e81bb45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:45.529958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a43f78c-88e7-437e-9d7a-2e3f1e81bb45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:45.529958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a43f78c-88e7-437e-9d7a-2e3f1e81bb45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:45.529958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a43f78c-88e7-437e-9d7a-2e3f1e81bb45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:45.650101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1a43f78c-88e7-437e-9d7a-2e3f1e81bb45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:45.658287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1a43f78c-88e7-437e-9d7a-2e3f1e81bb45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:45.659810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1a43f78c-88e7-437e-9d7a-2e3f1e81bb45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:45.660955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1a43f78c-88e7-437e-9d7a-2e3f1e81bb45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.145278 Sep 14 19:45:45.661526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 324/668] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:46.131982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-61952603-a804-4ea6-8830-2f671c6659f5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:46.132880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-61952603-a804-4ea6-8830-2f671c6659f5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:46.139140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-61952603-a804-4ea6-8830-2f671c6659f5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:46.139600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-61952603-a804-4ea6-8830-2f671c6659f5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:46.140350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-61952603-a804-4ea6-8830-2f671c6659f5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:46.140781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-61952603-a804-4ea6-8830-2f671c6659f5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:46.172064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-61952603-a804-4ea6-8830-2f671c6659f5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Sep 14 19:45:46.172631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 345/669] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:46 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:46.678877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8bfe30d1-31d8-464a-bafd-97e1704dd0de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:46.679479 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8bfe30d1-31d8-464a-bafd-97e1704dd0de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:46.685627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8bfe30d1-31d8-464a-bafd-97e1704dd0de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:46.686079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8bfe30d1-31d8-464a-bafd-97e1704dd0de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:46.686964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8bfe30d1-31d8-464a-bafd-97e1704dd0de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:46.687331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8bfe30d1-31d8-464a-bafd-97e1704dd0de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:46.818497 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8bfe30d1-31d8-464a-bafd-97e1704dd0de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:46.826989 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8bfe30d1-31d8-464a-bafd-97e1704dd0de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:46.828480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8bfe30d1-31d8-464a-bafd-97e1704dd0de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:46.829690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8bfe30d1-31d8-464a-bafd-97e1704dd0de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.154575 Sep 14 19:45:46.830253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 325/670] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:47.188842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-17859be5-de96-4367-a2f6-61dd4964db01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:47.189902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-17859be5-de96-4367-a2f6-61dd4964db01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:47.196181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17859be5-de96-4367-a2f6-61dd4964db01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:47.196722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17859be5-de96-4367-a2f6-61dd4964db01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:47.197401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17859be5-de96-4367-a2f6-61dd4964db01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:47.197876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17859be5-de96-4367-a2f6-61dd4964db01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:47.228276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-17859be5-de96-4367-a2f6-61dd4964db01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046668 Sep 14 19:45:47.228842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 346/671] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:47 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:45:47.848282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4e7fff64-2389-49b5-8d45-b98cd737f115 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:47.848906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4e7fff64-2389-49b5-8d45-b98cd737f115 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:47.854693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e7fff64-2389-49b5-8d45-b98cd737f115 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:47.855141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e7fff64-2389-49b5-8d45-b98cd737f115 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:47.855943 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e7fff64-2389-49b5-8d45-b98cd737f115 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:47.856373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e7fff64-2389-49b5-8d45-b98cd737f115 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:47.981696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4e7fff64-2389-49b5-8d45-b98cd737f115 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:47.988069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4e7fff64-2389-49b5-8d45-b98cd737f115 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:47.989573 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4e7fff64-2389-49b5-8d45-b98cd737f115 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:47.990738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4e7fff64-2389-49b5-8d45-b98cd737f115 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.146366 Sep 14 19:45:47.991294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 326/672] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:47 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:45:48.239985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5d80ae92-ea11-4884-b4c2-b38760beb0ae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:48.240870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5d80ae92-ea11-4884-b4c2-b38760beb0ae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:48.247260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d80ae92-ea11-4884-b4c2-b38760beb0ae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:48.247712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d80ae92-ea11-4884-b4c2-b38760beb0ae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:48.248495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d80ae92-ea11-4884-b4c2-b38760beb0ae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:48.248925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d80ae92-ea11-4884-b4c2-b38760beb0ae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:48.282113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5d80ae92-ea11-4884-b4c2-b38760beb0ae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046073 Sep 14 19:45:48.282672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 347/673] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:48 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:49.008056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8ccadd40-89e5-40e3-9aaa-e55c01dc90ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:49.008648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8ccadd40-89e5-40e3-9aaa-e55c01dc90ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:49.014982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ccadd40-89e5-40e3-9aaa-e55c01dc90ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:49.015422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ccadd40-89e5-40e3-9aaa-e55c01dc90ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:49.016209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ccadd40-89e5-40e3-9aaa-e55c01dc90ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:49.016646 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ccadd40-89e5-40e3-9aaa-e55c01dc90ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:49.146361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8ccadd40-89e5-40e3-9aaa-e55c01dc90ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:49.155585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8ccadd40-89e5-40e3-9aaa-e55c01dc90ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:49.157068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8ccadd40-89e5-40e3-9aaa-e55c01dc90ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:49.158265 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8ccadd40-89e5-40e3-9aaa-e55c01dc90ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.153989 Sep 14 19:45:49.158820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 327/674] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:49 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:49.293932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-43e05897-d2ed-4f1d-bb94-b15a87f29341 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:49.295079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-43e05897-d2ed-4f1d-bb94-b15a87f29341 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:49.301810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-43e05897-d2ed-4f1d-bb94-b15a87f29341 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:49.302366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-43e05897-d2ed-4f1d-bb94-b15a87f29341 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:49.303167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-43e05897-d2ed-4f1d-bb94-b15a87f29341 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:49.303605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-43e05897-d2ed-4f1d-bb94-b15a87f29341 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:49.333807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-43e05897-d2ed-4f1d-bb94-b15a87f29341 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Sep 14 19:45:49.334377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 348/675] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:49 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:50.175594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4ec9b66c-538d-4563-afb3-7cd072c643d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:50.176203 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4ec9b66c-538d-4563-afb3-7cd072c643d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:50.182247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4ec9b66c-538d-4563-afb3-7cd072c643d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:50.182689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4ec9b66c-538d-4563-afb3-7cd072c643d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:50.183619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4ec9b66c-538d-4563-afb3-7cd072c643d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:50.184568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4ec9b66c-538d-4563-afb3-7cd072c643d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:50.307027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4ec9b66c-538d-4563-afb3-7cd072c643d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:50.316064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4ec9b66c-538d-4563-afb3-7cd072c643d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:50.317589 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4ec9b66c-538d-4563-afb3-7cd072c643d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:50.318801 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4ec9b66c-538d-4563-afb3-7cd072c643d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.147171 Sep 14 19:45:50.319374 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 328/676] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:50 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:50.346360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-716a8d9c-0072-4e07-af1e-8e7b475dd7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:50.347274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-716a8d9c-0072-4e07-af1e-8e7b475dd7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:50.353359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-716a8d9c-0072-4e07-af1e-8e7b475dd7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:50.353845 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-716a8d9c-0072-4e07-af1e-8e7b475dd7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:50.354621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-716a8d9c-0072-4e07-af1e-8e7b475dd7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:50.355573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-716a8d9c-0072-4e07-af1e-8e7b475dd7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:50.385223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-716a8d9c-0072-4e07-af1e-8e7b475dd7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Sep 14 19:45:50.385822 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 349/677] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:50 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:51.336711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-241b2b10-7116-42cb-b1b4-b128d181f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:51.337321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-241b2b10-7116-42cb-b1b4-b128d181f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:51.343047 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-241b2b10-7116-42cb-b1b4-b128d181f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:51.343492 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-241b2b10-7116-42cb-b1b4-b128d181f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:51.344262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-241b2b10-7116-42cb-b1b4-b128d181f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:51.344705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-241b2b10-7116-42cb-b1b4-b128d181f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:51.396757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8a521d41-b16c-4495-93cb-45192eed4b69 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:51.397718 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8a521d41-b16c-4495-93cb-45192eed4b69 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:51.403808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a521d41-b16c-4495-93cb-45192eed4b69 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:51.404520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a521d41-b16c-4495-93cb-45192eed4b69 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:51.405306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a521d41-b16c-4495-93cb-45192eed4b69 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:51.405793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a521d41-b16c-4495-93cb-45192eed4b69 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:51.436828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8a521d41-b16c-4495-93cb-45192eed4b69 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Sep 14 19:45:51.437408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 350/678] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:51 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:45:51.467902 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-241b2b10-7116-42cb-b1b4-b128d181f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:51.477838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-241b2b10-7116-42cb-b1b4-b128d181f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:51.481264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-241b2b10-7116-42cb-b1b4-b128d181f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:51.484848 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-241b2b10-7116-42cb-b1b4-b128d181f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.150646 Sep 14 19:45:51.484848 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 329/679] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:51 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:52.448285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0db9b6be-40f3-465a-8450-544c1a08e904 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:52.449206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0db9b6be-40f3-465a-8450-544c1a08e904 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:52.455360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0db9b6be-40f3-465a-8450-544c1a08e904 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:52.455822 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0db9b6be-40f3-465a-8450-544c1a08e904 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:52.480763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0db9b6be-40f3-465a-8450-544c1a08e904 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:52.480763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0db9b6be-40f3-465a-8450-544c1a08e904 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:52.488293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0db9b6be-40f3-465a-8450-544c1a08e904 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Sep 14 19:45:52.488865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 351/680] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:52 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:52.503422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1b50cfb7-6811-46cd-af8d-12d31ddefa5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:52.504033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1b50cfb7-6811-46cd-af8d-12d31ddefa5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:52.510145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b50cfb7-6811-46cd-af8d-12d31ddefa5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:52.510598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b50cfb7-6811-46cd-af8d-12d31ddefa5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:52.511602 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b50cfb7-6811-46cd-af8d-12d31ddefa5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:52.512039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b50cfb7-6811-46cd-af8d-12d31ddefa5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:52.636897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1b50cfb7-6811-46cd-af8d-12d31ddefa5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:52.646126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1b50cfb7-6811-46cd-af8d-12d31ddefa5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:52.647622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1b50cfb7-6811-46cd-af8d-12d31ddefa5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:52.648852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1b50cfb7-6811-46cd-af8d-12d31ddefa5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.149552 Sep 14 19:45:52.649420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 330/681] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:53.500283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2bf24e0f-a719-40ef-83e7-ffa431b91d34 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:53.501130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2bf24e0f-a719-40ef-83e7-ffa431b91d34 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:53.507096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2bf24e0f-a719-40ef-83e7-ffa431b91d34 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:53.508963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2bf24e0f-a719-40ef-83e7-ffa431b91d34 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:53.508963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2bf24e0f-a719-40ef-83e7-ffa431b91d34 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:53.508963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2bf24e0f-a719-40ef-83e7-ffa431b91d34 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:53.537709 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2bf24e0f-a719-40ef-83e7-ffa431b91d34 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041654 Sep 14 19:45:53.538359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 352/682] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:53 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:45:53.667844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-377b64e0-3483-4b57-a814-f5f1d9c6e84e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:53.668558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-377b64e0-3483-4b57-a814-f5f1d9c6e84e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:53.674796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-377b64e0-3483-4b57-a814-f5f1d9c6e84e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:53.675242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-377b64e0-3483-4b57-a814-f5f1d9c6e84e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:53.676023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-377b64e0-3483-4b57-a814-f5f1d9c6e84e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:53.676459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-377b64e0-3483-4b57-a814-f5f1d9c6e84e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:53.815739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-377b64e0-3483-4b57-a814-f5f1d9c6e84e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:53.827624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-377b64e0-3483-4b57-a814-f5f1d9c6e84e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:53.829158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-377b64e0-3483-4b57-a814-f5f1d9c6e84e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:53.830419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-377b64e0-3483-4b57-a814-f5f1d9c6e84e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.166313 Sep 14 19:45:53.830997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 331/683] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:53 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:54.549252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-87af4a7b-8938-45ad-9cf2-5cf84a8db1b3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:54.550242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-87af4a7b-8938-45ad-9cf2-5cf84a8db1b3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:54.556351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87af4a7b-8938-45ad-9cf2-5cf84a8db1b3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:54.556768 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87af4a7b-8938-45ad-9cf2-5cf84a8db1b3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:54.557893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87af4a7b-8938-45ad-9cf2-5cf84a8db1b3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:54.557893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87af4a7b-8938-45ad-9cf2-5cf84a8db1b3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:54.590098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-87af4a7b-8938-45ad-9cf2-5cf84a8db1b3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044426 Sep 14 19:45:54.590640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 353/684] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:54 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:54.848086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eede8c74-b7a9-4298-b46a-7e397ef40ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:54.848690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eede8c74-b7a9-4298-b46a-7e397ef40ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:54.854951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eede8c74-b7a9-4298-b46a-7e397ef40ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:54.855724 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eede8c74-b7a9-4298-b46a-7e397ef40ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:54.857283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eede8c74-b7a9-4298-b46a-7e397ef40ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:54.858183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eede8c74-b7a9-4298-b46a-7e397ef40ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:54.981281 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eede8c74-b7a9-4298-b46a-7e397ef40ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:54.989808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eede8c74-b7a9-4298-b46a-7e397ef40ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:54.991334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eede8c74-b7a9-4298-b46a-7e397ef40ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:54.992514 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eede8c74-b7a9-4298-b46a-7e397ef40ab0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.148191 Sep 14 19:45:54.993192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 332/685] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:55.601231 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cd87d77b-08e8-4d5b-bd72-d98c2210214d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:55.602099 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cd87d77b-08e8-4d5b-bd72-d98c2210214d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:55.608508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd87d77b-08e8-4d5b-bd72-d98c2210214d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:55.613343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd87d77b-08e8-4d5b-bd72-d98c2210214d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:55.613343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd87d77b-08e8-4d5b-bd72-d98c2210214d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:55.613343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd87d77b-08e8-4d5b-bd72-d98c2210214d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:55.640292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cd87d77b-08e8-4d5b-bd72-d98c2210214d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043166 Sep 14 19:45:55.640860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 354/686] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:55 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:56.011866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fe901481-2de7-4889-9f15-afdf5be34f7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:56.012512 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fe901481-2de7-4889-9f15-afdf5be34f7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:56.018344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe901481-2de7-4889-9f15-afdf5be34f7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:56.018784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe901481-2de7-4889-9f15-afdf5be34f7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:56.019569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe901481-2de7-4889-9f15-afdf5be34f7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:56.020003 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe901481-2de7-4889-9f15-afdf5be34f7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:56.139076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fe901481-2de7-4889-9f15-afdf5be34f7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:56.147416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fe901481-2de7-4889-9f15-afdf5be34f7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:56.148931 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fe901481-2de7-4889-9f15-afdf5be34f7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:56.150246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fe901481-2de7-4889-9f15-afdf5be34f7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.142847 Sep 14 19:45:56.150839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 333/687] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:56 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:56.651807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d3e45649-4f37-4359-99e8-507b8e183814 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:56.652720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d3e45649-4f37-4359-99e8-507b8e183814 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:56.658655 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3e45649-4f37-4359-99e8-507b8e183814 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:56.659098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3e45649-4f37-4359-99e8-507b8e183814 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:56.659865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3e45649-4f37-4359-99e8-507b8e183814 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:56.660323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3e45649-4f37-4359-99e8-507b8e183814 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:56.696502 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d3e45649-4f37-4359-99e8-507b8e183814 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048291 Sep 14 19:45:56.697073 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 355/688] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:56 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:57.169642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-86a32b75-4d39-41ee-80f8-d849f5748285 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:57.170245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-86a32b75-4d39-41ee-80f8-d849f5748285 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:57.177107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86a32b75-4d39-41ee-80f8-d849f5748285 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:57.177608 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86a32b75-4d39-41ee-80f8-d849f5748285 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:57.178658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86a32b75-4d39-41ee-80f8-d849f5748285 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:57.179104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-86a32b75-4d39-41ee-80f8-d849f5748285 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:57.304652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-86a32b75-4d39-41ee-80f8-d849f5748285 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:57.313366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-86a32b75-4d39-41ee-80f8-d849f5748285 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:57.314939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-86a32b75-4d39-41ee-80f8-d849f5748285 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:57.316119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-86a32b75-4d39-41ee-80f8-d849f5748285 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.151005 Sep 14 19:45:57.316680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 334/689] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:57 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:57.708171 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-64c561a3-6391-4793-bb98-e840156d83ff tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:57.709089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-64c561a3-6391-4793-bb98-e840156d83ff tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:57.715784 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64c561a3-6391-4793-bb98-e840156d83ff tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:57.716195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64c561a3-6391-4793-bb98-e840156d83ff tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:57.716954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64c561a3-6391-4793-bb98-e840156d83ff tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:57.717393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64c561a3-6391-4793-bb98-e840156d83ff tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:57.746724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-64c561a3-6391-4793-bb98-e840156d83ff tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042313 Sep 14 19:45:57.747289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 356/690] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:57 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:58.334217 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5df5c41a-1eaa-4fb2-b3e9-f8225206663a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:58.334748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5df5c41a-1eaa-4fb2-b3e9-f8225206663a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:58.340595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5df5c41a-1eaa-4fb2-b3e9-f8225206663a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:58.341042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5df5c41a-1eaa-4fb2-b3e9-f8225206663a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:58.341846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5df5c41a-1eaa-4fb2-b3e9-f8225206663a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:58.342282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5df5c41a-1eaa-4fb2-b3e9-f8225206663a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:58.464392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5df5c41a-1eaa-4fb2-b3e9-f8225206663a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:58.471949 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5df5c41a-1eaa-4fb2-b3e9-f8225206663a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:58.473444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5df5c41a-1eaa-4fb2-b3e9-f8225206663a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:58.474680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5df5c41a-1eaa-4fb2-b3e9-f8225206663a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.144279 Sep 14 19:45:58.475240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 335/691] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:58 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:58.758396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-efbc4a5e-2720-4d8f-8c52-47d18128f447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:58.759434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-efbc4a5e-2720-4d8f-8c52-47d18128f447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:58.766261 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efbc4a5e-2720-4d8f-8c52-47d18128f447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:58.766714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efbc4a5e-2720-4d8f-8c52-47d18128f447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:58.767496 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efbc4a5e-2720-4d8f-8c52-47d18128f447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:58.767981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efbc4a5e-2720-4d8f-8c52-47d18128f447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:58.797375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-efbc4a5e-2720-4d8f-8c52-47d18128f447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042853 Sep 14 19:45:58.798019 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 357/692] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:58 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:59.492392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8b4bd7da-dc5c-4395-b8e3-e637d08709e0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:59.493008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8b4bd7da-dc5c-4395-b8e3-e637d08709e0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:59.498969 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8b4bd7da-dc5c-4395-b8e3-e637d08709e0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:59.499401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8b4bd7da-dc5c-4395-b8e3-e637d08709e0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:59.500181 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8b4bd7da-dc5c-4395-b8e3-e637d08709e0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:59.500700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8b4bd7da-dc5c-4395-b8e3-e637d08709e0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:59.635665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8b4bd7da-dc5c-4395-b8e3-e637d08709e0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:59.646446 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8b4bd7da-dc5c-4395-b8e3-e637d08709e0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:59.648240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8b4bd7da-dc5c-4395-b8e3-e637d08709e0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:45:59.649618 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8b4bd7da-dc5c-4395-b8e3-e637d08709e0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.160920 Sep 14 19:45:59.650280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 336/693] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:45:59 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:45:59.808404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2aba4954-3536-436b-a2cb-252d7584b9d2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:59.809974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2aba4954-3536-436b-a2cb-252d7584b9d2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:45:59.815774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2aba4954-3536-436b-a2cb-252d7584b9d2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:59.816366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2aba4954-3536-436b-a2cb-252d7584b9d2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:59.817156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2aba4954-3536-436b-a2cb-252d7584b9d2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:45:59.817634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2aba4954-3536-436b-a2cb-252d7584b9d2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:45:59.849267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2aba4954-3536-436b-a2cb-252d7584b9d2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Sep 14 19:45:59.849871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 358/694] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:45:59 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:00.669447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-12491d56-2d79-4b7c-b7e8-d02b19432e15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:00.670080 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-12491d56-2d79-4b7c-b7e8-d02b19432e15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:00.676038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12491d56-2d79-4b7c-b7e8-d02b19432e15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:00.676479 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12491d56-2d79-4b7c-b7e8-d02b19432e15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:00.677242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12491d56-2d79-4b7c-b7e8-d02b19432e15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:00.677693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12491d56-2d79-4b7c-b7e8-d02b19432e15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:00.731707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-16306474-ce21-460a-8c5a-349aa54f3a55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:00.732202 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-16306474-ce21-460a-8c5a-349aa54f3a55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:00.738245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16306474-ce21-460a-8c5a-349aa54f3a55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:00.738704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16306474-ce21-460a-8c5a-349aa54f3a55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:00.742242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16306474-ce21-460a-8c5a-349aa54f3a55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:00.742242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16306474-ce21-460a-8c5a-349aa54f3a55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:00.823526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-12491d56-2d79-4b7c-b7e8-d02b19432e15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:00.831446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-16306474-ce21-460a-8c5a-349aa54f3a55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lazy-loading 'services' on Instance uuid 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:46:00.832194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-12491d56-2d79-4b7c-b7e8-d02b19432e15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:00.833740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-12491d56-2d79-4b7c-b7e8-d02b19432e15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:00.834912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-12491d56-2d79-4b7c-b7e8-d02b19432e15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.170016 Sep 14 19:46:00.835470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 337/695] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:46:00 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:46:00.860525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7053a387-af3d-4689-8b40-9c023ebbba21 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:00.861610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7053a387-af3d-4689-8b40-9c023ebbba21 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:00.867421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7053a387-af3d-4689-8b40-9c023ebbba21 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:00.867861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7053a387-af3d-4689-8b40-9c023ebbba21 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:00.868626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7053a387-af3d-4689-8b40-9c023ebbba21 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:00.869055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7053a387-af3d-4689-8b40-9c023ebbba21 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:00.898824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7053a387-af3d-4689-8b40-9c023ebbba21 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041918 Sep 14 19:46:00.899372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 338/696] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:00 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:01.146860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-16306474-ce21-460a-8c5a-349aa54f3a55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments/a8158e22-8c89-4115-bde6-48f56d640235" status: 202 len: 0 microversion: 2.1 time: 0.419223 Sep 14 19:46:01.147453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 359/697] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Sep 14 19:46:00 2021] DELETE /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments/a8158e22-8c89-4115-bde6-48f56d640235 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:46:01.157344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ed603b23-ac96-4c17-874a-191cd8cea6ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:01.158759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ed603b23-ac96-4c17-874a-191cd8cea6ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:01.164824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed603b23-ac96-4c17-874a-191cd8cea6ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:01.165444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed603b23-ac96-4c17-874a-191cd8cea6ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:01.166390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed603b23-ac96-4c17-874a-191cd8cea6ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:01.166961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed603b23-ac96-4c17-874a-191cd8cea6ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:01.171436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-50273d29-43db-413b-b5fa-89c492a4f4e7 req-40650a3a-acb1-412b-83c9-da451c6da784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a26129-f7fb-4755-979a-968cdf0c7d34", "name": "network-vif-plugged", "status": "completed", "tag": "f0babfc4-e4f0-41d5-9206-dc7125b0b10e"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:46:01.173248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:46:01.173248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:46:01.180884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-50273d29-43db-413b-b5fa-89c492a4f4e7 req-40650a3a-acb1-412b-83c9-da451c6da784 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:01.181332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-50273d29-43db-413b-b5fa-89c492a4f4e7 req-40650a3a-acb1-412b-83c9-da451c6da784 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:01.192391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-50273d29-43db-413b-b5fa-89c492a4f4e7 req-40650a3a-acb1-412b-83c9-da451c6da784 service nova] Creating event network-vif-plugged:f0babfc4-e4f0-41d5-9206-dc7125b0b10e for instance 72a26129-f7fb-4755-979a-968cdf0c7d34 on hv-cinder-80588 Sep 14 19:46:01.197189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-50273d29-43db-413b-b5fa-89c492a4f4e7 req-40650a3a-acb1-412b-83c9-da451c6da784 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030207 Sep 14 19:46:01.197815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 360/698] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:46:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:01.199670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ed603b23-ac96-4c17-874a-191cd8cea6ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047516 Sep 14 19:46:01.200095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 339/699] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:01 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:01.854426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-01e5a54a-b4e6-4109-a4ca-eea0f3d5a2e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:01.855160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-01e5a54a-b4e6-4109-a4ca-eea0f3d5a2e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:01.861839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-01e5a54a-b4e6-4109-a4ca-eea0f3d5a2e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:01.862292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-01e5a54a-b4e6-4109-a4ca-eea0f3d5a2e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:01.863090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-01e5a54a-b4e6-4109-a4ca-eea0f3d5a2e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:01.863531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-01e5a54a-b4e6-4109-a4ca-eea0f3d5a2e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:01.913677 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6c6abe64-13d9-4aeb-a803-19704faa425e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:01.914639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6c6abe64-13d9-4aeb-a803-19704faa425e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:01.921130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6c6abe64-13d9-4aeb-a803-19704faa425e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:01.922041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6c6abe64-13d9-4aeb-a803-19704faa425e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:01.922709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6c6abe64-13d9-4aeb-a803-19704faa425e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:01.923151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6c6abe64-13d9-4aeb-a803-19704faa425e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:01.960558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6c6abe64-13d9-4aeb-a803-19704faa425e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050725 Sep 14 19:46:01.960558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 340/700] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:01 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:02.040226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-01e5a54a-b4e6-4109-a4ca-eea0f3d5a2e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:02.049403 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-01e5a54a-b4e6-4109-a4ca-eea0f3d5a2e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:02.050957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-01e5a54a-b4e6-4109-a4ca-eea0f3d5a2e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:02.052125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-01e5a54a-b4e6-4109-a4ca-eea0f3d5a2e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.202842 Sep 14 19:46:02.052685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 361/701] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:46:01 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:46:02.210429 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c3a3b60e-10fc-48b7-960c-650bb5fba809 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:02.211425 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c3a3b60e-10fc-48b7-960c-650bb5fba809 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:02.218130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3a3b60e-10fc-48b7-960c-650bb5fba809 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:02.220212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3a3b60e-10fc-48b7-960c-650bb5fba809 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:02.220212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3a3b60e-10fc-48b7-960c-650bb5fba809 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:02.220212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3a3b60e-10fc-48b7-960c-650bb5fba809 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:02.264575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c3a3b60e-10fc-48b7-960c-650bb5fba809 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057846 Sep 14 19:46:02.265258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 341/702] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:02 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:02.970693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a0528a21-a598-40fb-9449-7ed74db1efae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:02.971611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a0528a21-a598-40fb-9449-7ed74db1efae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:02.978082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a0528a21-a598-40fb-9449-7ed74db1efae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:02.978529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a0528a21-a598-40fb-9449-7ed74db1efae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:02.979299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a0528a21-a598-40fb-9449-7ed74db1efae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:02.980228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a0528a21-a598-40fb-9449-7ed74db1efae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:03.014706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a0528a21-a598-40fb-9449-7ed74db1efae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047731 Sep 14 19:46:03.015281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 362/703] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:02 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:03.070553 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-da5c0775-1860-4585-9095-3bd0ce5c968a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:03.071150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-da5c0775-1860-4585-9095-3bd0ce5c968a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:03.077026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-da5c0775-1860-4585-9095-3bd0ce5c968a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:03.077408 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-da5c0775-1860-4585-9095-3bd0ce5c968a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:03.078269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-da5c0775-1860-4585-9095-3bd0ce5c968a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:03.078710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-da5c0775-1860-4585-9095-3bd0ce5c968a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:03.199337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-da5c0775-1860-4585-9095-3bd0ce5c968a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:03.207957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-da5c0775-1860-4585-9095-3bd0ce5c968a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:03.209464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-da5c0775-1860-4585-9095-3bd0ce5c968a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:03.210667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-da5c0775-1860-4585-9095-3bd0ce5c968a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.143806 Sep 14 19:46:03.211241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 342/704] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:46:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:46:03.276187 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ed23b02a-631a-4f3f-8492-393d125ffbaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:03.277665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ed23b02a-631a-4f3f-8492-393d125ffbaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:03.283569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed23b02a-631a-4f3f-8492-393d125ffbaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:03.285890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed23b02a-631a-4f3f-8492-393d125ffbaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:03.285890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed23b02a-631a-4f3f-8492-393d125ffbaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:03.285890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed23b02a-631a-4f3f-8492-393d125ffbaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:03.315082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ed23b02a-631a-4f3f-8492-393d125ffbaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Sep 14 19:46:03.315655 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 363/705] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:03 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:04.025765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bb51d291-f141-4057-a995-8cbc16237cf3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:04.026683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bb51d291-f141-4057-a995-8cbc16237cf3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:04.032610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb51d291-f141-4057-a995-8cbc16237cf3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:04.033058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb51d291-f141-4057-a995-8cbc16237cf3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:04.033936 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb51d291-f141-4057-a995-8cbc16237cf3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:04.034384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb51d291-f141-4057-a995-8cbc16237cf3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:04.064545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bb51d291-f141-4057-a995-8cbc16237cf3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 Sep 14 19:46:04.065107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 343/706] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:04 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:04.229383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b32dac65-2f07-45ad-899e-9340c077afbb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:04.230526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b32dac65-2f07-45ad-899e-9340c077afbb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:04.236521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b32dac65-2f07-45ad-899e-9340c077afbb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:04.236975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b32dac65-2f07-45ad-899e-9340c077afbb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:04.237793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b32dac65-2f07-45ad-899e-9340c077afbb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:04.238236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b32dac65-2f07-45ad-899e-9340c077afbb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:04.326696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ee551fce-d76f-4681-8aa1-984bf152bcc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:04.327598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ee551fce-d76f-4681-8aa1-984bf152bcc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:04.333472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee551fce-d76f-4681-8aa1-984bf152bcc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:04.333946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee551fce-d76f-4681-8aa1-984bf152bcc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:04.334716 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee551fce-d76f-4681-8aa1-984bf152bcc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:04.335143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee551fce-d76f-4681-8aa1-984bf152bcc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:04.363999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b32dac65-2f07-45ad-899e-9340c077afbb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:04.365011 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ee551fce-d76f-4681-8aa1-984bf152bcc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042042 Sep 14 19:46:04.365609 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 344/707] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:04 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:04.373386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b32dac65-2f07-45ad-899e-9340c077afbb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:04.374911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b32dac65-2f07-45ad-899e-9340c077afbb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:04.376119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b32dac65-2f07-45ad-899e-9340c077afbb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.150514 Sep 14 19:46:04.376677 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 364/708] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:46:04 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:46:05.076520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d92edf56-5921-4426-8338-323999bb34ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:05.077429 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d92edf56-5921-4426-8338-323999bb34ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:05.083220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d92edf56-5921-4426-8338-323999bb34ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:05.083672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d92edf56-5921-4426-8338-323999bb34ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:05.084449 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d92edf56-5921-4426-8338-323999bb34ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:05.084890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d92edf56-5921-4426-8338-323999bb34ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:05.114882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d92edf56-5921-4426-8338-323999bb34ca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042625 Sep 14 19:46:05.115445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 345/709] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:05 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:05.376877 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a2114f66-1f67-4bac-94f1-84079adccda6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:05.377757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a2114f66-1f67-4bac-94f1-84079adccda6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:05.383746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2114f66-1f67-4bac-94f1-84079adccda6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:05.384197 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2114f66-1f67-4bac-94f1-84079adccda6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:05.384982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2114f66-1f67-4bac-94f1-84079adccda6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:05.385421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a2114f66-1f67-4bac-94f1-84079adccda6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:05.395576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6be2bef6-aaed-4822-908e-a34dbdba2544 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:05.396306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6be2bef6-aaed-4822-908e-a34dbdba2544 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:05.402559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6be2bef6-aaed-4822-908e-a34dbdba2544 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:05.403002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6be2bef6-aaed-4822-908e-a34dbdba2544 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:05.403772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6be2bef6-aaed-4822-908e-a34dbdba2544 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:05.404207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6be2bef6-aaed-4822-908e-a34dbdba2544 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:05.417311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a2114f66-1f67-4bac-94f1-84079adccda6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Sep 14 19:46:05.417903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 365/710] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:05 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:05.523632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6be2bef6-aaed-4822-908e-a34dbdba2544 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:05.531617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6be2bef6-aaed-4822-908e-a34dbdba2544 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:05.533104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6be2bef6-aaed-4822-908e-a34dbdba2544 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:05.534285 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6be2bef6-aaed-4822-908e-a34dbdba2544 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.143906 Sep 14 19:46:05.534812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 346/711] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:46:05 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:46:06.126740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ae2e7d53-4e89-4c4b-8b34-d9938f563fbf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:06.127634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ae2e7d53-4e89-4c4b-8b34-d9938f563fbf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:06.133449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae2e7d53-4e89-4c4b-8b34-d9938f563fbf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:06.133923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae2e7d53-4e89-4c4b-8b34-d9938f563fbf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:06.134692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae2e7d53-4e89-4c4b-8b34-d9938f563fbf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:06.135121 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae2e7d53-4e89-4c4b-8b34-d9938f563fbf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:06.163630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ae2e7d53-4e89-4c4b-8b34-d9938f563fbf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040667 Sep 14 19:46:06.164187 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 366/712] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:06 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:06.429217 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2b8dbdd7-aee8-4456-b5d4-d1c78e8b859b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:06.430084 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2b8dbdd7-aee8-4456-b5d4-d1c78e8b859b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:06.436027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b8dbdd7-aee8-4456-b5d4-d1c78e8b859b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:06.436468 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b8dbdd7-aee8-4456-b5d4-d1c78e8b859b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:06.437238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b8dbdd7-aee8-4456-b5d4-d1c78e8b859b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:06.437713 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b8dbdd7-aee8-4456-b5d4-d1c78e8b859b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:06.466682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2b8dbdd7-aee8-4456-b5d4-d1c78e8b859b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041349 Sep 14 19:46:06.467214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 347/713] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:06 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:06.552186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1c805140-49e9-4586-9eba-0d5d2e8cc209 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:06.552906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1c805140-49e9-4586-9eba-0d5d2e8cc209 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:06.559032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c805140-49e9-4586-9eba-0d5d2e8cc209 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:06.559480 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c805140-49e9-4586-9eba-0d5d2e8cc209 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:06.560251 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c805140-49e9-4586-9eba-0d5d2e8cc209 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:06.560692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c805140-49e9-4586-9eba-0d5d2e8cc209 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:06.685222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1c805140-49e9-4586-9eba-0d5d2e8cc209 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:06.693336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1c805140-49e9-4586-9eba-0d5d2e8cc209 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:06.694833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1c805140-49e9-4586-9eba-0d5d2e8cc209 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:06.695985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1c805140-49e9-4586-9eba-0d5d2e8cc209 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.147540 Sep 14 19:46:06.696533 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 367/714] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:46:06 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:46:07.176039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3ac5e1e1-a0fd-4eb4-b733-375cc6c5541e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:07.176935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3ac5e1e1-a0fd-4eb4-b733-375cc6c5541e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:07.183433 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3ac5e1e1-a0fd-4eb4-b733-375cc6c5541e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:07.183879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3ac5e1e1-a0fd-4eb4-b733-375cc6c5541e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:07.184656 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3ac5e1e1-a0fd-4eb4-b733-375cc6c5541e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:07.185089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3ac5e1e1-a0fd-4eb4-b733-375cc6c5541e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:07.220002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3ac5e1e1-a0fd-4eb4-b733-375cc6c5541e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047981 Sep 14 19:46:07.220591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 348/715] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:07 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:07.478247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a4130a09-e3f1-44a1-8ca3-341933e5f97f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:07.479161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a4130a09-e3f1-44a1-8ca3-341933e5f97f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:07.485733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a4130a09-e3f1-44a1-8ca3-341933e5f97f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:07.486183 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a4130a09-e3f1-44a1-8ca3-341933e5f97f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:07.486958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a4130a09-e3f1-44a1-8ca3-341933e5f97f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:07.487395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a4130a09-e3f1-44a1-8ca3-341933e5f97f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:07.516597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a4130a09-e3f1-44a1-8ca3-341933e5f97f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042253 Sep 14 19:46:07.517269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 368/716] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:07 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:07.715081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b34c2d3f-c44b-4654-a96c-e87c3582e263 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:07.716422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b34c2d3f-c44b-4654-a96c-e87c3582e263 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:07.721836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b34c2d3f-c44b-4654-a96c-e87c3582e263 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:07.722335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b34c2d3f-c44b-4654-a96c-e87c3582e263 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:07.723094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b34c2d3f-c44b-4654-a96c-e87c3582e263 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:07.723528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b34c2d3f-c44b-4654-a96c-e87c3582e263 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:07.857683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b34c2d3f-c44b-4654-a96c-e87c3582e263 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:07.864491 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b34c2d3f-c44b-4654-a96c-e87c3582e263 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:07.866001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b34c2d3f-c44b-4654-a96c-e87c3582e263 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:07.867159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b34c2d3f-c44b-4654-a96c-e87c3582e263 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.156545 Sep 14 19:46:07.867708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 349/717] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:46:07 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:46:08.234777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1f6327a8-c362-412d-903d-23fc0f5238f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:08.235714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1f6327a8-c362-412d-903d-23fc0f5238f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:08.241791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f6327a8-c362-412d-903d-23fc0f5238f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:08.242097 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f6327a8-c362-412d-903d-23fc0f5238f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:08.246970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f6327a8-c362-412d-903d-23fc0f5238f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:08.246970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f6327a8-c362-412d-903d-23fc0f5238f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:08.284726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1f6327a8-c362-412d-903d-23fc0f5238f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057357 Sep 14 19:46:08.285271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 369/718] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:08 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:08.527557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-26a13cbc-573f-40e1-b69d-1d2c72faf727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:08.528149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-26a13cbc-573f-40e1-b69d-1d2c72faf727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:08.534359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26a13cbc-573f-40e1-b69d-1d2c72faf727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:08.534801 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26a13cbc-573f-40e1-b69d-1d2c72faf727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:08.535570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26a13cbc-573f-40e1-b69d-1d2c72faf727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:08.535998 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26a13cbc-573f-40e1-b69d-1d2c72faf727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:08.565596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-26a13cbc-573f-40e1-b69d-1d2c72faf727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042151 Sep 14 19:46:08.573921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 350/719] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:08 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:08.884189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ad210082-5da3-4fc4-8476-f46a9aad09bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:08.884828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ad210082-5da3-4fc4-8476-f46a9aad09bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:08.890696 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ad210082-5da3-4fc4-8476-f46a9aad09bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:08.891143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ad210082-5da3-4fc4-8476-f46a9aad09bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:08.891944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ad210082-5da3-4fc4-8476-f46a9aad09bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:08.892381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ad210082-5da3-4fc4-8476-f46a9aad09bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:09.013812 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ad210082-5da3-4fc4-8476-f46a9aad09bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:09.022047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ad210082-5da3-4fc4-8476-f46a9aad09bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:09.023551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ad210082-5da3-4fc4-8476-f46a9aad09bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:09.024691 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ad210082-5da3-4fc4-8476-f46a9aad09bb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1807 microversion: 2.20 time: 0.144255 Sep 14 19:46:09.025731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 370/720] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:46:08 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:46:09.296908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-821baffc-e2ed-4fc1-b941-ae5bbf01f3f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:09.297887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-821baffc-e2ed-4fc1-b941-ae5bbf01f3f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:09.303721 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-821baffc-e2ed-4fc1-b941-ae5bbf01f3f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:09.304185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-821baffc-e2ed-4fc1-b941-ae5bbf01f3f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:09.304942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-821baffc-e2ed-4fc1-b941-ae5bbf01f3f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:09.305365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-821baffc-e2ed-4fc1-b941-ae5bbf01f3f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:09.335408 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-821baffc-e2ed-4fc1-b941-ae5bbf01f3f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043098 Sep 14 19:46:09.335990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 351/721] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:09 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:09.576925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-101e4ace-6c51-4559-900a-0c3ccf2121fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:09.577782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-101e4ace-6c51-4559-900a-0c3ccf2121fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:09.583710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-101e4ace-6c51-4559-900a-0c3ccf2121fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:09.584143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-101e4ace-6c51-4559-900a-0c3ccf2121fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:09.584908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-101e4ace-6c51-4559-900a-0c3ccf2121fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:09.585335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-101e4ace-6c51-4559-900a-0c3ccf2121fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:09.616197 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-101e4ace-6c51-4559-900a-0c3ccf2121fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Sep 14 19:46:09.616797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 371/722] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:09 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:10.043037 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a325ca81-b8fd-4a5c-84c6-6801c248cabd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:10.043642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a325ca81-b8fd-4a5c-84c6-6801c248cabd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:10.049858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a325ca81-b8fd-4a5c-84c6-6801c248cabd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:10.050319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a325ca81-b8fd-4a5c-84c6-6801c248cabd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:10.051097 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a325ca81-b8fd-4a5c-84c6-6801c248cabd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:10.051540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a325ca81-b8fd-4a5c-84c6-6801c248cabd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:10.174910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a325ca81-b8fd-4a5c-84c6-6801c248cabd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:10.183806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a325ca81-b8fd-4a5c-84c6-6801c248cabd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:10.185350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a325ca81-b8fd-4a5c-84c6-6801c248cabd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:10.186552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a325ca81-b8fd-4a5c-84c6-6801c248cabd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1794 microversion: 2.20 time: 0.147348 Sep 14 19:46:10.188079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 352/723] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:46:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1794 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:46:10.347803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4b76a15e-9d3d-4f5c-a748-6cd18c02dc37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:10.348726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4b76a15e-9d3d-4f5c-a748-6cd18c02dc37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:10.355290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b76a15e-9d3d-4f5c-a748-6cd18c02dc37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:10.355740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b76a15e-9d3d-4f5c-a748-6cd18c02dc37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:10.356524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b76a15e-9d3d-4f5c-a748-6cd18c02dc37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:10.356964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b76a15e-9d3d-4f5c-a748-6cd18c02dc37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:10.390314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4b76a15e-9d3d-4f5c-a748-6cd18c02dc37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046203 Sep 14 19:46:10.390789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 372/724] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:10 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:10.627701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-087ac972-f08d-4447-8e14-63ba7a44e346 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:10.628605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-087ac972-f08d-4447-8e14-63ba7a44e346 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:10.634380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-087ac972-f08d-4447-8e14-63ba7a44e346 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:10.634824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-087ac972-f08d-4447-8e14-63ba7a44e346 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:10.635581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-087ac972-f08d-4447-8e14-63ba7a44e346 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:10.636010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-087ac972-f08d-4447-8e14-63ba7a44e346 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:10.668987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-087ac972-f08d-4447-8e14-63ba7a44e346 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Sep 14 19:46:10.669450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 353/725] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:10 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:11.401583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-41ade7e2-423a-4b31-a3a2-fe28bc658c12 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:11.402474 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-41ade7e2-423a-4b31-a3a2-fe28bc658c12 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:11.408309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41ade7e2-423a-4b31-a3a2-fe28bc658c12 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:11.408765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41ade7e2-423a-4b31-a3a2-fe28bc658c12 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:11.409554 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41ade7e2-423a-4b31-a3a2-fe28bc658c12 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:11.409996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41ade7e2-423a-4b31-a3a2-fe28bc658c12 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:11.444227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-41ade7e2-423a-4b31-a3a2-fe28bc658c12 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046436 Sep 14 19:46:11.444775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 373/726] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:11.680147 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-93c7ac88-cada-4bca-99d3-28513a854534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:11.681088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-93c7ac88-cada-4bca-99d3-28513a854534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:11.687587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93c7ac88-cada-4bca-99d3-28513a854534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:11.688034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93c7ac88-cada-4bca-99d3-28513a854534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:11.688808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93c7ac88-cada-4bca-99d3-28513a854534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:11.689243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93c7ac88-cada-4bca-99d3-28513a854534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:11.717786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-93c7ac88-cada-4bca-99d3-28513a854534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041361 Sep 14 19:46:11.718337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 354/727] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:11 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:12.455701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-894d399e-4891-42cc-a7c7-cb54d3b9dd9b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:12.461354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-894d399e-4891-42cc-a7c7-cb54d3b9dd9b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:12.462431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-894d399e-4891-42cc-a7c7-cb54d3b9dd9b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:12.462873 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-894d399e-4891-42cc-a7c7-cb54d3b9dd9b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:12.464133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-894d399e-4891-42cc-a7c7-cb54d3b9dd9b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:12.464560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-894d399e-4891-42cc-a7c7-cb54d3b9dd9b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:12.495586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-894d399e-4891-42cc-a7c7-cb54d3b9dd9b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Sep 14 19:46:12.498025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 374/728] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:12 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:12.729249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8acf1f00-0dc2-4b3c-9b57-da71e8adb9e6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:12.730210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8acf1f00-0dc2-4b3c-9b57-da71e8adb9e6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:12.736389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8acf1f00-0dc2-4b3c-9b57-da71e8adb9e6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:12.736829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8acf1f00-0dc2-4b3c-9b57-da71e8adb9e6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:12.737681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8acf1f00-0dc2-4b3c-9b57-da71e8adb9e6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:12.738102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8acf1f00-0dc2-4b3c-9b57-da71e8adb9e6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:12.768083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8acf1f00-0dc2-4b3c-9b57-da71e8adb9e6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Sep 14 19:46:12.768658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 355/729] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:12 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:13.507516 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-45b92630-bde0-4eee-8969-e4f45188e21c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:13.508434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-45b92630-bde0-4eee-8969-e4f45188e21c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:13.514404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45b92630-bde0-4eee-8969-e4f45188e21c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:13.514853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45b92630-bde0-4eee-8969-e4f45188e21c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:13.515624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45b92630-bde0-4eee-8969-e4f45188e21c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:13.516066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45b92630-bde0-4eee-8969-e4f45188e21c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:13.546927 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-45b92630-bde0-4eee-8969-e4f45188e21c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043174 Sep 14 19:46:13.547495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 375/730] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:13 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:13.780074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-75464d16-3118-416f-84fc-ef13cbbd97b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:13.781010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-75464d16-3118-416f-84fc-ef13cbbd97b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:13.786913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75464d16-3118-416f-84fc-ef13cbbd97b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:13.787364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75464d16-3118-416f-84fc-ef13cbbd97b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:13.788131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75464d16-3118-416f-84fc-ef13cbbd97b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:13.788573 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75464d16-3118-416f-84fc-ef13cbbd97b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:13.817743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-75464d16-3118-416f-84fc-ef13cbbd97b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 Sep 14 19:46:13.818301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 356/731] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:13 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:14.558410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-421833d3-bb92-484c-a16a-b95e297fd171 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:14.559335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-421833d3-bb92-484c-a16a-b95e297fd171 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:14.565050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-421833d3-bb92-484c-a16a-b95e297fd171 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:14.565528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-421833d3-bb92-484c-a16a-b95e297fd171 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:14.566305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-421833d3-bb92-484c-a16a-b95e297fd171 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:14.566746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-421833d3-bb92-484c-a16a-b95e297fd171 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:14.595469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-421833d3-bb92-484c-a16a-b95e297fd171 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040896 Sep 14 19:46:14.596019 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 376/732] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:14 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:14.830315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5612a8ab-2d63-48f2-8acf-90eca07d8c7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:14.831179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5612a8ab-2d63-48f2-8acf-90eca07d8c7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:14.837339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5612a8ab-2d63-48f2-8acf-90eca07d8c7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:14.837856 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5612a8ab-2d63-48f2-8acf-90eca07d8c7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:14.839616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5612a8ab-2d63-48f2-8acf-90eca07d8c7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:14.839718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5612a8ab-2d63-48f2-8acf-90eca07d8c7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:14.870098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5612a8ab-2d63-48f2-8acf-90eca07d8c7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043663 Sep 14 19:46:14.870713 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 357/733] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:14 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:15.607741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7689d41f-f5d1-4d33-8560-ef87692f29d5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:15.609055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7689d41f-f5d1-4d33-8560-ef87692f29d5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:15.614620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7689d41f-f5d1-4d33-8560-ef87692f29d5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:15.615063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7689d41f-f5d1-4d33-8560-ef87692f29d5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:15.616491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7689d41f-f5d1-4d33-8560-ef87692f29d5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:15.616924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7689d41f-f5d1-4d33-8560-ef87692f29d5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:15.647461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7689d41f-f5d1-4d33-8560-ef87692f29d5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Sep 14 19:46:15.648026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 377/734] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:15 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:15.881680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-50f7b4dc-cda6-4b0f-a658-e2ad9f4b071b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:15.882588 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-50f7b4dc-cda6-4b0f-a658-e2ad9f4b071b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:15.888563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50f7b4dc-cda6-4b0f-a658-e2ad9f4b071b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:15.889018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50f7b4dc-cda6-4b0f-a658-e2ad9f4b071b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:15.889818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50f7b4dc-cda6-4b0f-a658-e2ad9f4b071b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:15.890260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50f7b4dc-cda6-4b0f-a658-e2ad9f4b071b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:15.921471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-50f7b4dc-cda6-4b0f-a658-e2ad9f4b071b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Sep 14 19:46:15.922346 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 358/735] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:15 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:16.659376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-621b169f-1399-4c93-b32a-60fa39d16e7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:16.660918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-621b169f-1399-4c93-b32a-60fa39d16e7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:16.667951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-621b169f-1399-4c93-b32a-60fa39d16e7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:16.668431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-621b169f-1399-4c93-b32a-60fa39d16e7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:16.669228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-621b169f-1399-4c93-b32a-60fa39d16e7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:16.669701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-621b169f-1399-4c93-b32a-60fa39d16e7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:16.704017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-621b169f-1399-4c93-b32a-60fa39d16e7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Sep 14 19:46:16.704017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 378/736] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:16 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:16.933113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5b6c88c0-7dd8-4957-9705-ba790be12d19 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:16.934049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5b6c88c0-7dd8-4957-9705-ba790be12d19 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:16.939889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b6c88c0-7dd8-4957-9705-ba790be12d19 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:16.940336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b6c88c0-7dd8-4957-9705-ba790be12d19 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:16.941093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b6c88c0-7dd8-4957-9705-ba790be12d19 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:16.941552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5b6c88c0-7dd8-4957-9705-ba790be12d19 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:16.970065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5b6c88c0-7dd8-4957-9705-ba790be12d19 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040701 Sep 14 19:46:16.970618 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 359/737] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:16 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:17.712734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-55126e96-66da-4944-9040-0389c6c880bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:17.713668 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-55126e96-66da-4944-9040-0389c6c880bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:17.719574 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55126e96-66da-4944-9040-0389c6c880bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:17.720069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55126e96-66da-4944-9040-0389c6c880bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:17.720854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55126e96-66da-4944-9040-0389c6c880bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:17.721288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55126e96-66da-4944-9040-0389c6c880bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:17.753109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-55126e96-66da-4944-9040-0389c6c880bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Sep 14 19:46:17.753698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 379/738] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:17 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:17.982235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9e2614db-fbb9-4e9e-a468-d64427e89944 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:17.983140 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9e2614db-fbb9-4e9e-a468-d64427e89944 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:17.989161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2614db-fbb9-4e9e-a468-d64427e89944 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:17.989645 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2614db-fbb9-4e9e-a468-d64427e89944 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:17.990467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2614db-fbb9-4e9e-a468-d64427e89944 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:17.990910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2614db-fbb9-4e9e-a468-d64427e89944 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:18.023227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9e2614db-fbb9-4e9e-a468-d64427e89944 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Sep 14 19:46:18.023774 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 360/739] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:17 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:18.764530 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-65a67766-1644-4eb4-8e65-742756bbb7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:18.765466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-65a67766-1644-4eb4-8e65-742756bbb7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:18.771557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65a67766-1644-4eb4-8e65-742756bbb7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:18.772003 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65a67766-1644-4eb4-8e65-742756bbb7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:18.772776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65a67766-1644-4eb4-8e65-742756bbb7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:18.773267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65a67766-1644-4eb4-8e65-742756bbb7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:18.803429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-65a67766-1644-4eb4-8e65-742756bbb7a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042605 Sep 14 19:46:18.803996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 380/740] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:18 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:19.034733 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c2c3f2f9-ce31-4e2f-a118-6279442c02ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:19.035675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c2c3f2f9-ce31-4e2f-a118-6279442c02ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:19.041771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2c3f2f9-ce31-4e2f-a118-6279442c02ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:19.042257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2c3f2f9-ce31-4e2f-a118-6279442c02ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:19.043026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2c3f2f9-ce31-4e2f-a118-6279442c02ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:19.043480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2c3f2f9-ce31-4e2f-a118-6279442c02ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:19.072576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c2c3f2f9-ce31-4e2f-a118-6279442c02ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041662 Sep 14 19:46:19.076118 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 361/741] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:19 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:19.815534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a02f58e3-8537-4f02-9b42-a09c36573539 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:19.816449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a02f58e3-8537-4f02-9b42-a09c36573539 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:19.822303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a02f58e3-8537-4f02-9b42-a09c36573539 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:19.823448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a02f58e3-8537-4f02-9b42-a09c36573539 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:19.824216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a02f58e3-8537-4f02-9b42-a09c36573539 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:19.824656 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a02f58e3-8537-4f02-9b42-a09c36573539 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:19.853748 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a02f58e3-8537-4f02-9b42-a09c36573539 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042008 Sep 14 19:46:19.854306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 381/742] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:20.085137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e77a4516-43d5-4eaa-9872-c54a9d8d3f26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:20.085985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e77a4516-43d5-4eaa-9872-c54a9d8d3f26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:20.091842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e77a4516-43d5-4eaa-9872-c54a9d8d3f26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:20.092311 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e77a4516-43d5-4eaa-9872-c54a9d8d3f26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:20.093084 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e77a4516-43d5-4eaa-9872-c54a9d8d3f26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:20.093546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e77a4516-43d5-4eaa-9872-c54a9d8d3f26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:20.123756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e77a4516-43d5-4eaa-9872-c54a9d8d3f26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042445 Sep 14 19:46:20.124366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 362/743] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:20 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:20.865275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3d36c5cd-5826-407e-b458-445912d9a963 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:20.866269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3d36c5cd-5826-407e-b458-445912d9a963 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:20.872837 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d36c5cd-5826-407e-b458-445912d9a963 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:20.873277 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d36c5cd-5826-407e-b458-445912d9a963 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:20.874093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d36c5cd-5826-407e-b458-445912d9a963 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:20.874523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d36c5cd-5826-407e-b458-445912d9a963 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:20.903099 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3d36c5cd-5826-407e-b458-445912d9a963 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041576 Sep 14 19:46:20.903656 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 382/744] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:20 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:21.135495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2e6aa992-278a-4693-a031-250d2cbb65dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:21.136460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2e6aa992-278a-4693-a031-250d2cbb65dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:21.142346 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e6aa992-278a-4693-a031-250d2cbb65dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:21.142803 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e6aa992-278a-4693-a031-250d2cbb65dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:21.143571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e6aa992-278a-4693-a031-250d2cbb65dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:21.144005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e6aa992-278a-4693-a031-250d2cbb65dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:21.174808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2e6aa992-278a-4693-a031-250d2cbb65dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043075 Sep 14 19:46:21.175402 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 363/745] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:21 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:21.913569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-85913748-d41c-4d24-8b37-aa84ddd637b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:21.914600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-85913748-d41c-4d24-8b37-aa84ddd637b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:21.921074 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85913748-d41c-4d24-8b37-aa84ddd637b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:21.921542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85913748-d41c-4d24-8b37-aa84ddd637b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:21.922591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85913748-d41c-4d24-8b37-aa84ddd637b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:21.923021 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85913748-d41c-4d24-8b37-aa84ddd637b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:21.952610 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-85913748-d41c-4d24-8b37-aa84ddd637b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042721 Sep 14 19:46:21.953188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 383/746] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:21 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:22.186270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7cd34f3b-c265-4965-b51b-c8ad35263602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:22.187167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7cd34f3b-c265-4965-b51b-c8ad35263602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:22.193164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7cd34f3b-c265-4965-b51b-c8ad35263602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:22.193635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7cd34f3b-c265-4965-b51b-c8ad35263602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:22.194486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7cd34f3b-c265-4965-b51b-c8ad35263602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:22.194894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7cd34f3b-c265-4965-b51b-c8ad35263602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:22.224894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7cd34f3b-c265-4965-b51b-c8ad35263602 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042324 Sep 14 19:46:22.225456 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 364/747] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:22 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:22.964521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c7be76b7-77c1-4472-951e-7cc1360cf744 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:22.965432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c7be76b7-77c1-4472-951e-7cc1360cf744 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:22.971788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7be76b7-77c1-4472-951e-7cc1360cf744 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:22.972237 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7be76b7-77c1-4472-951e-7cc1360cf744 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:22.973015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7be76b7-77c1-4472-951e-7cc1360cf744 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:22.973511 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7be76b7-77c1-4472-951e-7cc1360cf744 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:23.003286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c7be76b7-77c1-4472-951e-7cc1360cf744 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042618 Sep 14 19:46:23.003852 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 384/748] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:22 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:23.236583 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7de0eb63-9ddd-42f1-aff8-57e9d95a3218 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:23.237516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7de0eb63-9ddd-42f1-aff8-57e9d95a3218 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:23.243448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7de0eb63-9ddd-42f1-aff8-57e9d95a3218 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:23.243897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7de0eb63-9ddd-42f1-aff8-57e9d95a3218 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:23.245315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7de0eb63-9ddd-42f1-aff8-57e9d95a3218 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:23.245787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7de0eb63-9ddd-42f1-aff8-57e9d95a3218 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:23.287610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7de0eb63-9ddd-42f1-aff8-57e9d95a3218 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054314 Sep 14 19:46:23.288661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 365/749] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:23 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:24.015424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-455c1cb2-b979-4336-8c19-5753994788ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:24.016334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-455c1cb2-b979-4336-8c19-5753994788ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:24.022267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-455c1cb2-b979-4336-8c19-5753994788ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:24.022717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-455c1cb2-b979-4336-8c19-5753994788ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:24.023483 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-455c1cb2-b979-4336-8c19-5753994788ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:24.023976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-455c1cb2-b979-4336-8c19-5753994788ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:24.053971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-455c1cb2-b979-4336-8c19-5753994788ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042182 Sep 14 19:46:24.054536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 385/750] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:24 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:24.300250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9167d406-b639-4990-bf91-c976a5540327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:24.301154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9167d406-b639-4990-bf91-c976a5540327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:24.307447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9167d406-b639-4990-bf91-c976a5540327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:24.308168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9167d406-b639-4990-bf91-c976a5540327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:24.309349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9167d406-b639-4990-bf91-c976a5540327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:24.309894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9167d406-b639-4990-bf91-c976a5540327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:24.339838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9167d406-b639-4990-bf91-c976a5540327 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043521 Sep 14 19:46:24.340396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 366/751] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:24 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:25.065672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-45a86899-e9e4-44c0-906f-d7ce3407cdfa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:25.066633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-45a86899-e9e4-44c0-906f-d7ce3407cdfa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:25.072958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45a86899-e9e4-44c0-906f-d7ce3407cdfa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:25.073419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45a86899-e9e4-44c0-906f-d7ce3407cdfa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:25.074247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45a86899-e9e4-44c0-906f-d7ce3407cdfa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:25.074691 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45a86899-e9e4-44c0-906f-d7ce3407cdfa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:25.106891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-45a86899-e9e4-44c0-906f-d7ce3407cdfa tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 Sep 14 19:46:25.107386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 386/752] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:25 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:25.351376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4bef63a3-576f-481a-b3a9-603f9dda8465 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:25.352286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4bef63a3-576f-481a-b3a9-603f9dda8465 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:25.358611 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4bef63a3-576f-481a-b3a9-603f9dda8465 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:25.358991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4bef63a3-576f-481a-b3a9-603f9dda8465 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:25.359775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4bef63a3-576f-481a-b3a9-603f9dda8465 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:25.360212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4bef63a3-576f-481a-b3a9-603f9dda8465 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:25.390852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4bef63a3-576f-481a-b3a9-603f9dda8465 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043263 Sep 14 19:46:25.391414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 367/753] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:25 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:26.118692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-42fc0837-7bd3-4bf9-8a78-c51f0e6bb4ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:26.119623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-42fc0837-7bd3-4bf9-8a78-c51f0e6bb4ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:26.125818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-42fc0837-7bd3-4bf9-8a78-c51f0e6bb4ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:26.126272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-42fc0837-7bd3-4bf9-8a78-c51f0e6bb4ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:26.127064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-42fc0837-7bd3-4bf9-8a78-c51f0e6bb4ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:26.127505 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-42fc0837-7bd3-4bf9-8a78-c51f0e6bb4ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:26.159408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-42fc0837-7bd3-4bf9-8a78-c51f0e6bb4ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Sep 14 19:46:26.159976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 387/754] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:26 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:26.402515 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7428aa46-ad75-4975-8ddf-e2293beec41f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:26.403346 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7428aa46-ad75-4975-8ddf-e2293beec41f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:26.409712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7428aa46-ad75-4975-8ddf-e2293beec41f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:26.410150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7428aa46-ad75-4975-8ddf-e2293beec41f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:26.410929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7428aa46-ad75-4975-8ddf-e2293beec41f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:26.411353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7428aa46-ad75-4975-8ddf-e2293beec41f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:26.445295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7428aa46-ad75-4975-8ddf-e2293beec41f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046305 Sep 14 19:46:26.446241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 368/755] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:26 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:27.171156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e336af22-45ab-4be8-bd8a-96f6c9b29fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:27.172345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e336af22-45ab-4be8-bd8a-96f6c9b29fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:27.178684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e336af22-45ab-4be8-bd8a-96f6c9b29fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:27.179135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e336af22-45ab-4be8-bd8a-96f6c9b29fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:27.179922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e336af22-45ab-4be8-bd8a-96f6c9b29fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:27.180356 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e336af22-45ab-4be8-bd8a-96f6c9b29fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:27.217611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e336af22-45ab-4be8-bd8a-96f6c9b29fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049780 Sep 14 19:46:27.218729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 388/756] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:27 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:27.457755 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ab232fcb-9033-44b4-8107-adc11390503f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:27.464924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ab232fcb-9033-44b4-8107-adc11390503f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:27.465405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ab232fcb-9033-44b4-8107-adc11390503f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:27.465880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ab232fcb-9033-44b4-8107-adc11390503f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:27.466663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ab232fcb-9033-44b4-8107-adc11390503f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:27.467099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ab232fcb-9033-44b4-8107-adc11390503f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:27.498368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ab232fcb-9033-44b4-8107-adc11390503f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044376 Sep 14 19:46:27.498947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 369/757] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:27 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:28.230300 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-636ebecf-22f9-4dcd-b1c5-216857a88a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:28.231233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-636ebecf-22f9-4dcd-b1c5-216857a88a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:28.237565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-636ebecf-22f9-4dcd-b1c5-216857a88a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:28.238032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-636ebecf-22f9-4dcd-b1c5-216857a88a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:28.238831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-636ebecf-22f9-4dcd-b1c5-216857a88a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:28.239271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-636ebecf-22f9-4dcd-b1c5-216857a88a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:28.271136 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-636ebecf-22f9-4dcd-b1c5-216857a88a59 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Sep 14 19:46:28.271721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 389/758] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:28 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:28.510116 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-67c696a2-f8a0-43d7-9337-f4027767078c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:28.511065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-67c696a2-f8a0-43d7-9337-f4027767078c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:28.517365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-67c696a2-f8a0-43d7-9337-f4027767078c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:28.517890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-67c696a2-f8a0-43d7-9337-f4027767078c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:28.518660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-67c696a2-f8a0-43d7-9337-f4027767078c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:28.519099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-67c696a2-f8a0-43d7-9337-f4027767078c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:28.550470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-67c696a2-f8a0-43d7-9337-f4027767078c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044185 Sep 14 19:46:28.551137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 370/759] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:28 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:29.284357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ab9cee10-20ed-4640-8610-3751bdf0079c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:29.285262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ab9cee10-20ed-4640-8610-3751bdf0079c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:29.291445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab9cee10-20ed-4640-8610-3751bdf0079c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:29.291885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab9cee10-20ed-4640-8610-3751bdf0079c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:29.292660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab9cee10-20ed-4640-8610-3751bdf0079c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:29.293092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab9cee10-20ed-4640-8610-3751bdf0079c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:29.324828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ab9cee10-20ed-4640-8610-3751bdf0079c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Sep 14 19:46:29.325413 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 390/760] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:29 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:29.563546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-78348af5-76bf-4f65-beb4-4ebcb066cea1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:29.564396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-78348af5-76bf-4f65-beb4-4ebcb066cea1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:29.573735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-78348af5-76bf-4f65-beb4-4ebcb066cea1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:29.574492 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-78348af5-76bf-4f65-beb4-4ebcb066cea1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:29.575767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-78348af5-76bf-4f65-beb4-4ebcb066cea1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:29.576524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-78348af5-76bf-4f65-beb4-4ebcb066cea1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:29.625674 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-78348af5-76bf-4f65-beb4-4ebcb066cea1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065963 Sep 14 19:46:29.626271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 371/761] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:29 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:30.336433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f53648bb-b73a-4678-9aa8-a47fe569642f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:30.337367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f53648bb-b73a-4678-9aa8-a47fe569642f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:30.344169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f53648bb-b73a-4678-9aa8-a47fe569642f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:30.344611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f53648bb-b73a-4678-9aa8-a47fe569642f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:30.345395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f53648bb-b73a-4678-9aa8-a47fe569642f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:30.345852 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f53648bb-b73a-4678-9aa8-a47fe569642f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:30.381057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f53648bb-b73a-4678-9aa8-a47fe569642f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048349 Sep 14 19:46:30.381684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 391/762] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:30 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:30.638675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ee9aeb60-eec8-48e1-acb0-1a5046175684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:30.639589 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ee9aeb60-eec8-48e1-acb0-1a5046175684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:30.645706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee9aeb60-eec8-48e1-acb0-1a5046175684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:30.646149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee9aeb60-eec8-48e1-acb0-1a5046175684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:30.646929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee9aeb60-eec8-48e1-acb0-1a5046175684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:30.647360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee9aeb60-eec8-48e1-acb0-1a5046175684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:30.678218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ee9aeb60-eec8-48e1-acb0-1a5046175684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Sep 14 19:46:30.678787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 372/763] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:30 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:31.393158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ec34c51a-c4f8-47aa-bb19-74b352334758 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:31.394107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ec34c51a-c4f8-47aa-bb19-74b352334758 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:31.400245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec34c51a-c4f8-47aa-bb19-74b352334758 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:31.400715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec34c51a-c4f8-47aa-bb19-74b352334758 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:31.401542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec34c51a-c4f8-47aa-bb19-74b352334758 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:31.401964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec34c51a-c4f8-47aa-bb19-74b352334758 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:31.433329 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ec34c51a-c4f8-47aa-bb19-74b352334758 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Sep 14 19:46:31.433933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 392/764] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:31 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:31.689605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e9a698f1-8933-4270-aed2-dfc7de81155e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:31.690537 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e9a698f1-8933-4270-aed2-dfc7de81155e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:31.696464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e9a698f1-8933-4270-aed2-dfc7de81155e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:31.696910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e9a698f1-8933-4270-aed2-dfc7de81155e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:31.697717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e9a698f1-8933-4270-aed2-dfc7de81155e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:31.698151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e9a698f1-8933-4270-aed2-dfc7de81155e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:31.727599 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e9a698f1-8933-4270-aed2-dfc7de81155e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041710 Sep 14 19:46:31.728167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 373/765] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:31 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:32.445004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-21ce4c37-447a-4e56-ac67-eba91d7e0d83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:32.445953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-21ce4c37-447a-4e56-ac67-eba91d7e0d83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:32.452677 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21ce4c37-447a-4e56-ac67-eba91d7e0d83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:32.453155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21ce4c37-447a-4e56-ac67-eba91d7e0d83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:32.454023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21ce4c37-447a-4e56-ac67-eba91d7e0d83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:32.454782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21ce4c37-447a-4e56-ac67-eba91d7e0d83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:32.489032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-21ce4c37-447a-4e56-ac67-eba91d7e0d83 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047929 Sep 14 19:46:32.489638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 393/766] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:32 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:32.739577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f3a2ae4d-e1f4-42f7-a419-2b11089679c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:32.744935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f3a2ae4d-e1f4-42f7-a419-2b11089679c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:32.747376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3a2ae4d-e1f4-42f7-a419-2b11089679c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:32.747827 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3a2ae4d-e1f4-42f7-a419-2b11089679c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:32.748606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3a2ae4d-e1f4-42f7-a419-2b11089679c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:32.749043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3a2ae4d-e1f4-42f7-a419-2b11089679c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:32.779202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f3a2ae4d-e1f4-42f7-a419-2b11089679c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043465 Sep 14 19:46:32.779777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 374/767] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:32 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:33.500567 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c037d147-3e6d-455f-9020-7d065f5324c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:33.501483 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c037d147-3e6d-455f-9020-7d065f5324c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:33.507590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c037d147-3e6d-455f-9020-7d065f5324c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:33.510990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c037d147-3e6d-455f-9020-7d065f5324c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:33.510990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c037d147-3e6d-455f-9020-7d065f5324c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:33.510990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c037d147-3e6d-455f-9020-7d065f5324c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:33.544351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c037d147-3e6d-455f-9020-7d065f5324c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047479 Sep 14 19:46:33.544935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 394/768] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:33 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:33.790914 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-157c25d9-a440-4aed-bdaa-8bc1f424923d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:33.791691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-157c25d9-a440-4aed-bdaa-8bc1f424923d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:33.798142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-157c25d9-a440-4aed-bdaa-8bc1f424923d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:33.798596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-157c25d9-a440-4aed-bdaa-8bc1f424923d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:33.799385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-157c25d9-a440-4aed-bdaa-8bc1f424923d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:33.799822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-157c25d9-a440-4aed-bdaa-8bc1f424923d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:33.832119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-157c25d9-a440-4aed-bdaa-8bc1f424923d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Sep 14 19:46:33.832702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 375/769] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:33 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:34.556355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-06f590da-1382-420b-8467-666378a2641f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:34.557956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-06f590da-1382-420b-8467-666378a2641f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:34.564005 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06f590da-1382-420b-8467-666378a2641f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:34.564454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06f590da-1382-420b-8467-666378a2641f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:34.565312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06f590da-1382-420b-8467-666378a2641f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:34.565800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06f590da-1382-420b-8467-666378a2641f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:34.595894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-06f590da-1382-420b-8467-666378a2641f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043315 Sep 14 19:46:34.596469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 395/770] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:34 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:34.844337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b79674bc-01e7-49ca-93e6-b1c1ace93ce0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:34.845253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b79674bc-01e7-49ca-93e6-b1c1ace93ce0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:34.851427 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b79674bc-01e7-49ca-93e6-b1c1ace93ce0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:34.851868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b79674bc-01e7-49ca-93e6-b1c1ace93ce0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:34.852647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b79674bc-01e7-49ca-93e6-b1c1ace93ce0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:34.853075 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b79674bc-01e7-49ca-93e6-b1c1ace93ce0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:34.884478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b79674bc-01e7-49ca-93e6-b1c1ace93ce0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Sep 14 19:46:34.885072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 376/771] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:34 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:35.607537 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d5f0682f-ef37-4e41-b894-d3a7d588a2f6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:35.608450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d5f0682f-ef37-4e41-b894-d3a7d588a2f6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:35.614717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d5f0682f-ef37-4e41-b894-d3a7d588a2f6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:35.615217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d5f0682f-ef37-4e41-b894-d3a7d588a2f6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:35.616008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d5f0682f-ef37-4e41-b894-d3a7d588a2f6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:35.616443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d5f0682f-ef37-4e41-b894-d3a7d588a2f6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:35.649123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d5f0682f-ef37-4e41-b894-d3a7d588a2f6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045333 Sep 14 19:46:35.649811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 396/772] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:35 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:35.896131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-282ad738-9da1-4cf3-9584-30606ebc1fde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:35.897038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-282ad738-9da1-4cf3-9584-30606ebc1fde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:35.903216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-282ad738-9da1-4cf3-9584-30606ebc1fde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:35.903655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-282ad738-9da1-4cf3-9584-30606ebc1fde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:35.904429 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-282ad738-9da1-4cf3-9584-30606ebc1fde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:35.904858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-282ad738-9da1-4cf3-9584-30606ebc1fde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:35.937597 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-282ad738-9da1-4cf3-9584-30606ebc1fde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Sep 14 19:46:35.938184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 377/773] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:35 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:36.660772 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5e3b1330-4b95-4bc7-bb49-7a3214167fa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:36.661773 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5e3b1330-4b95-4bc7-bb49-7a3214167fa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:36.668337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e3b1330-4b95-4bc7-bb49-7a3214167fa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:36.668909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e3b1330-4b95-4bc7-bb49-7a3214167fa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:36.669749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e3b1330-4b95-4bc7-bb49-7a3214167fa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:36.670186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e3b1330-4b95-4bc7-bb49-7a3214167fa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:36.702472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5e3b1330-4b95-4bc7-bb49-7a3214167fa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045565 Sep 14 19:46:36.703088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 397/774] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:36 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:36.950669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2554e0af-0814-402b-9c18-a27bbc3c5488 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:36.951601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2554e0af-0814-402b-9c18-a27bbc3c5488 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:36.957743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2554e0af-0814-402b-9c18-a27bbc3c5488 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:36.958182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2554e0af-0814-402b-9c18-a27bbc3c5488 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:36.959060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2554e0af-0814-402b-9c18-a27bbc3c5488 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:36.959789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2554e0af-0814-402b-9c18-a27bbc3c5488 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:36.992188 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2554e0af-0814-402b-9c18-a27bbc3c5488 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046299 Sep 14 19:46:36.992797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 378/775] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:36 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:37.715101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8a8dbf30-48b3-4acd-bbd6-eb352947a2e4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:37.716068 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8a8dbf30-48b3-4acd-bbd6-eb352947a2e4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:37.722907 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a8dbf30-48b3-4acd-bbd6-eb352947a2e4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:37.723352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a8dbf30-48b3-4acd-bbd6-eb352947a2e4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:37.724162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a8dbf30-48b3-4acd-bbd6-eb352947a2e4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:37.724598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a8dbf30-48b3-4acd-bbd6-eb352947a2e4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:37.758806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8a8dbf30-48b3-4acd-bbd6-eb352947a2e4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047898 Sep 14 19:46:37.759406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 398/776] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:37 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:38.004619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-edc06a57-a5bf-417b-a5c0-5c2f1e597e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:38.005602 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-edc06a57-a5bf-417b-a5c0-5c2f1e597e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:38.012283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-edc06a57-a5bf-417b-a5c0-5c2f1e597e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:38.012848 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-edc06a57-a5bf-417b-a5c0-5c2f1e597e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:38.013664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-edc06a57-a5bf-417b-a5c0-5c2f1e597e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:38.014102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-edc06a57-a5bf-417b-a5c0-5c2f1e597e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:38.048536 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-edc06a57-a5bf-417b-a5c0-5c2f1e597e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047781 Sep 14 19:46:38.049128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 379/777] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:37 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:38.770857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cb399f0b-e322-4d08-93a5-fa4c949d8e31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:38.771799 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cb399f0b-e322-4d08-93a5-fa4c949d8e31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:38.778349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb399f0b-e322-4d08-93a5-fa4c949d8e31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:38.778842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb399f0b-e322-4d08-93a5-fa4c949d8e31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:38.779638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb399f0b-e322-4d08-93a5-fa4c949d8e31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:38.780081 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb399f0b-e322-4d08-93a5-fa4c949d8e31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:38.817522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cb399f0b-e322-4d08-93a5-fa4c949d8e31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050437 Sep 14 19:46:38.818102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 399/778] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:38 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:39.060571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ae61ff82-97b8-48b8-af00-7807b8dae259 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:39.061525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ae61ff82-97b8-48b8-af00-7807b8dae259 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:39.067441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae61ff82-97b8-48b8-af00-7807b8dae259 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:39.067873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae61ff82-97b8-48b8-af00-7807b8dae259 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:39.068668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae61ff82-97b8-48b8-af00-7807b8dae259 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:39.069080 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae61ff82-97b8-48b8-af00-7807b8dae259 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:39.099630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ae61ff82-97b8-48b8-af00-7807b8dae259 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043384 Sep 14 19:46:39.100200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 380/779] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:39 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:39.830513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-578d617e-3cae-4cb1-b0e1-9f80ff3d0430 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:39.831431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-578d617e-3cae-4cb1-b0e1-9f80ff3d0430 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:39.838606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-578d617e-3cae-4cb1-b0e1-9f80ff3d0430 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:39.839375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-578d617e-3cae-4cb1-b0e1-9f80ff3d0430 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:39.839821 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-578d617e-3cae-4cb1-b0e1-9f80ff3d0430 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:39.840255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-578d617e-3cae-4cb1-b0e1-9f80ff3d0430 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:39.870059 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-578d617e-3cae-4cb1-b0e1-9f80ff3d0430 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Sep 14 19:46:39.870634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 400/780] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:39 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:40.111806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9cdf4f5e-a41e-45f6-97f4-3bd42a4721c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:40.112751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9cdf4f5e-a41e-45f6-97f4-3bd42a4721c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:40.119691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cdf4f5e-a41e-45f6-97f4-3bd42a4721c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:40.120139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cdf4f5e-a41e-45f6-97f4-3bd42a4721c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:40.120921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cdf4f5e-a41e-45f6-97f4-3bd42a4721c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:40.121349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cdf4f5e-a41e-45f6-97f4-3bd42a4721c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:40.151595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9cdf4f5e-a41e-45f6-97f4-3bd42a4721c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Sep 14 19:46:40.157461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 381/781] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:40 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:40.881437 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-60eefec6-2878-4130-b030-3e9a469d6f0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:40.882375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-60eefec6-2878-4130-b030-3e9a469d6f0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:40.889156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60eefec6-2878-4130-b030-3e9a469d6f0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:40.889637 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60eefec6-2878-4130-b030-3e9a469d6f0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:40.890426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60eefec6-2878-4130-b030-3e9a469d6f0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:40.890959 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60eefec6-2878-4130-b030-3e9a469d6f0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:40.922413 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-60eefec6-2878-4130-b030-3e9a469d6f0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Sep 14 19:46:40.923000 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 401/782] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:40 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:41.163447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d143e2ad-db20-4c43-aca7-e154c82566ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:41.164748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d143e2ad-db20-4c43-aca7-e154c82566ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:41.173619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d143e2ad-db20-4c43-aca7-e154c82566ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:41.174072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d143e2ad-db20-4c43-aca7-e154c82566ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:41.174872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d143e2ad-db20-4c43-aca7-e154c82566ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:41.175314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d143e2ad-db20-4c43-aca7-e154c82566ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:41.206043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d143e2ad-db20-4c43-aca7-e154c82566ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 Sep 14 19:46:41.206789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 382/783] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:41 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:41.935052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-82692af4-587e-488b-89fa-d6dbe1c1b8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:41.935992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-82692af4-587e-488b-89fa-d6dbe1c1b8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:41.942357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-82692af4-587e-488b-89fa-d6dbe1c1b8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:41.942975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-82692af4-587e-488b-89fa-d6dbe1c1b8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:41.944121 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-82692af4-587e-488b-89fa-d6dbe1c1b8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:41.944776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-82692af4-587e-488b-89fa-d6dbe1c1b8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:41.981013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-82692af4-587e-488b-89fa-d6dbe1c1b8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050072 Sep 14 19:46:41.981729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 402/784] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:41 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:42.217794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dcb03b33-2d5a-493a-bb04-d9f0017027d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:42.218698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dcb03b33-2d5a-493a-bb04-d9f0017027d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:42.224764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcb03b33-2d5a-493a-bb04-d9f0017027d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:42.225206 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcb03b33-2d5a-493a-bb04-d9f0017027d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:42.226005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcb03b33-2d5a-493a-bb04-d9f0017027d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:42.226443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcb03b33-2d5a-493a-bb04-d9f0017027d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:42.256708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dcb03b33-2d5a-493a-bb04-d9f0017027d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042678 Sep 14 19:46:42.257257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 383/785] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:42 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:42.994318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-56a702d5-572c-4553-a208-e2948ebb327d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:42.995786 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-56a702d5-572c-4553-a208-e2948ebb327d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:43.002722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-56a702d5-572c-4553-a208-e2948ebb327d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:43.003232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-56a702d5-572c-4553-a208-e2948ebb327d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:43.004032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-56a702d5-572c-4553-a208-e2948ebb327d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:43.004467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-56a702d5-572c-4553-a208-e2948ebb327d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:43.041653 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-56a702d5-572c-4553-a208-e2948ebb327d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051082 Sep 14 19:46:43.042293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 403/786] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:42 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:43.224522 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9f0328c7-81aa-4bfa-b599-58dd2ce4bd91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:43.225143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9f0328c7-81aa-4bfa-b599-58dd2ce4bd91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:43.231692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f0328c7-81aa-4bfa-b599-58dd2ce4bd91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:43.232145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f0328c7-81aa-4bfa-b599-58dd2ce4bd91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:43.232974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f0328c7-81aa-4bfa-b599-58dd2ce4bd91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:43.233426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f0328c7-81aa-4bfa-b599-58dd2ce4bd91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:43.263743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9f0328c7-81aa-4bfa-b599-58dd2ce4bd91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments/dcf88e46-dac7-4d2d-a557-f0e5def18821" status: 200 len: 194 microversion: 2.20 time: 0.043111 Sep 14 19:46:43.264402 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 384/787] 10.222.0.58 () {60 vars in 1454 bytes} [Tue Sep 14 19:46:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments/dcf88e46-dac7-4d2d-a557-f0e5def18821 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:43.338921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:46:43.344653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 19:46:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments/dcf88e46-dac7-4d2d-a557-f0e5def18821 (ip 10.222.0.58) !!! Sep 14 19:46:43.351930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8f0412b0-e94f-42b1-bcc6-431ed4f5f3b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:43.353378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8f0412b0-e94f-42b1-bcc6-431ed4f5f3b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:43.363578 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8f0412b0-e94f-42b1-bcc6-431ed4f5f3b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:43.364137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8f0412b0-e94f-42b1-bcc6-431ed4f5f3b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:43.364801 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8f0412b0-e94f-42b1-bcc6-431ed4f5f3b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:43.365237 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8f0412b0-e94f-42b1-bcc6-431ed4f5f3b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:43.455500 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a57f2a6d-7e9c-4ac0-86bc-adcb39707601 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:43.456476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a57f2a6d-7e9c-4ac0-86bc-adcb39707601 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:43.466160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a57f2a6d-7e9c-4ac0-86bc-adcb39707601 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:43.469222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a57f2a6d-7e9c-4ac0-86bc-adcb39707601 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:43.469222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a57f2a6d-7e9c-4ac0-86bc-adcb39707601 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:43.469222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a57f2a6d-7e9c-4ac0-86bc-adcb39707601 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:43.500132 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a57f2a6d-7e9c-4ac0-86bc-adcb39707601 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233362 Sep 14 19:46:43.500698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 404/788] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:43 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:43.595575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-8f0412b0-e94f-42b1-bcc6-431ed4f5f3b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lazy-loading 'services' on Instance uuid 72a26129-f7fb-4755-979a-968cdf0c7d34 {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:46:43.832875 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8f0412b0-e94f-42b1-bcc6-431ed4f5f3b8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "DELETE /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments/dcf88e46-dac7-4d2d-a557-f0e5def18821" status: 202 len: 0 microversion: 2.20 time: 0.498218 Sep 14 19:46:43.833662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 385/789] 10.222.0.58 () {60 vars in 1457 bytes} [Tue Sep 14 19:46:43 2021] DELETE /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments/dcf88e46-dac7-4d2d-a557-f0e5def18821 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 14 19:46:43.843741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3f103b55-6109-43ec-8fc0-e035ddde74fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:43.844848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3f103b55-6109-43ec-8fc0-e035ddde74fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:43.851302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f103b55-6109-43ec-8fc0-e035ddde74fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:43.851745 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f103b55-6109-43ec-8fc0-e035ddde74fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:43.852536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f103b55-6109-43ec-8fc0-e035ddde74fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:43.853255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f103b55-6109-43ec-8fc0-e035ddde74fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:43.886426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3f103b55-6109-43ec-8fc0-e035ddde74fa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047378 Sep 14 19:46:43.887351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 405/790] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:44.053435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-af085a5a-1e5c-4c90-b4ab-060f9a3e774f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:44.054511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-af085a5a-1e5c-4c90-b4ab-060f9a3e774f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:44.061379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-af085a5a-1e5c-4c90-b4ab-060f9a3e774f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:44.061864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-af085a5a-1e5c-4c90-b4ab-060f9a3e774f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:44.062632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-af085a5a-1e5c-4c90-b4ab-060f9a3e774f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:44.063070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-af085a5a-1e5c-4c90-b4ab-060f9a3e774f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:44.094717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-af085a5a-1e5c-4c90-b4ab-060f9a3e774f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Sep 14 19:46:44.095284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 386/791] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:44 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:44.512198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1aca9b76-6303-4faa-be23-a9e8e8a2378e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:44.513120 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1aca9b76-6303-4faa-be23-a9e8e8a2378e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:44.519638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1aca9b76-6303-4faa-be23-a9e8e8a2378e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:44.520091 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1aca9b76-6303-4faa-be23-a9e8e8a2378e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:44.521078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1aca9b76-6303-4faa-be23-a9e8e8a2378e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:44.521372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1aca9b76-6303-4faa-be23-a9e8e8a2378e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:44.557844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1aca9b76-6303-4faa-be23-a9e8e8a2378e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049601 Sep 14 19:46:44.558441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 406/792] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:44 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:44.587174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:46:44.587983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 19:46:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:46:44.899087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9f0f88f4-86ec-4d56-82ae-d0c4f882bc6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:44.900547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9f0f88f4-86ec-4d56-82ae-d0c4f882bc6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:44.906673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f0f88f4-86ec-4d56-82ae-d0c4f882bc6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:44.907123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f0f88f4-86ec-4d56-82ae-d0c4f882bc6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:44.907919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f0f88f4-86ec-4d56-82ae-d0c4f882bc6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:44.908359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f0f88f4-86ec-4d56-82ae-d0c4f882bc6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:44.943420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9f0f88f4-86ec-4d56-82ae-d0c4f882bc6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048186 Sep 14 19:46:44.944041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 387/793] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:46:45.107209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-093a304d-5540-4f42-9fcf-19bccee13eb0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:45.108152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-093a304d-5540-4f42-9fcf-19bccee13eb0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:45.114327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-093a304d-5540-4f42-9fcf-19bccee13eb0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:45.114776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-093a304d-5540-4f42-9fcf-19bccee13eb0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:45.115591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-093a304d-5540-4f42-9fcf-19bccee13eb0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:45.116016 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-093a304d-5540-4f42-9fcf-19bccee13eb0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:45.152381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-093a304d-5540-4f42-9fcf-19bccee13eb0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049309 Sep 14 19:46:45.152983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 407/794] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:45 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:45.569946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3a32f29f-b225-4716-8c05-884c1dd76cac tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:45.570890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3a32f29f-b225-4716-8c05-884c1dd76cac tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:45.576851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a32f29f-b225-4716-8c05-884c1dd76cac tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:45.577304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a32f29f-b225-4716-8c05-884c1dd76cac tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:45.578143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a32f29f-b225-4716-8c05-884c1dd76cac tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:45.578577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a32f29f-b225-4716-8c05-884c1dd76cac tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:45.608957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3a32f29f-b225-4716-8c05-884c1dd76cac tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043598 Sep 14 19:46:45.609587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 388/795] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:45 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:45.956103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b3faeacf-e327-4f7f-b39d-a17a6d464ea0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:45.957081 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b3faeacf-e327-4f7f-b39d-a17a6d464ea0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:45.963673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3faeacf-e327-4f7f-b39d-a17a6d464ea0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:45.964124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3faeacf-e327-4f7f-b39d-a17a6d464ea0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:45.964948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3faeacf-e327-4f7f-b39d-a17a6d464ea0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:45.965390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3faeacf-e327-4f7f-b39d-a17a6d464ea0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:45.995634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b3faeacf-e327-4f7f-b39d-a17a6d464ea0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043596 Sep 14 19:46:45.996219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 408/796] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:46.163585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-16da124c-8010-43ab-bb89-7966f4bf9034 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:46.164483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-16da124c-8010-43ab-bb89-7966f4bf9034 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:46.171106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16da124c-8010-43ab-bb89-7966f4bf9034 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:46.171550 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16da124c-8010-43ab-bb89-7966f4bf9034 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:46.172577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16da124c-8010-43ab-bb89-7966f4bf9034 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:46.173016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16da124c-8010-43ab-bb89-7966f4bf9034 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:46.206715 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-16da124c-8010-43ab-bb89-7966f4bf9034 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046782 Sep 14 19:46:46.207295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 389/797] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:46 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:46.621186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ded9c278-c71e-4422-a1d9-6c68de719ddb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:46.622153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ded9c278-c71e-4422-a1d9-6c68de719ddb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:46.628389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ded9c278-c71e-4422-a1d9-6c68de719ddb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:46.628946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ded9c278-c71e-4422-a1d9-6c68de719ddb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:46.629922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ded9c278-c71e-4422-a1d9-6c68de719ddb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:46.630413 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ded9c278-c71e-4422-a1d9-6c68de719ddb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:46.662359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ded9c278-c71e-4422-a1d9-6c68de719ddb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Sep 14 19:46:46.662926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 409/798] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:46 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:47.007967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a01ac4fe-2819-4360-8c9d-a710a28479b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:47.009712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a01ac4fe-2819-4360-8c9d-a710a28479b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:47.027800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a01ac4fe-2819-4360-8c9d-a710a28479b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:47.027800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a01ac4fe-2819-4360-8c9d-a710a28479b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:47.027800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a01ac4fe-2819-4360-8c9d-a710a28479b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:47.027800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a01ac4fe-2819-4360-8c9d-a710a28479b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:47.059481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a01ac4fe-2819-4360-8c9d-a710a28479b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055700 Sep 14 19:46:47.060099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 390/799] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:47 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:47.218743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-11ff68c0-1f10-4fbc-9cd7-c5cd0842256c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:47.219671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-11ff68c0-1f10-4fbc-9cd7-c5cd0842256c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:47.226929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11ff68c0-1f10-4fbc-9cd7-c5cd0842256c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:47.227431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11ff68c0-1f10-4fbc-9cd7-c5cd0842256c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:47.229025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11ff68c0-1f10-4fbc-9cd7-c5cd0842256c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:47.230440 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11ff68c0-1f10-4fbc-9cd7-c5cd0842256c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:47.283374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-11ff68c0-1f10-4fbc-9cd7-c5cd0842256c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068534 Sep 14 19:46:47.283859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 410/800] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:47 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:47.674762 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d19e7114-757f-4c11-822d-7ebfd2e0ad46 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:47.675667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d19e7114-757f-4c11-822d-7ebfd2e0ad46 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:47.681727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d19e7114-757f-4c11-822d-7ebfd2e0ad46 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:47.682183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d19e7114-757f-4c11-822d-7ebfd2e0ad46 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:47.682967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d19e7114-757f-4c11-822d-7ebfd2e0ad46 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:47.683401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d19e7114-757f-4c11-822d-7ebfd2e0ad46 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:47.712965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d19e7114-757f-4c11-822d-7ebfd2e0ad46 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 Sep 14 19:46:47.713598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 391/801] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:47 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:48.071257 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c6d3779d-3a85-4a2b-b04f-37a212ce3d23 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:48.072587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c6d3779d-3a85-4a2b-b04f-37a212ce3d23 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:48.078740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6d3779d-3a85-4a2b-b04f-37a212ce3d23 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:48.079195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6d3779d-3a85-4a2b-b04f-37a212ce3d23 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:48.079977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6d3779d-3a85-4a2b-b04f-37a212ce3d23 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:48.080542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6d3779d-3a85-4a2b-b04f-37a212ce3d23 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:48.110199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c6d3779d-3a85-4a2b-b04f-37a212ce3d23 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042915 Sep 14 19:46:48.110753 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 411/802] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:48 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:48.295915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-adf98474-aec4-4ad5-91ff-344362752ddd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:48.297657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-adf98474-aec4-4ad5-91ff-344362752ddd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:48.307350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-adf98474-aec4-4ad5-91ff-344362752ddd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:48.307803 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-adf98474-aec4-4ad5-91ff-344362752ddd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:48.308630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-adf98474-aec4-4ad5-91ff-344362752ddd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:48.309069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-adf98474-aec4-4ad5-91ff-344362752ddd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:48.342270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-adf98474-aec4-4ad5-91ff-344362752ddd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051976 Sep 14 19:46:48.342843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 392/803] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:48 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:48.725248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e994d72b-b453-4662-8e8b-8f688a85d4c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:48.726286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e994d72b-b453-4662-8e8b-8f688a85d4c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:48.732994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e994d72b-b453-4662-8e8b-8f688a85d4c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:48.733439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e994d72b-b453-4662-8e8b-8f688a85d4c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:48.734232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e994d72b-b453-4662-8e8b-8f688a85d4c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:48.734663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e994d72b-b453-4662-8e8b-8f688a85d4c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:48.763330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e994d72b-b453-4662-8e8b-8f688a85d4c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042669 Sep 14 19:46:48.769763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 412/804] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:48 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:49.120992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e908e0fd-10c0-4c39-a102-7df6b7ebd029 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:49.122061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e908e0fd-10c0-4c39-a102-7df6b7ebd029 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:49.128023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e908e0fd-10c0-4c39-a102-7df6b7ebd029 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:49.128464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e908e0fd-10c0-4c39-a102-7df6b7ebd029 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:49.129228 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e908e0fd-10c0-4c39-a102-7df6b7ebd029 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:49.129703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e908e0fd-10c0-4c39-a102-7df6b7ebd029 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:49.160194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e908e0fd-10c0-4c39-a102-7df6b7ebd029 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042101 Sep 14 19:46:49.160775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 393/805] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:49 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:49.353915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-be1c08b5-1ddd-404a-96f2-d27299dde8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:49.354834 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-be1c08b5-1ddd-404a-96f2-d27299dde8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:49.361054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-be1c08b5-1ddd-404a-96f2-d27299dde8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:49.361520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-be1c08b5-1ddd-404a-96f2-d27299dde8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:49.362318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-be1c08b5-1ddd-404a-96f2-d27299dde8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:49.362783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-be1c08b5-1ddd-404a-96f2-d27299dde8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:49.392918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-be1c08b5-1ddd-404a-96f2-d27299dde8b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042698 Sep 14 19:46:49.393470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 413/806] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:49 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:49.774806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4350406a-ad10-41cf-9641-c25392ee84e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:49.775623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4350406a-ad10-41cf-9641-c25392ee84e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:49.781626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4350406a-ad10-41cf-9641-c25392ee84e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:49.782076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4350406a-ad10-41cf-9641-c25392ee84e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:49.782844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4350406a-ad10-41cf-9641-c25392ee84e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:49.783268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4350406a-ad10-41cf-9641-c25392ee84e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:49.813623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4350406a-ad10-41cf-9641-c25392ee84e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042645 Sep 14 19:46:49.814190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 394/807] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:49 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:50.171784 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d2fd3bf8-ad8d-4798-96bb-7563c6562409 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:50.172955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d2fd3bf8-ad8d-4798-96bb-7563c6562409 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:50.179106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d2fd3bf8-ad8d-4798-96bb-7563c6562409 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:50.179562 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d2fd3bf8-ad8d-4798-96bb-7563c6562409 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:50.180346 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d2fd3bf8-ad8d-4798-96bb-7563c6562409 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:50.180791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d2fd3bf8-ad8d-4798-96bb-7563c6562409 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:50.211666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d2fd3bf8-ad8d-4798-96bb-7563c6562409 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043657 Sep 14 19:46:50.230969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 414/808] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:50 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:50.405138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-21350294-7155-4ea1-b068-752c7da7e392 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:50.406153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-21350294-7155-4ea1-b068-752c7da7e392 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:50.412402 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21350294-7155-4ea1-b068-752c7da7e392 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:50.412852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21350294-7155-4ea1-b068-752c7da7e392 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:50.413677 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21350294-7155-4ea1-b068-752c7da7e392 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:50.414109 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21350294-7155-4ea1-b068-752c7da7e392 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:50.455940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-21350294-7155-4ea1-b068-752c7da7e392 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055254 Sep 14 19:46:50.456504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 395/809] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:50 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:50.826687 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-50b6a897-1a34-48ed-9755-b209b36d01cf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:50.827526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-50b6a897-1a34-48ed-9755-b209b36d01cf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:50.833901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50b6a897-1a34-48ed-9755-b209b36d01cf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:50.834348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50b6a897-1a34-48ed-9755-b209b36d01cf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:50.835117 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50b6a897-1a34-48ed-9755-b209b36d01cf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:50.835550 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50b6a897-1a34-48ed-9755-b209b36d01cf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:50.864715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-50b6a897-1a34-48ed-9755-b209b36d01cf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042405 Sep 14 19:46:50.865259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 415/810] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:50 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:51.223364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-927f7fc3-104c-4001-a982-e49ff554eb16 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:51.224348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-927f7fc3-104c-4001-a982-e49ff554eb16 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:51.230324 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-927f7fc3-104c-4001-a982-e49ff554eb16 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:51.230763 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-927f7fc3-104c-4001-a982-e49ff554eb16 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:51.231518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-927f7fc3-104c-4001-a982-e49ff554eb16 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:51.231940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-927f7fc3-104c-4001-a982-e49ff554eb16 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:51.262247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-927f7fc3-104c-4001-a982-e49ff554eb16 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042616 Sep 14 19:46:51.262834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 396/811] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:51 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:51.467363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-edebb782-2fa1-4cf9-92e5-211d789dc437 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:51.471720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-edebb782-2fa1-4cf9-92e5-211d789dc437 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:51.474436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-edebb782-2fa1-4cf9-92e5-211d789dc437 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:51.474830 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-edebb782-2fa1-4cf9-92e5-211d789dc437 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:51.475614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-edebb782-2fa1-4cf9-92e5-211d789dc437 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:51.476053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-edebb782-2fa1-4cf9-92e5-211d789dc437 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:51.508181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-edebb782-2fa1-4cf9-92e5-211d789dc437 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044463 Sep 14 19:46:51.508750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 416/812] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:51 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:51.876377 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eafa0e6b-7b55-4556-9006-f487c210b256 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:51.879577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eafa0e6b-7b55-4556-9006-f487c210b256 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:51.883440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eafa0e6b-7b55-4556-9006-f487c210b256 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:51.883894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eafa0e6b-7b55-4556-9006-f487c210b256 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:51.884664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eafa0e6b-7b55-4556-9006-f487c210b256 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:51.885099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eafa0e6b-7b55-4556-9006-f487c210b256 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:51.915372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eafa0e6b-7b55-4556-9006-f487c210b256 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043024 Sep 14 19:46:51.915933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 397/813] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:51 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:52.274486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2b964337-b25a-45fa-9256-9ea4c36c6146 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:52.275427 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2b964337-b25a-45fa-9256-9ea4c36c6146 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:52.281441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b964337-b25a-45fa-9256-9ea4c36c6146 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:52.281921 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b964337-b25a-45fa-9256-9ea4c36c6146 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:52.282699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b964337-b25a-45fa-9256-9ea4c36c6146 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:52.283139 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b964337-b25a-45fa-9256-9ea4c36c6146 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:52.313467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2b964337-b25a-45fa-9256-9ea4c36c6146 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042747 Sep 14 19:46:52.314060 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 417/814] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:46:52.519784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4e9c53a4-7ba0-4bd2-b961-de74dfd94257 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:52.520709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4e9c53a4-7ba0-4bd2-b961-de74dfd94257 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:52.526577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e9c53a4-7ba0-4bd2-b961-de74dfd94257 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:52.527028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e9c53a4-7ba0-4bd2-b961-de74dfd94257 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:52.527819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e9c53a4-7ba0-4bd2-b961-de74dfd94257 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:52.528253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e9c53a4-7ba0-4bd2-b961-de74dfd94257 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:52.560058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4e9c53a4-7ba0-4bd2-b961-de74dfd94257 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044130 Sep 14 19:46:52.560653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 398/815] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:52 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:52.927139 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-42705e2a-42c9-4332-87a2-c9fb9c366a02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:52.928050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-42705e2a-42c9-4332-87a2-c9fb9c366a02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:52.934027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-42705e2a-42c9-4332-87a2-c9fb9c366a02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:52.934486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-42705e2a-42c9-4332-87a2-c9fb9c366a02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:52.935269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-42705e2a-42c9-4332-87a2-c9fb9c366a02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:52.935705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-42705e2a-42c9-4332-87a2-c9fb9c366a02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:52.965287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-42705e2a-42c9-4332-87a2-c9fb9c366a02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042008 Sep 14 19:46:52.965877 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 418/816] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:52 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:53.325153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-48b3b3cc-b891-44cc-978c-64ac2a0fa8e2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:53.326085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-48b3b3cc-b891-44cc-978c-64ac2a0fa8e2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:53.332637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b3b3cc-b891-44cc-978c-64ac2a0fa8e2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:53.333091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b3b3cc-b891-44cc-978c-64ac2a0fa8e2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:53.333914 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b3b3cc-b891-44cc-978c-64ac2a0fa8e2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:53.334350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b3b3cc-b891-44cc-978c-64ac2a0fa8e2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:53.364356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-48b3b3cc-b891-44cc-978c-64ac2a0fa8e2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042992 Sep 14 19:46:53.364932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 399/817] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:53 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:53.571031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b9cf804b-1952-4746-a350-29e6ad4a34e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:53.571940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b9cf804b-1952-4746-a350-29e6ad4a34e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:53.578415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9cf804b-1952-4746-a350-29e6ad4a34e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:53.578862 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9cf804b-1952-4746-a350-29e6ad4a34e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:53.579630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9cf804b-1952-4746-a350-29e6ad4a34e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:53.580062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9cf804b-1952-4746-a350-29e6ad4a34e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:53.608826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b9cf804b-1952-4746-a350-29e6ad4a34e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041401 Sep 14 19:46:53.609598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 419/818] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:53 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:53.976766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-364653b4-6582-4d29-a992-d7d357716727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:53.977778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-364653b4-6582-4d29-a992-d7d357716727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:53.984324 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-364653b4-6582-4d29-a992-d7d357716727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:53.984768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-364653b4-6582-4d29-a992-d7d357716727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:53.985653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-364653b4-6582-4d29-a992-d7d357716727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:53.986095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-364653b4-6582-4d29-a992-d7d357716727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:54.016738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-364653b4-6582-4d29-a992-d7d357716727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043736 Sep 14 19:46:54.017530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 400/819] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:53 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:54.286116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:46:54.286578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 19:46:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:46:54.471664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ac892bf8-7327-4ee0-bac2-885b26cc8c64 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:54.472825 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ac892bf8-7327-4ee0-bac2-885b26cc8c64 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:54.478608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac892bf8-7327-4ee0-bac2-885b26cc8c64 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:54.479083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac892bf8-7327-4ee0-bac2-885b26cc8c64 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:54.479845 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac892bf8-7327-4ee0-bac2-885b26cc8c64 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:54.480273 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac892bf8-7327-4ee0-bac2-885b26cc8c64 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:54.509444 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ac892bf8-7327-4ee0-bac2-885b26cc8c64 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137387 Sep 14 19:46:54.510025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 420/820] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:54.741614 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-849fd317-f537-4f6e-9d27-78ae181dca46 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:54.742924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-849fd317-f537-4f6e-9d27-78ae181dca46 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:54.749065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-849fd317-f537-4f6e-9d27-78ae181dca46 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:54.749675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-849fd317-f537-4f6e-9d27-78ae181dca46 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:54.750824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-849fd317-f537-4f6e-9d27-78ae181dca46 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:54.751222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-849fd317-f537-4f6e-9d27-78ae181dca46 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:54.781099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-849fd317-f537-4f6e-9d27-78ae181dca46 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164877 Sep 14 19:46:54.781684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 401/821] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:54 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:55.027969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ae67339e-a310-47e2-9e94-39897290640d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:55.028781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ae67339e-a310-47e2-9e94-39897290640d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:55.034903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae67339e-a310-47e2-9e94-39897290640d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:55.035369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae67339e-a310-47e2-9e94-39897290640d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:55.036281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae67339e-a310-47e2-9e94-39897290640d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:55.036731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae67339e-a310-47e2-9e94-39897290640d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:55.066831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ae67339e-a310-47e2-9e94-39897290640d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042761 Sep 14 19:46:55.067384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 421/822] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:55 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:55.521445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5f06b499-841f-43cc-bdd6-5eae547db0d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:55.522381 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5f06b499-841f-43cc-bdd6-5eae547db0d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:55.528207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f06b499-841f-43cc-bdd6-5eae547db0d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:55.528652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f06b499-841f-43cc-bdd6-5eae547db0d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:55.529423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f06b499-841f-43cc-bdd6-5eae547db0d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:55.529887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f06b499-841f-43cc-bdd6-5eae547db0d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:55.560185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5f06b499-841f-43cc-bdd6-5eae547db0d2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042446 Sep 14 19:46:55.560756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 402/823] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:55 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:55.793836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5f3fa3d3-6be0-4c77-af25-a565912f2de2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:55.794534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5f3fa3d3-6be0-4c77-af25-a565912f2de2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:55.801086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f3fa3d3-6be0-4c77-af25-a565912f2de2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:55.808088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f3fa3d3-6be0-4c77-af25-a565912f2de2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:55.808088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f3fa3d3-6be0-4c77-af25-a565912f2de2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:55.808088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f3fa3d3-6be0-4c77-af25-a565912f2de2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:55.835962 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5f3fa3d3-6be0-4c77-af25-a565912f2de2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047127 Sep 14 19:46:55.836545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 422/824] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:55 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:56.078870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f7082432-c537-4e33-aac3-fb200e017b64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:56.079691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f7082432-c537-4e33-aac3-fb200e017b64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:56.085689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7082432-c537-4e33-aac3-fb200e017b64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:56.086146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7082432-c537-4e33-aac3-fb200e017b64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:56.086927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7082432-c537-4e33-aac3-fb200e017b64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:56.087358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7082432-c537-4e33-aac3-fb200e017b64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:56.117476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f7082432-c537-4e33-aac3-fb200e017b64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042405 Sep 14 19:46:56.118089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 403/825] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:56 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:56.571935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2402c64c-f52c-4113-a60c-ba6507d111f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:56.573525 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2402c64c-f52c-4113-a60c-ba6507d111f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:56.579725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2402c64c-f52c-4113-a60c-ba6507d111f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:56.580173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2402c64c-f52c-4113-a60c-ba6507d111f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:56.580990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2402c64c-f52c-4113-a60c-ba6507d111f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:56.581422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2402c64c-f52c-4113-a60c-ba6507d111f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:56.611071 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2402c64c-f52c-4113-a60c-ba6507d111f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042938 Sep 14 19:46:56.611684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 423/826] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:56 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:56.847018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-896d0cc2-163c-47a0-988e-3f5bab1790a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:56.847921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-896d0cc2-163c-47a0-988e-3f5bab1790a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:56.854563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-896d0cc2-163c-47a0-988e-3f5bab1790a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:56.854980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-896d0cc2-163c-47a0-988e-3f5bab1790a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:56.855798 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-896d0cc2-163c-47a0-988e-3f5bab1790a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:56.856179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-896d0cc2-163c-47a0-988e-3f5bab1790a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:56.887480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-896d0cc2-163c-47a0-988e-3f5bab1790a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044140 Sep 14 19:46:56.888054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 404/827] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:56 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:57.129617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-178dc33a-e275-449d-8291-cac6ee9ef593 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:57.130536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-178dc33a-e275-449d-8291-cac6ee9ef593 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:57.136975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-178dc33a-e275-449d-8291-cac6ee9ef593 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:57.137429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-178dc33a-e275-449d-8291-cac6ee9ef593 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:57.138230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-178dc33a-e275-449d-8291-cac6ee9ef593 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:57.138671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-178dc33a-e275-449d-8291-cac6ee9ef593 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:57.167628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-178dc33a-e275-449d-8291-cac6ee9ef593 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041981 Sep 14 19:46:57.168195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 424/828] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:57 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:57.622867 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-48b12e11-949f-43f9-b743-b75300ee67a4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:57.623956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-48b12e11-949f-43f9-b743-b75300ee67a4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:57.629958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b12e11-949f-43f9-b743-b75300ee67a4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:57.630409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b12e11-949f-43f9-b743-b75300ee67a4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:57.631192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b12e11-949f-43f9-b743-b75300ee67a4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:57.631620 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b12e11-949f-43f9-b743-b75300ee67a4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:57.661691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-48b12e11-949f-43f9-b743-b75300ee67a4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043109 Sep 14 19:46:57.662267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 405/829] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:57 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:57.899039 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-06660983-4eaa-4d76-a5ee-944ad2d12eab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:57.899953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-06660983-4eaa-4d76-a5ee-944ad2d12eab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:57.905731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06660983-4eaa-4d76-a5ee-944ad2d12eab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:57.906235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06660983-4eaa-4d76-a5ee-944ad2d12eab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:57.907017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06660983-4eaa-4d76-a5ee-944ad2d12eab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:57.907470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-06660983-4eaa-4d76-a5ee-944ad2d12eab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:57.937362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-06660983-4eaa-4d76-a5ee-944ad2d12eab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042188 Sep 14 19:46:57.937950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 425/830] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:57 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:58.019687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f334702d-0198-4e17-9b52-7de470909216 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:46:58.020255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f334702d-0198-4e17-9b52-7de470909216 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:58.026485 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f334702d-0198-4e17-9b52-7de470909216 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:58.027002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f334702d-0198-4e17-9b52-7de470909216 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:58.027784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f334702d-0198-4e17-9b52-7de470909216 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:58.028226 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f334702d-0198-4e17-9b52-7de470909216 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:58.051316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-f334702d-0198-4e17-9b52-7de470909216 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lazy-loading 'flavor' on Instance uuid 7745385c-e705-4e0e-8fc7-c96f398b93d9 {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:46:58.179205 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8ad3b7c0-15f6-4f26-9fee-8bdb3bbbfddc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:58.180032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8ad3b7c0-15f6-4f26-9fee-8bdb3bbbfddc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:58.186532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ad3b7c0-15f6-4f26-9fee-8bdb3bbbfddc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:58.187007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ad3b7c0-15f6-4f26-9fee-8bdb3bbbfddc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:58.190119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ad3b7c0-15f6-4f26-9fee-8bdb3bbbfddc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:58.190119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ad3b7c0-15f6-4f26-9fee-8bdb3bbbfddc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:58.218418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8ad3b7c0-15f6-4f26-9fee-8bdb3bbbfddc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Sep 14 19:46:58.218986 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 426/831] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:58 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:46:58.367702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f334702d-0198-4e17-9b52-7de470909216 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "POST /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9/action" status: 202 len: 0 microversion: 2.1 time: 0.351801 Sep 14 19:46:58.368385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 406/832] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:46:58 2021] POST /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:46:58.383732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-55704436-e35b-4cac-908a-fac6d2023927 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:58.383732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-55704436-e35b-4cac-908a-fac6d2023927 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:58.384637 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55704436-e35b-4cac-908a-fac6d2023927 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:58.385087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55704436-e35b-4cac-908a-fac6d2023927 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:58.385914 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55704436-e35b-4cac-908a-fac6d2023927 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:58.386406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55704436-e35b-4cac-908a-fac6d2023927 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:58.617767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-55704436-e35b-4cac-908a-fac6d2023927 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:58.625465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-55704436-e35b-4cac-908a-fac6d2023927 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.251474 Sep 14 19:46:58.626080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 427/833] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:46:58 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:46:58.674137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9ad18d6a-8cc0-454c-bbde-f0de2eb188b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:58.675140 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9ad18d6a-8cc0-454c-bbde-f0de2eb188b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:58.681415 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ad18d6a-8cc0-454c-bbde-f0de2eb188b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:58.681886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ad18d6a-8cc0-454c-bbde-f0de2eb188b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:58.682666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ad18d6a-8cc0-454c-bbde-f0de2eb188b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:58.683095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ad18d6a-8cc0-454c-bbde-f0de2eb188b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:58.715032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9ad18d6a-8cc0-454c-bbde-f0de2eb188b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044904 Sep 14 19:46:58.715610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 407/834] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:58 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:46:58.949453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b4919b96-e03c-4b0c-985c-5b1105d338cf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:58.950414 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b4919b96-e03c-4b0c-985c-5b1105d338cf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:58.956255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b4919b96-e03c-4b0c-985c-5b1105d338cf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:58.956729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b4919b96-e03c-4b0c-985c-5b1105d338cf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:58.957527 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b4919b96-e03c-4b0c-985c-5b1105d338cf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:58.957976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b4919b96-e03c-4b0c-985c-5b1105d338cf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:58.987756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b4919b96-e03c-4b0c-985c-5b1105d338cf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042496 Sep 14 19:46:58.988325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 428/835] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:58 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:59.230461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-be26721d-09f3-4f1d-b58c-e7e85d0aeaf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:59.231407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-be26721d-09f3-4f1d-b58c-e7e85d0aeaf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:59.237442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be26721d-09f3-4f1d-b58c-e7e85d0aeaf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:59.237933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be26721d-09f3-4f1d-b58c-e7e85d0aeaf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:59.239666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be26721d-09f3-4f1d-b58c-e7e85d0aeaf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:59.240502 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be26721d-09f3-4f1d-b58c-e7e85d0aeaf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:59.272990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-be26721d-09f3-4f1d-b58c-e7e85d0aeaf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046248 Sep 14 19:46:59.273591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 408/836] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:59 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:59.643112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fab0428a-3579-4251-bcd4-5b4818e8eba8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:59.643742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fab0428a-3579-4251-bcd4-5b4818e8eba8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:59.649752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fab0428a-3579-4251-bcd4-5b4818e8eba8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:59.650204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fab0428a-3579-4251-bcd4-5b4818e8eba8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:59.650989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fab0428a-3579-4251-bcd4-5b4818e8eba8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:59.651430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fab0428a-3579-4251-bcd4-5b4818e8eba8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:59.727989 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ed6f3dd9-02ae-4157-a0ec-8766df6297be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:59.729024 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ed6f3dd9-02ae-4157-a0ec-8766df6297be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:46:59.736297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed6f3dd9-02ae-4157-a0ec-8766df6297be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:59.736757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed6f3dd9-02ae-4157-a0ec-8766df6297be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:59.737584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed6f3dd9-02ae-4157-a0ec-8766df6297be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:46:59.738032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed6f3dd9-02ae-4157-a0ec-8766df6297be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:46:59.772098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ed6f3dd9-02ae-4157-a0ec-8766df6297be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048250 Sep 14 19:46:59.772705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 409/837] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:46:59 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:46:59.783589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-fab0428a-3579-4251-bcd4-5b4818e8eba8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:46:59.791606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fab0428a-3579-4251-bcd4-5b4818e8eba8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.152135 Sep 14 19:46:59.792198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 429/838] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:46:59 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:00.000407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-042bc21f-0f78-449f-b656-9b49786d78a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:00.001358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-042bc21f-0f78-449f-b656-9b49786d78a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:00.007446 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-042bc21f-0f78-449f-b656-9b49786d78a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:00.007960 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-042bc21f-0f78-449f-b656-9b49786d78a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:00.008747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-042bc21f-0f78-449f-b656-9b49786d78a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:00.009192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-042bc21f-0f78-449f-b656-9b49786d78a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:00.039352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-042bc21f-0f78-449f-b656-9b49786d78a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Sep 14 19:47:00.039933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 410/839] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:46:59 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:00.285487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5f09e639-0f4c-4957-ae2a-5a5a06ed47d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:00.286600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5f09e639-0f4c-4957-ae2a-5a5a06ed47d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:00.293353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f09e639-0f4c-4957-ae2a-5a5a06ed47d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:00.293836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f09e639-0f4c-4957-ae2a-5a5a06ed47d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:00.294634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f09e639-0f4c-4957-ae2a-5a5a06ed47d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:00.295098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f09e639-0f4c-4957-ae2a-5a5a06ed47d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:00.325994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5f09e639-0f4c-4957-ae2a-5a5a06ed47d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Sep 14 19:47:00.326563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 430/840] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:00 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:00.784309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ffb0d446-75b5-49af-86eb-76b0c4151d11 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:00.785213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ffb0d446-75b5-49af-86eb-76b0c4151d11 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:00.791297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ffb0d446-75b5-49af-86eb-76b0c4151d11 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:00.791743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ffb0d446-75b5-49af-86eb-76b0c4151d11 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:00.793100 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ffb0d446-75b5-49af-86eb-76b0c4151d11 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:00.793549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ffb0d446-75b5-49af-86eb-76b0c4151d11 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:00.811227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-21fe2937-4390-40e8-aa73-023674971c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:00.812228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-21fe2937-4390-40e8-aa73-023674971c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:00.818323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21fe2937-4390-40e8-aa73-023674971c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:00.818774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21fe2937-4390-40e8-aa73-023674971c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:00.819802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21fe2937-4390-40e8-aa73-023674971c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:00.820353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21fe2937-4390-40e8-aa73-023674971c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:00.825625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ffb0d446-75b5-49af-86eb-76b0c4151d11 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045124 Sep 14 19:47:00.826262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 411/841] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:00 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:00.944979 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-21fe2937-4390-40e8-aa73-023674971c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:00.952590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-21fe2937-4390-40e8-aa73-023674971c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.146371 Sep 14 19:47:00.953171 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 431/842] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:00 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:01.051344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7449772f-f255-43c4-961d-2dfa3aa65072 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:01.052169 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7449772f-f255-43c4-961d-2dfa3aa65072 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:01.058243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7449772f-f255-43c4-961d-2dfa3aa65072 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:01.058738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7449772f-f255-43c4-961d-2dfa3aa65072 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:01.059656 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7449772f-f255-43c4-961d-2dfa3aa65072 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:01.060399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7449772f-f255-43c4-961d-2dfa3aa65072 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:01.092335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7449772f-f255-43c4-961d-2dfa3aa65072 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045025 Sep 14 19:47:01.092911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 412/843] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:01 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:01.337453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c4aa8deb-2fa0-4c42-a5ae-327b765495d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:01.338333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c4aa8deb-2fa0-4c42-a5ae-327b765495d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:01.344777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4aa8deb-2fa0-4c42-a5ae-327b765495d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:01.345229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4aa8deb-2fa0-4c42-a5ae-327b765495d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:01.346042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4aa8deb-2fa0-4c42-a5ae-327b765495d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:01.346546 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4aa8deb-2fa0-4c42-a5ae-327b765495d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:01.374945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c4aa8deb-2fa0-4c42-a5ae-327b765495d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041331 Sep 14 19:47:01.375495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 432/844] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:01 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:01.837709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-05f16e81-c612-4dd0-9c7b-ab6bcdffbcae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:01.838622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-05f16e81-c612-4dd0-9c7b-ab6bcdffbcae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:01.844519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05f16e81-c612-4dd0-9c7b-ab6bcdffbcae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:01.844963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05f16e81-c612-4dd0-9c7b-ab6bcdffbcae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:01.845766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05f16e81-c612-4dd0-9c7b-ab6bcdffbcae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:01.846207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05f16e81-c612-4dd0-9c7b-ab6bcdffbcae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:01.874798 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-05f16e81-c612-4dd0-9c7b-ab6bcdffbcae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041028 Sep 14 19:47:01.875355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 413/845] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:01 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:01.969368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c735774e-1ae4-406c-b338-b10772e471a3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:01.970010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c735774e-1ae4-406c-b338-b10772e471a3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:01.975977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c735774e-1ae4-406c-b338-b10772e471a3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:01.976425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c735774e-1ae4-406c-b338-b10772e471a3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:01.977203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c735774e-1ae4-406c-b338-b10772e471a3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:01.977679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c735774e-1ae4-406c-b338-b10772e471a3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:02.102513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c735774e-1ae4-406c-b338-b10772e471a3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:02.103939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-636fffaa-62d0-423c-b28e-2a30d2330d27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:02.105401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-636fffaa-62d0-423c-b28e-2a30d2330d27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:02.110610 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c735774e-1ae4-406c-b338-b10772e471a3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.144931 Sep 14 19:47:02.111064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-636fffaa-62d0-423c-b28e-2a30d2330d27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:02.111310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 433/846] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:01 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:02.111512 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-636fffaa-62d0-423c-b28e-2a30d2330d27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:02.112280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-636fffaa-62d0-423c-b28e-2a30d2330d27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:02.112713 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-636fffaa-62d0-423c-b28e-2a30d2330d27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:02.141619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-636fffaa-62d0-423c-b28e-2a30d2330d27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 Sep 14 19:47:02.142173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 414/847] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:02 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:02.386030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8cbf4348-5c39-4b8f-8c71-a9b34f6f4b0c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:02.386942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8cbf4348-5c39-4b8f-8c71-a9b34f6f4b0c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:02.392692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cbf4348-5c39-4b8f-8c71-a9b34f6f4b0c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:02.393136 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cbf4348-5c39-4b8f-8c71-a9b34f6f4b0c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:02.393939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cbf4348-5c39-4b8f-8c71-a9b34f6f4b0c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:02.394382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cbf4348-5c39-4b8f-8c71-a9b34f6f4b0c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:02.423716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8cbf4348-5c39-4b8f-8c71-a9b34f6f4b0c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041424 Sep 14 19:47:02.424261 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 434/848] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:02 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:02.887319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4c4652ac-a83b-4ec2-9587-8b274d71c54d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:02.888201 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4c4652ac-a83b-4ec2-9587-8b274d71c54d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:02.894023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c4652ac-a83b-4ec2-9587-8b274d71c54d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:02.894461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c4652ac-a83b-4ec2-9587-8b274d71c54d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:02.895241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c4652ac-a83b-4ec2-9587-8b274d71c54d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:02.895661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c4652ac-a83b-4ec2-9587-8b274d71c54d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:02.925925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4c4652ac-a83b-4ec2-9587-8b274d71c54d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043058 Sep 14 19:47:02.926500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 415/849] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:02 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:03.127496 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5e47f03c-ad20-4b2d-8b37-994631a1a78b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:03.128104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5e47f03c-ad20-4b2d-8b37-994631a1a78b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:03.133914 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e47f03c-ad20-4b2d-8b37-994631a1a78b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:03.134337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e47f03c-ad20-4b2d-8b37-994631a1a78b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:03.135093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e47f03c-ad20-4b2d-8b37-994631a1a78b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:03.135552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e47f03c-ad20-4b2d-8b37-994631a1a78b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:03.152908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8a5af156-d059-4328-b64e-55b3aa7caf66 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:03.153992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8a5af156-d059-4328-b64e-55b3aa7caf66 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:03.159788 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a5af156-d059-4328-b64e-55b3aa7caf66 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:03.160268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a5af156-d059-4328-b64e-55b3aa7caf66 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:03.161038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a5af156-d059-4328-b64e-55b3aa7caf66 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:03.161471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a5af156-d059-4328-b64e-55b3aa7caf66 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:03.191775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8a5af156-d059-4328-b64e-55b3aa7caf66 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042647 Sep 14 19:47:03.192339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 416/850] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:03 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:03.256734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5e47f03c-ad20-4b2d-8b37-994631a1a78b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:03.264781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5e47f03c-ad20-4b2d-8b37-994631a1a78b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140840 Sep 14 19:47:03.265350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 435/851] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:03 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:03.435768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4a067000-0164-4d71-b504-4da3edabed61 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:03.436672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4a067000-0164-4d71-b504-4da3edabed61 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:03.442548 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a067000-0164-4d71-b504-4da3edabed61 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:03.442995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a067000-0164-4d71-b504-4da3edabed61 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:03.443757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a067000-0164-4d71-b504-4da3edabed61 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:03.444255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a067000-0164-4d71-b504-4da3edabed61 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:03.472457 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4a067000-0164-4d71-b504-4da3edabed61 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041060 Sep 14 19:47:03.473019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 417/852] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:03 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:03.937718 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-25b08908-0cfd-4548-ac42-1076e7215fd8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:03.938661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-25b08908-0cfd-4548-ac42-1076e7215fd8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:03.944564 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-25b08908-0cfd-4548-ac42-1076e7215fd8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:03.945011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-25b08908-0cfd-4548-ac42-1076e7215fd8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:03.945815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-25b08908-0cfd-4548-ac42-1076e7215fd8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:03.946249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-25b08908-0cfd-4548-ac42-1076e7215fd8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:03.974942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-25b08908-0cfd-4548-ac42-1076e7215fd8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041122 Sep 14 19:47:03.975522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 436/853] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:04.203462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2be21edb-e818-45e2-a1ca-528d81cbf7fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:04.204400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2be21edb-e818-45e2-a1ca-528d81cbf7fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:04.210363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2be21edb-e818-45e2-a1ca-528d81cbf7fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:04.210809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2be21edb-e818-45e2-a1ca-528d81cbf7fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:04.211577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2be21edb-e818-45e2-a1ca-528d81cbf7fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:04.212019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2be21edb-e818-45e2-a1ca-528d81cbf7fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:04.240527 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2be21edb-e818-45e2-a1ca-528d81cbf7fc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Sep 14 19:47:04.241081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 418/854] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:04 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:04.283096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6fcb7611-d046-449f-aed7-e24181bb9161 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:04.283709 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6fcb7611-d046-449f-aed7-e24181bb9161 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:04.289667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6fcb7611-d046-449f-aed7-e24181bb9161 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:04.290411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6fcb7611-d046-449f-aed7-e24181bb9161 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:04.290897 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6fcb7611-d046-449f-aed7-e24181bb9161 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:04.291333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6fcb7611-d046-449f-aed7-e24181bb9161 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:04.414290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6fcb7611-d046-449f-aed7-e24181bb9161 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:04.421747 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6fcb7611-d046-449f-aed7-e24181bb9161 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142391 Sep 14 19:47:04.422705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 437/855] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:04 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:04.483820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-df71f6c0-9d2e-46d0-a437-5ce29cd96041 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:04.484711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-df71f6c0-9d2e-46d0-a437-5ce29cd96041 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:04.490549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df71f6c0-9d2e-46d0-a437-5ce29cd96041 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:04.490997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df71f6c0-9d2e-46d0-a437-5ce29cd96041 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:04.491764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df71f6c0-9d2e-46d0-a437-5ce29cd96041 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:04.492278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df71f6c0-9d2e-46d0-a437-5ce29cd96041 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:04.520792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-df71f6c0-9d2e-46d0-a437-5ce29cd96041 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040684 Sep 14 19:47:04.521357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 419/856] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:04 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:04.986143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7ab7d23f-1b92-49a5-ba4b-8610b01a704e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:04.987001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7ab7d23f-1b92-49a5-ba4b-8610b01a704e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:04.992888 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7ab7d23f-1b92-49a5-ba4b-8610b01a704e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:04.993341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7ab7d23f-1b92-49a5-ba4b-8610b01a704e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:04.994138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7ab7d23f-1b92-49a5-ba4b-8610b01a704e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:04.994611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7ab7d23f-1b92-49a5-ba4b-8610b01a704e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:05.023932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7ab7d23f-1b92-49a5-ba4b-8610b01a704e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041710 Sep 14 19:47:05.024485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 438/857] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:04 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:05.251903 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c85e85fb-89c3-4185-abde-6b2f148eb041 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:05.252720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c85e85fb-89c3-4185-abde-6b2f148eb041 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:05.258523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c85e85fb-89c3-4185-abde-6b2f148eb041 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:05.258965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c85e85fb-89c3-4185-abde-6b2f148eb041 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:05.259721 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c85e85fb-89c3-4185-abde-6b2f148eb041 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:05.260148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c85e85fb-89c3-4185-abde-6b2f148eb041 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:05.291254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c85e85fb-89c3-4185-abde-6b2f148eb041 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Sep 14 19:47:05.291806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 420/858] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:05 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:05.441135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-de90ce1f-ce20-4e99-b9f9-ca1eb45653f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:05.441868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-de90ce1f-ce20-4e99-b9f9-ca1eb45653f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:05.447808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de90ce1f-ce20-4e99-b9f9-ca1eb45653f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:05.448252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de90ce1f-ce20-4e99-b9f9-ca1eb45653f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:05.449682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de90ce1f-ce20-4e99-b9f9-ca1eb45653f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:05.450135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de90ce1f-ce20-4e99-b9f9-ca1eb45653f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:05.531912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8525fcb1-1cf9-442d-8c99-c1e4ea5fb39f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:05.532820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8525fcb1-1cf9-442d-8c99-c1e4ea5fb39f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:05.538859 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8525fcb1-1cf9-442d-8c99-c1e4ea5fb39f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:05.539316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8525fcb1-1cf9-442d-8c99-c1e4ea5fb39f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:05.540093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8525fcb1-1cf9-442d-8c99-c1e4ea5fb39f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:05.540530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8525fcb1-1cf9-442d-8c99-c1e4ea5fb39f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:05.570466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8525fcb1-1cf9-442d-8c99-c1e4ea5fb39f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042231 Sep 14 19:47:05.571046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 421/859] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:05 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:05.572355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-de90ce1f-ce20-4e99-b9f9-ca1eb45653f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:05.580393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-de90ce1f-ce20-4e99-b9f9-ca1eb45653f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.143024 Sep 14 19:47:05.580949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 439/860] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:05 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:06.036616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-937d5e44-d3e0-4ae9-ac8c-a095859cc0aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:06.037557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-937d5e44-d3e0-4ae9-ac8c-a095859cc0aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:06.044029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-937d5e44-d3e0-4ae9-ac8c-a095859cc0aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:06.044468 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-937d5e44-d3e0-4ae9-ac8c-a095859cc0aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:06.045220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-937d5e44-d3e0-4ae9-ac8c-a095859cc0aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:06.045685 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-937d5e44-d3e0-4ae9-ac8c-a095859cc0aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:06.073718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-937d5e44-d3e0-4ae9-ac8c-a095859cc0aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040847 Sep 14 19:47:06.074275 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 422/861] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:06 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:06.303049 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-94464b1f-e1ae-457e-a890-88d5af3b1375 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:06.303957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-94464b1f-e1ae-457e-a890-88d5af3b1375 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:06.310359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94464b1f-e1ae-457e-a890-88d5af3b1375 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:06.310787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94464b1f-e1ae-457e-a890-88d5af3b1375 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:06.311548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94464b1f-e1ae-457e-a890-88d5af3b1375 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:06.311979 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94464b1f-e1ae-457e-a890-88d5af3b1375 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:06.340666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-94464b1f-e1ae-457e-a890-88d5af3b1375 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 Sep 14 19:47:06.341217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 440/862] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:06 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:06.582418 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-58a103d2-b4a4-477e-bb7c-96bac66b0a3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:06.583277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-58a103d2-b4a4-477e-bb7c-96bac66b0a3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:06.589048 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58a103d2-b4a4-477e-bb7c-96bac66b0a3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:06.589487 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58a103d2-b4a4-477e-bb7c-96bac66b0a3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:06.590276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58a103d2-b4a4-477e-bb7c-96bac66b0a3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:06.590707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58a103d2-b4a4-477e-bb7c-96bac66b0a3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:06.602486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d6a3be29-692d-4afa-9958-1e355dc435c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:06.603095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d6a3be29-692d-4afa-9958-1e355dc435c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:06.609382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6a3be29-692d-4afa-9958-1e355dc435c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:06.610034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6a3be29-692d-4afa-9958-1e355dc435c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:06.610653 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6a3be29-692d-4afa-9958-1e355dc435c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:06.611088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6a3be29-692d-4afa-9958-1e355dc435c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:06.620364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-58a103d2-b4a4-477e-bb7c-96bac66b0a3a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041716 Sep 14 19:47:06.621592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 423/863] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:06 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:06.728702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d6a3be29-692d-4afa-9958-1e355dc435c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:06.736640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d6a3be29-692d-4afa-9958-1e355dc435c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.137886 Sep 14 19:47:06.737192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 441/864] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:06 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:07.085521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2d17309f-6cfa-4ac0-a8f4-ba24b1f831b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:07.086432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2d17309f-6cfa-4ac0-a8f4-ba24b1f831b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:07.093017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d17309f-6cfa-4ac0-a8f4-ba24b1f831b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:07.093391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d17309f-6cfa-4ac0-a8f4-ba24b1f831b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:07.094239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d17309f-6cfa-4ac0-a8f4-ba24b1f831b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:07.094671 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d17309f-6cfa-4ac0-a8f4-ba24b1f831b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:07.123841 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2d17309f-6cfa-4ac0-a8f4-ba24b1f831b7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042089 Sep 14 19:47:07.124404 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 424/865] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:07 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:07.351692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3006bef8-1f8e-4d5f-afff-5c41ba0f1901 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:07.352521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3006bef8-1f8e-4d5f-afff-5c41ba0f1901 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:07.358329 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3006bef8-1f8e-4d5f-afff-5c41ba0f1901 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:07.358777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3006bef8-1f8e-4d5f-afff-5c41ba0f1901 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:07.359538 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3006bef8-1f8e-4d5f-afff-5c41ba0f1901 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:07.359971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3006bef8-1f8e-4d5f-afff-5c41ba0f1901 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:07.388817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3006bef8-1f8e-4d5f-afff-5c41ba0f1901 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Sep 14 19:47:07.389363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 442/866] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:07 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:07.632316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4128a634-a36e-4697-8821-49dfd22d8353 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:07.633249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4128a634-a36e-4697-8821-49dfd22d8353 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:07.639264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4128a634-a36e-4697-8821-49dfd22d8353 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:07.639702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4128a634-a36e-4697-8821-49dfd22d8353 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:07.640459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4128a634-a36e-4697-8821-49dfd22d8353 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:07.640888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4128a634-a36e-4697-8821-49dfd22d8353 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:07.669449 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4128a634-a36e-4697-8821-49dfd22d8353 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040973 Sep 14 19:47:07.670024 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 425/867] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:07 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:07.754521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b1dea6cd-7cae-416d-9921-c7b8421d9794 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:07.755127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b1dea6cd-7cae-416d-9921-c7b8421d9794 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:07.760919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1dea6cd-7cae-416d-9921-c7b8421d9794 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:07.761373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1dea6cd-7cae-416d-9921-c7b8421d9794 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:07.762211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1dea6cd-7cae-416d-9921-c7b8421d9794 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:07.762646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1dea6cd-7cae-416d-9921-c7b8421d9794 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:07.882151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b1dea6cd-7cae-416d-9921-c7b8421d9794 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:07.889665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b1dea6cd-7cae-416d-9921-c7b8421d9794 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138752 Sep 14 19:47:07.890284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 443/868] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:07 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:47:08.135453 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3265f866-dd68-46c5-b6cc-17178f65665c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:08.136851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3265f866-dd68-46c5-b6cc-17178f65665c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:08.142739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3265f866-dd68-46c5-b6cc-17178f65665c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:08.143122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3265f866-dd68-46c5-b6cc-17178f65665c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:08.143872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3265f866-dd68-46c5-b6cc-17178f65665c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:08.144298 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3265f866-dd68-46c5-b6cc-17178f65665c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:08.172996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3265f866-dd68-46c5-b6cc-17178f65665c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041301 Sep 14 19:47:08.173569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 426/869] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:08 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:47:08.399954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-94d13594-6bd4-4128-9d7f-89414ee2186c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:08.400791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-94d13594-6bd4-4128-9d7f-89414ee2186c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:08.406921 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94d13594-6bd4-4128-9d7f-89414ee2186c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:08.407381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94d13594-6bd4-4128-9d7f-89414ee2186c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:08.408122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94d13594-6bd4-4128-9d7f-89414ee2186c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:08.408657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94d13594-6bd4-4128-9d7f-89414ee2186c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:08.437889 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-94d13594-6bd4-4128-9d7f-89414ee2186c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041751 Sep 14 19:47:08.438445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 444/870] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:08 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:08.681073 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-83643b22-e970-4507-826d-735c52579f4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:08.682014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-83643b22-e970-4507-826d-735c52579f4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:08.688585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83643b22-e970-4507-826d-735c52579f4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:08.689036 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83643b22-e970-4507-826d-735c52579f4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:08.689839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83643b22-e970-4507-826d-735c52579f4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:08.690277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83643b22-e970-4507-826d-735c52579f4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:08.723232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-83643b22-e970-4507-826d-735c52579f4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Sep 14 19:47:08.723822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 427/871] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:08 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:09.036285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-83eda718-7dd4-46be-b8f5-0f2e292b3a84 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:09.036285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-83eda718-7dd4-46be-b8f5-0f2e292b3a84 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:09.036285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83eda718-7dd4-46be-b8f5-0f2e292b3a84 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:09.036285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83eda718-7dd4-46be-b8f5-0f2e292b3a84 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:09.041927 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83eda718-7dd4-46be-b8f5-0f2e292b3a84 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:09.041927 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83eda718-7dd4-46be-b8f5-0f2e292b3a84 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:09.119268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-83eda718-7dd4-46be-b8f5-0f2e292b3a84 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:09.126605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-83eda718-7dd4-46be-b8f5-0f2e292b3a84 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.223920 Sep 14 19:47:09.130440 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 445/872] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:08 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:09.184238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ac350287-5b31-4f61-b2e2-9bb847e33fed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:09.185135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ac350287-5b31-4f61-b2e2-9bb847e33fed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:09.191346 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac350287-5b31-4f61-b2e2-9bb847e33fed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:09.191788 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac350287-5b31-4f61-b2e2-9bb847e33fed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:09.192545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac350287-5b31-4f61-b2e2-9bb847e33fed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:09.192974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac350287-5b31-4f61-b2e2-9bb847e33fed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:09.221626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ac350287-5b31-4f61-b2e2-9bb847e33fed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041127 Sep 14 19:47:09.222189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 428/873] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:09.450051 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6cf92c9d-87d7-448a-add6-1ae7fee54755 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:09.451022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6cf92c9d-87d7-448a-add6-1ae7fee54755 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:09.456945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cf92c9d-87d7-448a-add6-1ae7fee54755 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:09.457394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cf92c9d-87d7-448a-add6-1ae7fee54755 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:09.458186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cf92c9d-87d7-448a-add6-1ae7fee54755 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:09.458615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cf92c9d-87d7-448a-add6-1ae7fee54755 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:09.487300 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6cf92c9d-87d7-448a-add6-1ae7fee54755 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041793 Sep 14 19:47:09.487845 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 446/874] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:09 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:09.734605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4fcf2f81-fca3-451d-affc-1b312d29d521 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:09.735569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4fcf2f81-fca3-451d-affc-1b312d29d521 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:09.741439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fcf2f81-fca3-451d-affc-1b312d29d521 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:09.741931 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fcf2f81-fca3-451d-affc-1b312d29d521 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:09.742705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fcf2f81-fca3-451d-affc-1b312d29d521 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:09.743218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fcf2f81-fca3-451d-affc-1b312d29d521 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:09.772460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4fcf2f81-fca3-451d-affc-1b312d29d521 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041672 Sep 14 19:47:09.773218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 429/875] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:09 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:10.143665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cd32a701-8cae-4ca9-823d-f508859d7dc3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:10.144229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cd32a701-8cae-4ca9-823d-f508859d7dc3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:10.150063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd32a701-8cae-4ca9-823d-f508859d7dc3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:10.150513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd32a701-8cae-4ca9-823d-f508859d7dc3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:10.151280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd32a701-8cae-4ca9-823d-f508859d7dc3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:10.151774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd32a701-8cae-4ca9-823d-f508859d7dc3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:10.232343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-49065cc0-b04f-49d0-b848-65f069231230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:10.233319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-49065cc0-b04f-49d0-b848-65f069231230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:10.239521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49065cc0-b04f-49d0-b848-65f069231230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:10.239970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49065cc0-b04f-49d0-b848-65f069231230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:10.241770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49065cc0-b04f-49d0-b848-65f069231230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:10.241770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49065cc0-b04f-49d0-b848-65f069231230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:10.273969 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-49065cc0-b04f-49d0-b848-65f069231230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045436 Sep 14 19:47:10.277257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 430/876] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:10.278465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cd32a701-8cae-4ca9-823d-f508859d7dc3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:10.286030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cd32a701-8cae-4ca9-823d-f508859d7dc3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.146156 Sep 14 19:47:10.286641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 447/877] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:10 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:10.498479 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-328a2e18-e4b7-4956-8c36-1ee4469e7c4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:10.499383 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-328a2e18-e4b7-4956-8c36-1ee4469e7c4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:10.505400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-328a2e18-e4b7-4956-8c36-1ee4469e7c4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:10.511339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-328a2e18-e4b7-4956-8c36-1ee4469e7c4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:10.511339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-328a2e18-e4b7-4956-8c36-1ee4469e7c4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:10.511339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-328a2e18-e4b7-4956-8c36-1ee4469e7c4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:10.536468 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-328a2e18-e4b7-4956-8c36-1ee4469e7c4b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041763 Sep 14 19:47:10.537031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 431/878] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:10 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:10.784172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d07dbb9a-ddb8-43e1-9d0f-d4dd07ab8ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:10.785807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d07dbb9a-ddb8-43e1-9d0f-d4dd07ab8ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:10.791326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d07dbb9a-ddb8-43e1-9d0f-d4dd07ab8ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:10.791779 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d07dbb9a-ddb8-43e1-9d0f-d4dd07ab8ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:10.792561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d07dbb9a-ddb8-43e1-9d0f-d4dd07ab8ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:10.793000 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d07dbb9a-ddb8-43e1-9d0f-d4dd07ab8ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:10.823325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d07dbb9a-ddb8-43e1-9d0f-d4dd07ab8ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Sep 14 19:47:10.824866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 448/879] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:10 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:11.286404 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4749b761-1f97-43bf-8907-c5af65eddfcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:11.287222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4749b761-1f97-43bf-8907-c5af65eddfcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:11.293731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4749b761-1f97-43bf-8907-c5af65eddfcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:11.294185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4749b761-1f97-43bf-8907-c5af65eddfcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:11.294952 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4749b761-1f97-43bf-8907-c5af65eddfcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:11.295387 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4749b761-1f97-43bf-8907-c5af65eddfcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:11.303044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f6e7ce52-37cf-41cb-8a6e-5c0bbcb4d8f2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:11.303655 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f6e7ce52-37cf-41cb-8a6e-5c0bbcb4d8f2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:11.309730 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6e7ce52-37cf-41cb-8a6e-5c0bbcb4d8f2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:11.310181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6e7ce52-37cf-41cb-8a6e-5c0bbcb4d8f2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:11.310957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6e7ce52-37cf-41cb-8a6e-5c0bbcb4d8f2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:11.311415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6e7ce52-37cf-41cb-8a6e-5c0bbcb4d8f2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:11.324820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4749b761-1f97-43bf-8907-c5af65eddfcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042284 Sep 14 19:47:11.325449 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 432/880] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:11 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:11.428457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f6e7ce52-37cf-41cb-8a6e-5c0bbcb4d8f2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:11.435674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f6e7ce52-37cf-41cb-8a6e-5c0bbcb4d8f2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.136297 Sep 14 19:47:11.436250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 449/881] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:11 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:47:11.548731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e0ada9dc-a514-4d81-a2eb-cc3f94b7c8c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:11.549618 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e0ada9dc-a514-4d81-a2eb-cc3f94b7c8c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:11.555389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e0ada9dc-a514-4d81-a2eb-cc3f94b7c8c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:11.555842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e0ada9dc-a514-4d81-a2eb-cc3f94b7c8c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:11.556603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e0ada9dc-a514-4d81-a2eb-cc3f94b7c8c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:11.557057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e0ada9dc-a514-4d81-a2eb-cc3f94b7c8c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:11.585242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e0ada9dc-a514-4d81-a2eb-cc3f94b7c8c8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040747 Sep 14 19:47:11.585845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 433/882] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:11.835431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1bcd0a11-dfc2-4c1d-94b4-2a29b6ac5604 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:11.836322 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1bcd0a11-dfc2-4c1d-94b4-2a29b6ac5604 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:11.842771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bcd0a11-dfc2-4c1d-94b4-2a29b6ac5604 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:11.843216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bcd0a11-dfc2-4c1d-94b4-2a29b6ac5604 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:11.843977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bcd0a11-dfc2-4c1d-94b4-2a29b6ac5604 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:11.844407 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bcd0a11-dfc2-4c1d-94b4-2a29b6ac5604 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:11.872015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1bcd0a11-dfc2-4c1d-94b4-2a29b6ac5604 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040462 Sep 14 19:47:11.872561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 450/883] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:11 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:12.336607 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3a9ce60e-46bb-4879-a9a5-06c29b966213 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:12.337524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3a9ce60e-46bb-4879-a9a5-06c29b966213 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:12.343747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a9ce60e-46bb-4879-a9a5-06c29b966213 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:12.344181 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a9ce60e-46bb-4879-a9a5-06c29b966213 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:12.344966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a9ce60e-46bb-4879-a9a5-06c29b966213 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:12.345396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a9ce60e-46bb-4879-a9a5-06c29b966213 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:12.373642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3a9ce60e-46bb-4879-a9a5-06c29b966213 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040811 Sep 14 19:47:12.374185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 434/884] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:12 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:12.452351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f2eb6ebd-7347-4f42-a854-2da45f2146fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:12.452956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f2eb6ebd-7347-4f42-a854-2da45f2146fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:12.458773 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f2eb6ebd-7347-4f42-a854-2da45f2146fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:12.459231 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f2eb6ebd-7347-4f42-a854-2da45f2146fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:12.459999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f2eb6ebd-7347-4f42-a854-2da45f2146fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:12.460433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f2eb6ebd-7347-4f42-a854-2da45f2146fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:12.581664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f2eb6ebd-7347-4f42-a854-2da45f2146fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:12.588849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f2eb6ebd-7347-4f42-a854-2da45f2146fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140136 Sep 14 19:47:12.589410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 451/885] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:12 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:12.596022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bb85afb5-fc0a-4b85-b39d-43b7feaba1bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:12.596965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bb85afb5-fc0a-4b85-b39d-43b7feaba1bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:12.602723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb85afb5-fc0a-4b85-b39d-43b7feaba1bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:12.603185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb85afb5-fc0a-4b85-b39d-43b7feaba1bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:12.603955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb85afb5-fc0a-4b85-b39d-43b7feaba1bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:12.604387 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb85afb5-fc0a-4b85-b39d-43b7feaba1bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:12.633175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bb85afb5-fc0a-4b85-b39d-43b7feaba1bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040846 Sep 14 19:47:12.633761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 435/886] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:12 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:12.883426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e668faca-32e7-4c7c-b99c-304682ed026f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:12.884338 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e668faca-32e7-4c7c-b99c-304682ed026f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:12.890188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e668faca-32e7-4c7c-b99c-304682ed026f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:12.890640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e668faca-32e7-4c7c-b99c-304682ed026f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:12.891410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e668faca-32e7-4c7c-b99c-304682ed026f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:12.891953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e668faca-32e7-4c7c-b99c-304682ed026f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:12.922796 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e668faca-32e7-4c7c-b99c-304682ed026f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042856 Sep 14 19:47:12.923354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 452/887] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:12 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:13.384546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9a4fbd4a-76a9-4360-8b35-8cf7b1e07226 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:13.385435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9a4fbd4a-76a9-4360-8b35-8cf7b1e07226 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:13.391767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9a4fbd4a-76a9-4360-8b35-8cf7b1e07226 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:13.392207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9a4fbd4a-76a9-4360-8b35-8cf7b1e07226 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:13.392961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9a4fbd4a-76a9-4360-8b35-8cf7b1e07226 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:13.393386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9a4fbd4a-76a9-4360-8b35-8cf7b1e07226 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:13.422630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9a4fbd4a-76a9-4360-8b35-8cf7b1e07226 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041686 Sep 14 19:47:13.423175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 436/888] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:13.605715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6f53bc93-b2aa-43b3-b17b-2e6c11704afa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:13.606586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6f53bc93-b2aa-43b3-b17b-2e6c11704afa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:13.612704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6f53bc93-b2aa-43b3-b17b-2e6c11704afa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:13.613159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6f53bc93-b2aa-43b3-b17b-2e6c11704afa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:13.614007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6f53bc93-b2aa-43b3-b17b-2e6c11704afa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:13.614452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6f53bc93-b2aa-43b3-b17b-2e6c11704afa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:13.644643 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2705d632-db75-497f-876b-0d437da71224 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:13.645457 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2705d632-db75-497f-876b-0d437da71224 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:13.651777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2705d632-db75-497f-876b-0d437da71224 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:13.652227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2705d632-db75-497f-876b-0d437da71224 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:13.653016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2705d632-db75-497f-876b-0d437da71224 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:13.653481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2705d632-db75-497f-876b-0d437da71224 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:13.683910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2705d632-db75-497f-876b-0d437da71224 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043050 Sep 14 19:47:13.684669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 437/889] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:13 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:13.733155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6f53bc93-b2aa-43b3-b17b-2e6c11704afa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:13.740411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6f53bc93-b2aa-43b3-b17b-2e6c11704afa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138330 Sep 14 19:47:13.740973 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 453/890] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:13 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:13.934269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-70c2d567-f339-42ab-a891-69a8dccb8e1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:13.935172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-70c2d567-f339-42ab-a891-69a8dccb8e1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:13.940995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70c2d567-f339-42ab-a891-69a8dccb8e1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:13.943815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70c2d567-f339-42ab-a891-69a8dccb8e1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:13.943815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70c2d567-f339-42ab-a891-69a8dccb8e1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:13.943815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70c2d567-f339-42ab-a891-69a8dccb8e1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:13.971570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-70c2d567-f339-42ab-a891-69a8dccb8e1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041725 Sep 14 19:47:13.972119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 438/891] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:13 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:14.434210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-78f52d47-7fce-4e8a-8daf-00d8ca9f34d8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:14.435113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-78f52d47-7fce-4e8a-8daf-00d8ca9f34d8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:14.440938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78f52d47-7fce-4e8a-8daf-00d8ca9f34d8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:14.441386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78f52d47-7fce-4e8a-8daf-00d8ca9f34d8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:14.442195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78f52d47-7fce-4e8a-8daf-00d8ca9f34d8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:14.442630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78f52d47-7fce-4e8a-8daf-00d8ca9f34d8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:14.471350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-78f52d47-7fce-4e8a-8daf-00d8ca9f34d8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040997 Sep 14 19:47:14.471899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 454/892] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:14 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:14.695196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-be3b307b-8258-4dbd-9a3d-7aa66be6e59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:14.696159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-be3b307b-8258-4dbd-9a3d-7aa66be6e59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:14.702516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be3b307b-8258-4dbd-9a3d-7aa66be6e59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:14.702983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be3b307b-8258-4dbd-9a3d-7aa66be6e59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:14.703748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be3b307b-8258-4dbd-9a3d-7aa66be6e59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:14.704184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be3b307b-8258-4dbd-9a3d-7aa66be6e59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:14.732611 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-be3b307b-8258-4dbd-9a3d-7aa66be6e59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041176 Sep 14 19:47:14.733160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 439/893] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:14 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:14.757429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-850975b0-585e-42d9-b63f-0126fcb9fbfc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:14.758069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-850975b0-585e-42d9-b63f-0126fcb9fbfc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:14.764364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-850975b0-585e-42d9-b63f-0126fcb9fbfc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:14.764810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-850975b0-585e-42d9-b63f-0126fcb9fbfc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:14.765608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-850975b0-585e-42d9-b63f-0126fcb9fbfc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:14.766078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-850975b0-585e-42d9-b63f-0126fcb9fbfc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:14.883820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-850975b0-585e-42d9-b63f-0126fcb9fbfc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:14.892253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-850975b0-585e-42d9-b63f-0126fcb9fbfc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138464 Sep 14 19:47:14.892826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 455/894] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:14 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:14.983042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ef0c6d99-1378-4d9c-aee9-805300d8efe8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:14.983870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ef0c6d99-1378-4d9c-aee9-805300d8efe8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:14.989799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ef0c6d99-1378-4d9c-aee9-805300d8efe8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:14.990250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ef0c6d99-1378-4d9c-aee9-805300d8efe8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:14.991016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ef0c6d99-1378-4d9c-aee9-805300d8efe8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:14.991455 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ef0c6d99-1378-4d9c-aee9-805300d8efe8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:15.020338 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ef0c6d99-1378-4d9c-aee9-805300d8efe8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Sep 14 19:47:15.020899 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 440/895] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:14 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:15.483361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f1ddd9b1-f746-4aaa-b3ee-af6c91753057 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:15.484267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f1ddd9b1-f746-4aaa-b3ee-af6c91753057 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:15.489971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f1ddd9b1-f746-4aaa-b3ee-af6c91753057 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:15.490418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f1ddd9b1-f746-4aaa-b3ee-af6c91753057 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:15.491198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f1ddd9b1-f746-4aaa-b3ee-af6c91753057 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:15.491764 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f1ddd9b1-f746-4aaa-b3ee-af6c91753057 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:15.504124 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-29e1239d-fd54-4d8d-8616-62b9b53f7043 req-203b02bd-5dbb-43fe-8a0c-83cc75228f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7745385c-e705-4e0e-8fc7-c96f398b93d9", "name": "network-vif-unplugged", "status": "completed", "tag": "ffccccb6-d608-41f3-af2c-a06ebc5fa625"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:15.505199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:47:15.505199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:47:15.512744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-29e1239d-fd54-4d8d-8616-62b9b53f7043 req-203b02bd-5dbb-43fe-8a0c-83cc75228f04 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:15.513510 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-29e1239d-fd54-4d8d-8616-62b9b53f7043 req-203b02bd-5dbb-43fe-8a0c-83cc75228f04 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:15.521777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f1ddd9b1-f746-4aaa-b3ee-af6c91753057 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042630 Sep 14 19:47:15.522660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 456/896] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:15 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:15.524529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-29e1239d-fd54-4d8d-8616-62b9b53f7043 req-203b02bd-5dbb-43fe-8a0c-83cc75228f04 service nova] Creating event network-vif-unplugged:ffccccb6-d608-41f3-af2c-a06ebc5fa625 for instance 7745385c-e705-4e0e-8fc7-c96f398b93d9 on hv-cinder-80588 Sep 14 19:47:15.530202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-29e1239d-fd54-4d8d-8616-62b9b53f7043 req-203b02bd-5dbb-43fe-8a0c-83cc75228f04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030101 Sep 14 19:47:15.531191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 441/897] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:47:15 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:15.743892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-302ef25e-71b7-405a-8ae5-6b34b58de45f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:15.744731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-302ef25e-71b7-405a-8ae5-6b34b58de45f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:15.751064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-302ef25e-71b7-405a-8ae5-6b34b58de45f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:15.751512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-302ef25e-71b7-405a-8ae5-6b34b58de45f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:15.752282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-302ef25e-71b7-405a-8ae5-6b34b58de45f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:15.752719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-302ef25e-71b7-405a-8ae5-6b34b58de45f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:15.781599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-302ef25e-71b7-405a-8ae5-6b34b58de45f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041488 Sep 14 19:47:15.782216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 457/898] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:15 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:15.910408 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3bfe29a0-776a-411e-8744-386c8a4a3bde tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:15.911098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3bfe29a0-776a-411e-8744-386c8a4a3bde tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:15.917890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3bfe29a0-776a-411e-8744-386c8a4a3bde tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:15.918343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3bfe29a0-776a-411e-8744-386c8a4a3bde tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:15.919120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3bfe29a0-776a-411e-8744-386c8a4a3bde tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:15.919551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3bfe29a0-776a-411e-8744-386c8a4a3bde tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:16.032306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3d1d9425-d368-4dee-89ac-52e529e28380 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:16.033218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3d1d9425-d368-4dee-89ac-52e529e28380 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:16.039220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d1d9425-d368-4dee-89ac-52e529e28380 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:16.039675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d1d9425-d368-4dee-89ac-52e529e28380 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:16.040461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d1d9425-d368-4dee-89ac-52e529e28380 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:16.040788 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3bfe29a0-776a-411e-8744-386c8a4a3bde tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:16.041470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d1d9425-d368-4dee-89ac-52e529e28380 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:16.049319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3bfe29a0-776a-411e-8744-386c8a4a3bde tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142894 Sep 14 19:47:16.050134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 442/899] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:15 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:16.071181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3d1d9425-d368-4dee-89ac-52e529e28380 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042598 Sep 14 19:47:16.071726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 458/900] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:16 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:16.533411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-451cead7-cfaa-4f9d-a1ce-145701df72ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:16.534458 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-451cead7-cfaa-4f9d-a1ce-145701df72ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:16.540585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-451cead7-cfaa-4f9d-a1ce-145701df72ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:16.540963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-451cead7-cfaa-4f9d-a1ce-145701df72ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:16.541771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-451cead7-cfaa-4f9d-a1ce-145701df72ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:16.542784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-451cead7-cfaa-4f9d-a1ce-145701df72ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:16.570950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-451cead7-cfaa-4f9d-a1ce-145701df72ca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041322 Sep 14 19:47:16.571504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 443/901] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:16 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:16.792832 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-72c059af-5a92-4549-a948-51f1e0501bf9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:16.793708 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-72c059af-5a92-4549-a948-51f1e0501bf9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:16.799823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72c059af-5a92-4549-a948-51f1e0501bf9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:16.800264 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72c059af-5a92-4549-a948-51f1e0501bf9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:16.801028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72c059af-5a92-4549-a948-51f1e0501bf9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:16.801458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72c059af-5a92-4549-a948-51f1e0501bf9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:16.829116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-72c059af-5a92-4549-a948-51f1e0501bf9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040736 Sep 14 19:47:16.829685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 459/902] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:16 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:17.066353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eb4f5632-2507-485f-8e0b-0df7f3c55c77 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:17.066982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eb4f5632-2507-485f-8e0b-0df7f3c55c77 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:17.072778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb4f5632-2507-485f-8e0b-0df7f3c55c77 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:17.073786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb4f5632-2507-485f-8e0b-0df7f3c55c77 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:17.074562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb4f5632-2507-485f-8e0b-0df7f3c55c77 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:17.075002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb4f5632-2507-485f-8e0b-0df7f3c55c77 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:17.082353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-747fa311-8aea-40e9-a0b9-eb81c5fd73f3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:17.083260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-747fa311-8aea-40e9-a0b9-eb81c5fd73f3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:17.089713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-747fa311-8aea-40e9-a0b9-eb81c5fd73f3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:17.090166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-747fa311-8aea-40e9-a0b9-eb81c5fd73f3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:17.090941 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-747fa311-8aea-40e9-a0b9-eb81c5fd73f3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:17.091381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-747fa311-8aea-40e9-a0b9-eb81c5fd73f3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:17.119857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-747fa311-8aea-40e9-a0b9-eb81c5fd73f3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041086 Sep 14 19:47:17.120766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 460/903] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:17 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:17.205481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eb4f5632-2507-485f-8e0b-0df7f3c55c77 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:17.212880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eb4f5632-2507-485f-8e0b-0df7f3c55c77 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.150423 Sep 14 19:47:17.213446 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 444/904] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:17 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:17.582414 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d564084d-8b0c-493a-8cdb-494383973c44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:17.583305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d564084d-8b0c-493a-8cdb-494383973c44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:17.589058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d564084d-8b0c-493a-8cdb-494383973c44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:17.589514 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d564084d-8b0c-493a-8cdb-494383973c44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:17.590925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d564084d-8b0c-493a-8cdb-494383973c44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:17.591355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d564084d-8b0c-493a-8cdb-494383973c44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:17.618970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d564084d-8b0c-493a-8cdb-494383973c44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040318 Sep 14 19:47:17.619511 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 461/905] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:17 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:17.840120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4bce20c9-2c08-423f-9066-eb86b0a31d0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:17.841032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4bce20c9-2c08-423f-9066-eb86b0a31d0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:17.847018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4bce20c9-2c08-423f-9066-eb86b0a31d0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:17.847366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4bce20c9-2c08-423f-9066-eb86b0a31d0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:17.848131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4bce20c9-2c08-423f-9066-eb86b0a31d0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:17.848563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4bce20c9-2c08-423f-9066-eb86b0a31d0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:17.876898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4bce20c9-2c08-423f-9066-eb86b0a31d0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040519 Sep 14 19:47:17.877448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 445/906] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:17 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:18.131974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bc16a858-7e9c-4ac8-936c-75761f9da8f5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:18.132882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bc16a858-7e9c-4ac8-936c-75761f9da8f5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:18.138816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc16a858-7e9c-4ac8-936c-75761f9da8f5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:18.139265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc16a858-7e9c-4ac8-936c-75761f9da8f5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:18.140038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc16a858-7e9c-4ac8-936c-75761f9da8f5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:18.140473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc16a858-7e9c-4ac8-936c-75761f9da8f5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:18.169078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bc16a858-7e9c-4ac8-936c-75761f9da8f5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040834 Sep 14 19:47:18.169645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 462/907] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:18 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:18.230357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0d0d7d63-309f-4312-86ff-6ee54a234e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:18.231507 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0d0d7d63-309f-4312-86ff-6ee54a234e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:18.237510 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d0d7d63-309f-4312-86ff-6ee54a234e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:18.237986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d0d7d63-309f-4312-86ff-6ee54a234e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:18.238753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d0d7d63-309f-4312-86ff-6ee54a234e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:18.239191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d0d7d63-309f-4312-86ff-6ee54a234e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:18.358528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0d0d7d63-309f-4312-86ff-6ee54a234e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:18.365735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0d0d7d63-309f-4312-86ff-6ee54a234e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.139193 Sep 14 19:47:18.366303 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 446/908] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:18 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:18.629691 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ab594a9c-f789-4ee1-a8a3-e60354653241 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:18.630586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ab594a9c-f789-4ee1-a8a3-e60354653241 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:18.636376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab594a9c-f789-4ee1-a8a3-e60354653241 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:18.636851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab594a9c-f789-4ee1-a8a3-e60354653241 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:18.637649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab594a9c-f789-4ee1-a8a3-e60354653241 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:18.638072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ab594a9c-f789-4ee1-a8a3-e60354653241 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:18.667884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ab594a9c-f789-4ee1-a8a3-e60354653241 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042003 Sep 14 19:47:18.668995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 463/909] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:18 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:18.888832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-26223e65-faba-48ae-9f59-1d3897a4cfd7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:18.889772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-26223e65-faba-48ae-9f59-1d3897a4cfd7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:18.895583 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26223e65-faba-48ae-9f59-1d3897a4cfd7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:18.896033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26223e65-faba-48ae-9f59-1d3897a4cfd7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:18.896799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26223e65-faba-48ae-9f59-1d3897a4cfd7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:18.897262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26223e65-faba-48ae-9f59-1d3897a4cfd7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:18.925290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-26223e65-faba-48ae-9f59-1d3897a4cfd7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040943 Sep 14 19:47:18.925868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 447/910] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:18 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:19.180599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b9deed1a-a2fb-4409-84b1-1bf387b841e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:19.181617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b9deed1a-a2fb-4409-84b1-1bf387b841e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:19.187410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9deed1a-a2fb-4409-84b1-1bf387b841e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:19.187861 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9deed1a-a2fb-4409-84b1-1bf387b841e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:19.188629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9deed1a-a2fb-4409-84b1-1bf387b841e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:19.189065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9deed1a-a2fb-4409-84b1-1bf387b841e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:19.218391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b9deed1a-a2fb-4409-84b1-1bf387b841e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041553 Sep 14 19:47:19.218936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 464/911] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:19 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:19.383840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f4ea2c8d-7baf-486c-bbf5-73a6adb0085b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:19.384455 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f4ea2c8d-7baf-486c-bbf5-73a6adb0085b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:19.391103 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f4ea2c8d-7baf-486c-bbf5-73a6adb0085b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:19.391544 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f4ea2c8d-7baf-486c-bbf5-73a6adb0085b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:19.392304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f4ea2c8d-7baf-486c-bbf5-73a6adb0085b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:19.392735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f4ea2c8d-7baf-486c-bbf5-73a6adb0085b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:19.510942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f4ea2c8d-7baf-486c-bbf5-73a6adb0085b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:19.518847 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f4ea2c8d-7baf-486c-bbf5-73a6adb0085b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138662 Sep 14 19:47:19.519416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 448/912] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:19 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:19.680240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d1a6e2d9-8fe4-4dd0-9131-e6fd6c84e815 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:19.681127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d1a6e2d9-8fe4-4dd0-9131-e6fd6c84e815 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:19.687374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d1a6e2d9-8fe4-4dd0-9131-e6fd6c84e815 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:19.687816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d1a6e2d9-8fe4-4dd0-9131-e6fd6c84e815 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:19.688573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d1a6e2d9-8fe4-4dd0-9131-e6fd6c84e815 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:19.689003 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d1a6e2d9-8fe4-4dd0-9131-e6fd6c84e815 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:19.719401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d1a6e2d9-8fe4-4dd0-9131-e6fd6c84e815 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042103 Sep 14 19:47:19.719401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 465/913] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:19.937278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d062f973-2cec-4f25-8a8a-3f4173f8c11a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:19.938322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d062f973-2cec-4f25-8a8a-3f4173f8c11a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:19.944093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d062f973-2cec-4f25-8a8a-3f4173f8c11a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:19.944536 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d062f973-2cec-4f25-8a8a-3f4173f8c11a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:19.945297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d062f973-2cec-4f25-8a8a-3f4173f8c11a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:19.945753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d062f973-2cec-4f25-8a8a-3f4173f8c11a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:19.973965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d062f973-2cec-4f25-8a8a-3f4173f8c11a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041015 Sep 14 19:47:19.974450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 449/914] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:20.230154 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5f5ed1b2-927f-49d3-87dd-3346830b0f47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:20.231033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5f5ed1b2-927f-49d3-87dd-3346830b0f47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:20.237033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f5ed1b2-927f-49d3-87dd-3346830b0f47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:20.237480 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f5ed1b2-927f-49d3-87dd-3346830b0f47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:20.238278 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f5ed1b2-927f-49d3-87dd-3346830b0f47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:20.238745 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f5ed1b2-927f-49d3-87dd-3346830b0f47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:20.268770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5f5ed1b2-927f-49d3-87dd-3346830b0f47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042496 Sep 14 19:47:20.269339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 466/915] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:20 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:20.536252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e56528a6-6a21-4fa2-8fa7-6127cc0318ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:20.536857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e56528a6-6a21-4fa2-8fa7-6127cc0318ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:20.542989 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e56528a6-6a21-4fa2-8fa7-6127cc0318ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:20.543447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e56528a6-6a21-4fa2-8fa7-6127cc0318ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:20.544233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e56528a6-6a21-4fa2-8fa7-6127cc0318ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:20.544665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e56528a6-6a21-4fa2-8fa7-6127cc0318ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:20.667510 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e56528a6-6a21-4fa2-8fa7-6127cc0318ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:20.675120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e56528a6-6a21-4fa2-8fa7-6127cc0318ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142601 Sep 14 19:47:20.675702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 450/916] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:20 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:20.730115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c343439b-c939-4894-b8c8-6f49c4394433 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:20.731588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c343439b-c939-4894-b8c8-6f49c4394433 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:20.737299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c343439b-c939-4894-b8c8-6f49c4394433 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:20.737785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c343439b-c939-4894-b8c8-6f49c4394433 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:20.738559 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c343439b-c939-4894-b8c8-6f49c4394433 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:20.738994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c343439b-c939-4894-b8c8-6f49c4394433 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:20.766945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c343439b-c939-4894-b8c8-6f49c4394433 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040529 Sep 14 19:47:20.767544 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 467/917] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:20.984907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c94a6b0f-2560-4ed7-87f3-f596683a8fab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:20.985828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c94a6b0f-2560-4ed7-87f3-f596683a8fab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:20.991686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c94a6b0f-2560-4ed7-87f3-f596683a8fab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:20.992129 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c94a6b0f-2560-4ed7-87f3-f596683a8fab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:20.992883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c94a6b0f-2560-4ed7-87f3-f596683a8fab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:20.993314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c94a6b0f-2560-4ed7-87f3-f596683a8fab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:21.022109 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c94a6b0f-2560-4ed7-87f3-f596683a8fab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040980 Sep 14 19:47:21.022664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 451/918] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:20 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:21.281351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3c60a878-1c24-4a21-94e3-0c12bfab1034 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:21.282324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3c60a878-1c24-4a21-94e3-0c12bfab1034 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:21.288254 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c60a878-1c24-4a21-94e3-0c12bfab1034 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:21.288701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c60a878-1c24-4a21-94e3-0c12bfab1034 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:21.289476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c60a878-1c24-4a21-94e3-0c12bfab1034 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:21.289938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c60a878-1c24-4a21-94e3-0c12bfab1034 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:21.319890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3c60a878-1c24-4a21-94e3-0c12bfab1034 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042795 Sep 14 19:47:21.320461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 468/919] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:21 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:21.692627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bd1d05f5-49bd-483a-9e13-9cbdc24c1ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:21.693235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bd1d05f5-49bd-483a-9e13-9cbdc24c1ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:21.699028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd1d05f5-49bd-483a-9e13-9cbdc24c1ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:21.700219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd1d05f5-49bd-483a-9e13-9cbdc24c1ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:21.700984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd1d05f5-49bd-483a-9e13-9cbdc24c1ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:21.701416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd1d05f5-49bd-483a-9e13-9cbdc24c1ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:21.779072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8a2519a8-5921-4c9d-9ae6-6b990601f9ce tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:21.779332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8a2519a8-5921-4c9d-9ae6-6b990601f9ce tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:21.785112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a2519a8-5921-4c9d-9ae6-6b990601f9ce tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:21.785595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a2519a8-5921-4c9d-9ae6-6b990601f9ce tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:21.786372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a2519a8-5921-4c9d-9ae6-6b990601f9ce tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:21.786807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a2519a8-5921-4c9d-9ae6-6b990601f9ce tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:21.818447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8a2519a8-5921-4c9d-9ae6-6b990601f9ce tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043711 Sep 14 19:47:21.819218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 469/920] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:21 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:47:21.822243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bd1d05f5-49bd-483a-9e13-9cbdc24c1ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:21.830046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bd1d05f5-49bd-483a-9e13-9cbdc24c1ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.141047 Sep 14 19:47:21.830619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 452/921] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:21 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:22.033717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fe5724fc-4ca8-4974-8d13-34885e1b55cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:22.034621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fe5724fc-4ca8-4974-8d13-34885e1b55cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:22.040454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fe5724fc-4ca8-4974-8d13-34885e1b55cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:22.040901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fe5724fc-4ca8-4974-8d13-34885e1b55cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:22.041741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fe5724fc-4ca8-4974-8d13-34885e1b55cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:22.042184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fe5724fc-4ca8-4974-8d13-34885e1b55cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:22.071824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fe5724fc-4ca8-4974-8d13-34885e1b55cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042096 Sep 14 19:47:22.072372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 470/922] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:22 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:22.331330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cbe4bfa1-7146-431e-a889-4d7d64c044be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:22.332235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cbe4bfa1-7146-431e-a889-4d7d64c044be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:22.338065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbe4bfa1-7146-431e-a889-4d7d64c044be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:22.338514 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbe4bfa1-7146-431e-a889-4d7d64c044be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:22.339280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbe4bfa1-7146-431e-a889-4d7d64c044be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:22.340289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbe4bfa1-7146-431e-a889-4d7d64c044be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:22.368750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cbe4bfa1-7146-431e-a889-4d7d64c044be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 Sep 14 19:47:22.369300 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 453/923] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:22 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:22.829374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0d92bf22-1cf6-4df3-bb5d-179e1db2c918 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:22.830306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0d92bf22-1cf6-4df3-bb5d-179e1db2c918 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:22.836309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d92bf22-1cf6-4df3-bb5d-179e1db2c918 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:22.836832 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d92bf22-1cf6-4df3-bb5d-179e1db2c918 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:22.837638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d92bf22-1cf6-4df3-bb5d-179e1db2c918 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:22.838079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d92bf22-1cf6-4df3-bb5d-179e1db2c918 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:22.847328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-88ebb1b1-4896-4f83-8d03-518d38d40958 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:22.847991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-88ebb1b1-4896-4f83-8d03-518d38d40958 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:22.853809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-88ebb1b1-4896-4f83-8d03-518d38d40958 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:22.854257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-88ebb1b1-4896-4f83-8d03-518d38d40958 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:22.855025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-88ebb1b1-4896-4f83-8d03-518d38d40958 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:22.855951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-88ebb1b1-4896-4f83-8d03-518d38d40958 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:22.868746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0d92bf22-1cf6-4df3-bb5d-179e1db2c918 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043182 Sep 14 19:47:22.873272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 471/924] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:22 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:22.979580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-88ebb1b1-4896-4f83-8d03-518d38d40958 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:22.987562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-88ebb1b1-4896-4f83-8d03-518d38d40958 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.144018 Sep 14 19:47:22.988139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 454/925] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:22 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:23.083349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-182e7aec-d4eb-4d73-8254-d874713dff39 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:23.084269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-182e7aec-d4eb-4d73-8254-d874713dff39 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:23.090617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-182e7aec-d4eb-4d73-8254-d874713dff39 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:23.091062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-182e7aec-d4eb-4d73-8254-d874713dff39 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:23.091824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-182e7aec-d4eb-4d73-8254-d874713dff39 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:23.092264 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-182e7aec-d4eb-4d73-8254-d874713dff39 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:23.121410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-182e7aec-d4eb-4d73-8254-d874713dff39 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041917 Sep 14 19:47:23.121982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 472/926] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:23 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:23.380163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a549b024-5e3c-46c5-8d4f-953f125f6890 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:23.381058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a549b024-5e3c-46c5-8d4f-953f125f6890 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:23.387383 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a549b024-5e3c-46c5-8d4f-953f125f6890 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:23.387824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a549b024-5e3c-46c5-8d4f-953f125f6890 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:23.388579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a549b024-5e3c-46c5-8d4f-953f125f6890 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:23.389005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a549b024-5e3c-46c5-8d4f-953f125f6890 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:23.417059 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a549b024-5e3c-46c5-8d4f-953f125f6890 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040703 Sep 14 19:47:23.417616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 455/927] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:23 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:23.880878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fb573f9f-9224-43d3-aebf-47d75170637c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:23.881801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fb573f9f-9224-43d3-aebf-47d75170637c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:23.888215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb573f9f-9224-43d3-aebf-47d75170637c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:23.888682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb573f9f-9224-43d3-aebf-47d75170637c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:23.889437 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb573f9f-9224-43d3-aebf-47d75170637c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:23.889899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb573f9f-9224-43d3-aebf-47d75170637c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:23.917272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fb573f9f-9224-43d3-aebf-47d75170637c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040197 Sep 14 19:47:23.917841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 473/928] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:24.004918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-173c9176-317e-4df8-9f92-4d60e2a7b00b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:24.005523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-173c9176-317e-4df8-9f92-4d60e2a7b00b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:24.012580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-173c9176-317e-4df8-9f92-4d60e2a7b00b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:24.012580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-173c9176-317e-4df8-9f92-4d60e2a7b00b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:24.013122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-173c9176-317e-4df8-9f92-4d60e2a7b00b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:24.013585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-173c9176-317e-4df8-9f92-4d60e2a7b00b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:24.134915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-98383de7-ecb5-46cc-b579-205d4eb7fc19 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:24.135827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-98383de7-ecb5-46cc-b579-205d4eb7fc19 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:24.141607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98383de7-ecb5-46cc-b579-205d4eb7fc19 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:24.141992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-173c9176-317e-4df8-9f92-4d60e2a7b00b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:24.142178 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98383de7-ecb5-46cc-b579-205d4eb7fc19 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:24.142806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98383de7-ecb5-46cc-b579-205d4eb7fc19 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:24.143232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98383de7-ecb5-46cc-b579-205d4eb7fc19 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:24.149652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-173c9176-317e-4df8-9f92-4d60e2a7b00b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.148435 Sep 14 19:47:24.150234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 456/929] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:24 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:24.172103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-98383de7-ecb5-46cc-b579-205d4eb7fc19 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 Sep 14 19:47:24.172905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 474/930] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:24 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:24.428658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-589184a8-ef82-4826-b7e5-6361f97ccbb2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:24.429593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-589184a8-ef82-4826-b7e5-6361f97ccbb2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:24.436299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-589184a8-ef82-4826-b7e5-6361f97ccbb2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:24.436745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-589184a8-ef82-4826-b7e5-6361f97ccbb2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:24.437553 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-589184a8-ef82-4826-b7e5-6361f97ccbb2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:24.437987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-589184a8-ef82-4826-b7e5-6361f97ccbb2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:24.466697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-589184a8-ef82-4826-b7e5-6361f97ccbb2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041769 Sep 14 19:47:24.470123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 457/931] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:24 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:24.928433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-da903850-94fb-4e74-babe-aeb2cc5b9817 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:24.929345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-da903850-94fb-4e74-babe-aeb2cc5b9817 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:24.935156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da903850-94fb-4e74-babe-aeb2cc5b9817 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:24.935608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da903850-94fb-4e74-babe-aeb2cc5b9817 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:24.936377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da903850-94fb-4e74-babe-aeb2cc5b9817 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:24.936813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da903850-94fb-4e74-babe-aeb2cc5b9817 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:24.966136 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-da903850-94fb-4e74-babe-aeb2cc5b9817 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041485 Sep 14 19:47:24.966695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 475/932] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:25.166831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-784e9a5c-b92a-47e1-ae5d-4f67fca2fa2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:25.167440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-784e9a5c-b92a-47e1-ae5d-4f67fca2fa2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:25.173736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-784e9a5c-b92a-47e1-ae5d-4f67fca2fa2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:25.174183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-784e9a5c-b92a-47e1-ae5d-4f67fca2fa2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:25.175001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-784e9a5c-b92a-47e1-ae5d-4f67fca2fa2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:25.175438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-784e9a5c-b92a-47e1-ae5d-4f67fca2fa2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:25.184020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-874be33c-337b-4bdd-a16a-e3de4f245acb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:25.185066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-874be33c-337b-4bdd-a16a-e3de4f245acb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:25.190906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-874be33c-337b-4bdd-a16a-e3de4f245acb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:25.191352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-874be33c-337b-4bdd-a16a-e3de4f245acb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:25.192126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-874be33c-337b-4bdd-a16a-e3de4f245acb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:25.192556 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-874be33c-337b-4bdd-a16a-e3de4f245acb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:25.222274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-874be33c-337b-4bdd-a16a-e3de4f245acb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042377 Sep 14 19:47:25.222848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 476/933] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:25 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:25.294761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-784e9a5c-b92a-47e1-ae5d-4f67fca2fa2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:25.302385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-784e9a5c-b92a-47e1-ae5d-4f67fca2fa2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.139205 Sep 14 19:47:25.302948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 458/934] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:25 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:25.477132 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 19:47:25.480542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0f8a0e72-376c-4054-8445-4180e0de0d64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:25.481721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0f8a0e72-376c-4054-8445-4180e0de0d64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:25.487611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f8a0e72-376c-4054-8445-4180e0de0d64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:25.488054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f8a0e72-376c-4054-8445-4180e0de0d64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:25.488809 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f8a0e72-376c-4054-8445-4180e0de0d64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:25.489240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f8a0e72-376c-4054-8445-4180e0de0d64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:25.518693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0f8a0e72-376c-4054-8445-4180e0de0d64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042925 Sep 14 19:47:25.519377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 477/935] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:25 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:25.978041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-aeef9e34-722f-40a4-96d3-6e7ba26787c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:25.978933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-aeef9e34-722f-40a4-96d3-6e7ba26787c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:25.985309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aeef9e34-722f-40a4-96d3-6e7ba26787c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:25.985773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aeef9e34-722f-40a4-96d3-6e7ba26787c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:25.986567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aeef9e34-722f-40a4-96d3-6e7ba26787c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:25.986997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aeef9e34-722f-40a4-96d3-6e7ba26787c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:26.015470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-aeef9e34-722f-40a4-96d3-6e7ba26787c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041188 Sep 14 19:47:26.020351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 459/936] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:26.234304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-70c9472d-b46b-4d40-8f39-e0bb90fd76c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:26.235237 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-70c9472d-b46b-4d40-8f39-e0bb90fd76c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:26.241184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70c9472d-b46b-4d40-8f39-e0bb90fd76c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:26.241658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70c9472d-b46b-4d40-8f39-e0bb90fd76c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:26.242435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70c9472d-b46b-4d40-8f39-e0bb90fd76c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:26.242870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70c9472d-b46b-4d40-8f39-e0bb90fd76c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:26.272731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-70c9472d-b46b-4d40-8f39-e0bb90fd76c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042851 Sep 14 19:47:26.273312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 478/937] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:26 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:26.317383 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 19:47:26.320664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3e6f0214-5b87-42f3-8dc0-3c5c813ff544 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:26.321263 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3e6f0214-5b87-42f3-8dc0-3c5c813ff544 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:26.327701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e6f0214-5b87-42f3-8dc0-3c5c813ff544 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:26.328146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e6f0214-5b87-42f3-8dc0-3c5c813ff544 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:26.328910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e6f0214-5b87-42f3-8dc0-3c5c813ff544 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:26.329347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e6f0214-5b87-42f3-8dc0-3c5c813ff544 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:26.444894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3e6f0214-5b87-42f3-8dc0-3c5c813ff544 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:26.453014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3e6f0214-5b87-42f3-8dc0-3c5c813ff544 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.137087 Sep 14 19:47:26.453606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 460/938] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:26 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:26.529868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-307d55c8-ed8a-4353-afc4-ecc7bcbb65c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:26.530694 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-307d55c8-ed8a-4353-afc4-ecc7bcbb65c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:26.546415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-307d55c8-ed8a-4353-afc4-ecc7bcbb65c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:26.546857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-307d55c8-ed8a-4353-afc4-ecc7bcbb65c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:26.547877 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-307d55c8-ed8a-4353-afc4-ecc7bcbb65c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:26.548299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-307d55c8-ed8a-4353-afc4-ecc7bcbb65c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:26.563036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 53738. Sep 14 19:47:26.578491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-307d55c8-ed8a-4353-afc4-ecc7bcbb65c9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053131 Sep 14 19:47:26.579042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 479/939] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:26 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:27.026526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-57ca7571-0b9a-420f-8f98-c323744086fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:27.027465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-57ca7571-0b9a-420f-8f98-c323744086fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:27.033216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57ca7571-0b9a-420f-8f98-c323744086fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:27.033693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57ca7571-0b9a-420f-8f98-c323744086fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:27.034441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57ca7571-0b9a-420f-8f98-c323744086fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:27.034864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57ca7571-0b9a-420f-8f98-c323744086fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:27.063992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-57ca7571-0b9a-420f-8f98-c323744086fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041309 Sep 14 19:47:27.064532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 461/940] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:27 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:27.284397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9e9dac69-6824-4a27-a04a-a7f66582d18b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:27.285311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9e9dac69-6824-4a27-a04a-a7f66582d18b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:27.291316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e9dac69-6824-4a27-a04a-a7f66582d18b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:27.291769 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e9dac69-6824-4a27-a04a-a7f66582d18b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:27.292551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e9dac69-6824-4a27-a04a-a7f66582d18b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:27.293485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e9dac69-6824-4a27-a04a-a7f66582d18b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:27.322965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9e9dac69-6824-4a27-a04a-a7f66582d18b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042388 Sep 14 19:47:27.323555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 480/941] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:27 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:27.469802 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d0c41922-121e-48b3-9bfe-c54f8cad956d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:27.470413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d0c41922-121e-48b3-9bfe-c54f8cad956d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:27.487580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d0c41922-121e-48b3-9bfe-c54f8cad956d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:27.488031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d0c41922-121e-48b3-9bfe-c54f8cad956d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:27.488817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d0c41922-121e-48b3-9bfe-c54f8cad956d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:27.489253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d0c41922-121e-48b3-9bfe-c54f8cad956d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:27.495189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 53746. Sep 14 19:47:27.590312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ef94d6f6-c0c3-42b9-8da8-f75e1073b578 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:27.591249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ef94d6f6-c0c3-42b9-8da8-f75e1073b578 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:27.596977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ef94d6f6-c0c3-42b9-8da8-f75e1073b578 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:27.597422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ef94d6f6-c0c3-42b9-8da8-f75e1073b578 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:27.598226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ef94d6f6-c0c3-42b9-8da8-f75e1073b578 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:27.598652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ef94d6f6-c0c3-42b9-8da8-f75e1073b578 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:27.615941 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d0c41922-121e-48b3-9bfe-c54f8cad956d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:27.623810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d0c41922-121e-48b3-9bfe-c54f8cad956d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.157733 Sep 14 19:47:27.624511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 462/942] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:27 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:27.628802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ef94d6f6-c0c3-42b9-8da8-f75e1073b578 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042825 Sep 14 19:47:27.629354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 481/943] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:27 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:28.076223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d164699a-d299-42b8-86c0-c87afa9a2b5f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:28.077233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d164699a-d299-42b8-86c0-c87afa9a2b5f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:28.083596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d164699a-d299-42b8-86c0-c87afa9a2b5f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:28.084125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d164699a-d299-42b8-86c0-c87afa9a2b5f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:28.084983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d164699a-d299-42b8-86c0-c87afa9a2b5f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:28.085481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d164699a-d299-42b8-86c0-c87afa9a2b5f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:28.115196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d164699a-d299-42b8-86c0-c87afa9a2b5f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043247 Sep 14 19:47:28.116180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 463/944] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:28 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:28.334412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e623dab2-fa4a-4696-ba1f-00c6627665f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:28.335348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e623dab2-fa4a-4696-ba1f-00c6627665f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:28.341330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e623dab2-fa4a-4696-ba1f-00c6627665f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:28.341814 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e623dab2-fa4a-4696-ba1f-00c6627665f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:28.342580 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e623dab2-fa4a-4696-ba1f-00c6627665f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:28.343015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e623dab2-fa4a-4696-ba1f-00c6627665f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:28.372631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e623dab2-fa4a-4696-ba1f-00c6627665f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041865 Sep 14 19:47:28.373103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 482/945] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:28 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:28.640196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a339d45a-c9db-406e-9028-85b62af48137 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:28.640714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4610e53f-0b3a-4c29-a1e0-b29fa0027f82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:28.641012 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a339d45a-c9db-406e-9028-85b62af48137 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:28.641122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4610e53f-0b3a-4c29-a1e0-b29fa0027f82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:28.647493 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4610e53f-0b3a-4c29-a1e0-b29fa0027f82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:28.647734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a339d45a-c9db-406e-9028-85b62af48137 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:28.647939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4610e53f-0b3a-4c29-a1e0-b29fa0027f82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:28.648211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a339d45a-c9db-406e-9028-85b62af48137 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:28.648712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4610e53f-0b3a-4c29-a1e0-b29fa0027f82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:28.648978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a339d45a-c9db-406e-9028-85b62af48137 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:28.649142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4610e53f-0b3a-4c29-a1e0-b29fa0027f82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:28.649412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a339d45a-c9db-406e-9028-85b62af48137 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:28.679251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a339d45a-c9db-406e-9028-85b62af48137 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042944 Sep 14 19:47:28.679934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 464/946] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:28 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:28.771763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4610e53f-0b3a-4c29-a1e0-b29fa0027f82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:28.779024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4610e53f-0b3a-4c29-a1e0-b29fa0027f82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142218 Sep 14 19:47:28.779580 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 483/947] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:28 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:47:29.130275 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-85797ce7-84e3-4c2f-bd56-68c60d940314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:29.131175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-85797ce7-84e3-4c2f-bd56-68c60d940314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:29.137010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85797ce7-84e3-4c2f-bd56-68c60d940314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:29.137454 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85797ce7-84e3-4c2f-bd56-68c60d940314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:29.138248 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85797ce7-84e3-4c2f-bd56-68c60d940314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:29.138679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85797ce7-84e3-4c2f-bd56-68c60d940314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:29.167332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-85797ce7-84e3-4c2f-bd56-68c60d940314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040900 Sep 14 19:47:29.168461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 465/948] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:29 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:29.384676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-898730d0-2e49-41b2-9aee-d724b8f38a88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:29.385525 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-898730d0-2e49-41b2-9aee-d724b8f38a88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:29.391856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-898730d0-2e49-41b2-9aee-d724b8f38a88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:29.392304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-898730d0-2e49-41b2-9aee-d724b8f38a88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:29.393077 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-898730d0-2e49-41b2-9aee-d724b8f38a88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:29.393537 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-898730d0-2e49-41b2-9aee-d724b8f38a88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:29.422469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-898730d0-2e49-41b2-9aee-d724b8f38a88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 Sep 14 19:47:29.423028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 484/949] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:29 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:29.695834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7ca59379-fc54-4466-b17c-8e506d88c46b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:29.696654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7ca59379-fc54-4466-b17c-8e506d88c46b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:29.702966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ca59379-fc54-4466-b17c-8e506d88c46b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:29.703422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ca59379-fc54-4466-b17c-8e506d88c46b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:29.704192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ca59379-fc54-4466-b17c-8e506d88c46b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:29.704631 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ca59379-fc54-4466-b17c-8e506d88c46b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:29.733804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7ca59379-fc54-4466-b17c-8e506d88c46b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041807 Sep 14 19:47:29.734390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 466/950] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:29 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:29.794881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fdd3271f-6075-4e37-8fd4-f52168c95ab4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:29.795495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fdd3271f-6075-4e37-8fd4-f52168c95ab4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:29.801759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdd3271f-6075-4e37-8fd4-f52168c95ab4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:29.802217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdd3271f-6075-4e37-8fd4-f52168c95ab4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:29.802993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdd3271f-6075-4e37-8fd4-f52168c95ab4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:29.803433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdd3271f-6075-4e37-8fd4-f52168c95ab4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:29.920846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-fdd3271f-6075-4e37-8fd4-f52168c95ab4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:29.928491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fdd3271f-6075-4e37-8fd4-f52168c95ab4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.137306 Sep 14 19:47:29.929088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 485/951] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:29 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:30.178868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f47e9743-3ac2-4f40-b4a7-c4942f4f37e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:30.179813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f47e9743-3ac2-4f40-b4a7-c4942f4f37e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:30.186451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f47e9743-3ac2-4f40-b4a7-c4942f4f37e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:30.187079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f47e9743-3ac2-4f40-b4a7-c4942f4f37e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:30.187839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f47e9743-3ac2-4f40-b4a7-c4942f4f37e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:30.188266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f47e9743-3ac2-4f40-b4a7-c4942f4f37e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:30.221004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f47e9743-3ac2-4f40-b4a7-c4942f4f37e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045861 Sep 14 19:47:30.221623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 467/952] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:30 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:30.433907 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-41d69f09-ea63-4869-8db2-ff6ea6da872b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:30.434732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-41d69f09-ea63-4869-8db2-ff6ea6da872b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:30.440575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41d69f09-ea63-4869-8db2-ff6ea6da872b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:30.441061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41d69f09-ea63-4869-8db2-ff6ea6da872b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:30.441866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41d69f09-ea63-4869-8db2-ff6ea6da872b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:30.442321 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41d69f09-ea63-4869-8db2-ff6ea6da872b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:30.470976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-41d69f09-ea63-4869-8db2-ff6ea6da872b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040925 Sep 14 19:47:30.478852 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 486/953] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:30 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:30.745039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a0383355-0913-4c58-8c8b-aac732319879 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:30.745882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a0383355-0913-4c58-8c8b-aac732319879 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:30.751699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a0383355-0913-4c58-8c8b-aac732319879 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:30.752141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a0383355-0913-4c58-8c8b-aac732319879 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:30.752903 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a0383355-0913-4c58-8c8b-aac732319879 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:30.753348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a0383355-0913-4c58-8c8b-aac732319879 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:30.782317 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a0383355-0913-4c58-8c8b-aac732319879 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041067 Sep 14 19:47:30.782874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 468/954] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:30 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:30.945659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5eb236a8-ab3c-48d4-a362-887352101deb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:30.946268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5eb236a8-ab3c-48d4-a362-887352101deb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:30.952686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5eb236a8-ab3c-48d4-a362-887352101deb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:30.953139 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5eb236a8-ab3c-48d4-a362-887352101deb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:30.953948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5eb236a8-ab3c-48d4-a362-887352101deb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:30.954390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5eb236a8-ab3c-48d4-a362-887352101deb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:31.075422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5eb236a8-ab3c-48d4-a362-887352101deb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:31.082906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5eb236a8-ab3c-48d4-a362-887352101deb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140849 Sep 14 19:47:31.083472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 487/955] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:30 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:31.232775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fe55944c-9db8-4f1f-81f9-7e35ca1cbbef tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:31.233708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fe55944c-9db8-4f1f-81f9-7e35ca1cbbef tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:31.239622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe55944c-9db8-4f1f-81f9-7e35ca1cbbef tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:31.240180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe55944c-9db8-4f1f-81f9-7e35ca1cbbef tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:31.240865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe55944c-9db8-4f1f-81f9-7e35ca1cbbef tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:31.241308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fe55944c-9db8-4f1f-81f9-7e35ca1cbbef tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:31.271736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fe55944c-9db8-4f1f-81f9-7e35ca1cbbef tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042789 Sep 14 19:47:31.272399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 469/956] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:31 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:31.488380 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a6368781-f4d1-4722-90d3-c8a790c920b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:31.489320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a6368781-f4d1-4722-90d3-c8a790c920b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:31.495264 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6368781-f4d1-4722-90d3-c8a790c920b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:31.495971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6368781-f4d1-4722-90d3-c8a790c920b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:31.497454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6368781-f4d1-4722-90d3-c8a790c920b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:31.497916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6368781-f4d1-4722-90d3-c8a790c920b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:31.527537 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a6368781-f4d1-4722-90d3-c8a790c920b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042883 Sep 14 19:47:31.528100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 488/957] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:31 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:31.794353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bbae4c77-4274-4b94-a8f1-556c58f58e77 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:31.795173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bbae4c77-4274-4b94-a8f1-556c58f58e77 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:31.801387 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bbae4c77-4274-4b94-a8f1-556c58f58e77 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:31.801853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bbae4c77-4274-4b94-a8f1-556c58f58e77 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:31.802616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bbae4c77-4274-4b94-a8f1-556c58f58e77 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:31.803041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bbae4c77-4274-4b94-a8f1-556c58f58e77 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:31.832629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bbae4c77-4274-4b94-a8f1-556c58f58e77 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042563 Sep 14 19:47:31.833187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 470/958] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:31 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:32.100148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6251eb52-9c72-4b96-a676-2ce923af0e67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:32.100675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6251eb52-9c72-4b96-a676-2ce923af0e67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:32.108487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6251eb52-9c72-4b96-a676-2ce923af0e67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:32.108933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6251eb52-9c72-4b96-a676-2ce923af0e67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:32.109732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6251eb52-9c72-4b96-a676-2ce923af0e67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:32.110170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6251eb52-9c72-4b96-a676-2ce923af0e67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:32.231028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6251eb52-9c72-4b96-a676-2ce923af0e67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:32.241425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6251eb52-9c72-4b96-a676-2ce923af0e67 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.145521 Sep 14 19:47:32.242008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 489/959] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:32 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:32.284021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-695f9b84-f1ee-4d9e-a211-e8535a18e5e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:32.284923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-695f9b84-f1ee-4d9e-a211-e8535a18e5e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:32.290853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-695f9b84-f1ee-4d9e-a211-e8535a18e5e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:32.291304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-695f9b84-f1ee-4d9e-a211-e8535a18e5e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:32.292098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-695f9b84-f1ee-4d9e-a211-e8535a18e5e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:32.292536 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-695f9b84-f1ee-4d9e-a211-e8535a18e5e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:32.321884 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-695f9b84-f1ee-4d9e-a211-e8535a18e5e4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041596 Sep 14 19:47:32.322446 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 471/960] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:32 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:32.538938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b64ba827-0173-4887-bd78-dc46076cfead tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:32.539903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b64ba827-0173-4887-bd78-dc46076cfead tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:32.545854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b64ba827-0173-4887-bd78-dc46076cfead tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:32.546304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b64ba827-0173-4887-bd78-dc46076cfead tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:32.547085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b64ba827-0173-4887-bd78-dc46076cfead tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:32.547784 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b64ba827-0173-4887-bd78-dc46076cfead tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:32.576304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b64ba827-0173-4887-bd78-dc46076cfead tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041115 Sep 14 19:47:32.576847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 490/961] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:32 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:32.846046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-04f41857-106f-49db-b61d-3cc337909807 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:32.846046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-04f41857-106f-49db-b61d-3cc337909807 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:32.850461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-04f41857-106f-49db-b61d-3cc337909807 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:32.850907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-04f41857-106f-49db-b61d-3cc337909807 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:32.851705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-04f41857-106f-49db-b61d-3cc337909807 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:32.852142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-04f41857-106f-49db-b61d-3cc337909807 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:32.881416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-04f41857-106f-49db-b61d-3cc337909807 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041715 Sep 14 19:47:32.891220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 472/962] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:32 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:33.257543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-81e69283-9b43-4699-b258-893260e2b327 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:33.258154 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-81e69283-9b43-4699-b258-893260e2b327 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:33.264280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-81e69283-9b43-4699-b258-893260e2b327 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:33.264741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-81e69283-9b43-4699-b258-893260e2b327 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:33.265548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-81e69283-9b43-4699-b258-893260e2b327 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:33.265997 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-81e69283-9b43-4699-b258-893260e2b327 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:33.333902 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f0de09d7-cd4a-467a-ad0b-c89e5b345e34 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:33.334799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f0de09d7-cd4a-467a-ad0b-c89e5b345e34 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:33.340486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f0de09d7-cd4a-467a-ad0b-c89e5b345e34 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:33.340926 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f0de09d7-cd4a-467a-ad0b-c89e5b345e34 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:33.341719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f0de09d7-cd4a-467a-ad0b-c89e5b345e34 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:33.342153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f0de09d7-cd4a-467a-ad0b-c89e5b345e34 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:33.371198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f0de09d7-cd4a-467a-ad0b-c89e5b345e34 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041054 Sep 14 19:47:33.372789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 473/963] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:33 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:47:33.387224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-81e69283-9b43-4699-b258-893260e2b327 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:33.394510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-81e69283-9b43-4699-b258-893260e2b327 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140728 Sep 14 19:47:33.395070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 491/964] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:33 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:33.587105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bcc7d87d-f59d-4c33-b99b-58dd855d0897 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:33.587925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bcc7d87d-f59d-4c33-b99b-58dd855d0897 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:33.594204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcc7d87d-f59d-4c33-b99b-58dd855d0897 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:33.594647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcc7d87d-f59d-4c33-b99b-58dd855d0897 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:33.595404 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcc7d87d-f59d-4c33-b99b-58dd855d0897 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:33.595834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcc7d87d-f59d-4c33-b99b-58dd855d0897 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:33.624404 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bcc7d87d-f59d-4c33-b99b-58dd855d0897 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041213 Sep 14 19:47:33.624954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 474/965] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:33 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:33.893564 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3cc9b9a0-d095-4d4a-8d6a-6b07b1a2016a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:33.895117 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3cc9b9a0-d095-4d4a-8d6a-6b07b1a2016a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:33.900988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3cc9b9a0-d095-4d4a-8d6a-6b07b1a2016a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:33.901439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3cc9b9a0-d095-4d4a-8d6a-6b07b1a2016a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:33.902272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3cc9b9a0-d095-4d4a-8d6a-6b07b1a2016a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:33.902705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3cc9b9a0-d095-4d4a-8d6a-6b07b1a2016a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:33.931448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3cc9b9a0-d095-4d4a-8d6a-6b07b1a2016a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041727 Sep 14 19:47:33.931992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 492/966] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:33 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:34.383401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f974668b-7e7a-4b31-b929-a11be5175203 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:34.384298 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f974668b-7e7a-4b31-b929-a11be5175203 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:34.390930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f974668b-7e7a-4b31-b929-a11be5175203 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:34.391378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f974668b-7e7a-4b31-b929-a11be5175203 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:34.392151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f974668b-7e7a-4b31-b929-a11be5175203 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:34.392599 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f974668b-7e7a-4b31-b929-a11be5175203 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:34.411669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e9615130-3dca-4df7-87ab-69ea1eb8f0c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:34.412651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e9615130-3dca-4df7-87ab-69ea1eb8f0c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:34.418615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9615130-3dca-4df7-87ab-69ea1eb8f0c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:34.419070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9615130-3dca-4df7-87ab-69ea1eb8f0c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:34.419828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9615130-3dca-4df7-87ab-69ea1eb8f0c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:34.420256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9615130-3dca-4df7-87ab-69ea1eb8f0c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:34.427344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f974668b-7e7a-4b31-b929-a11be5175203 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047658 Sep 14 19:47:34.428057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 475/967] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:34 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:34.543086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e9615130-3dca-4df7-87ab-69ea1eb8f0c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:34.551173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e9615130-3dca-4df7-87ab-69ea1eb8f0c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.143089 Sep 14 19:47:34.551663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 493/968] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:34 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:34.635875 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5478b98f-d92e-4eda-a8a3-6eb8740cf97e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:34.636796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5478b98f-d92e-4eda-a8a3-6eb8740cf97e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:34.642849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5478b98f-d92e-4eda-a8a3-6eb8740cf97e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:34.643290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5478b98f-d92e-4eda-a8a3-6eb8740cf97e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:34.644048 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5478b98f-d92e-4eda-a8a3-6eb8740cf97e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:34.644474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5478b98f-d92e-4eda-a8a3-6eb8740cf97e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:34.672887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5478b98f-d92e-4eda-a8a3-6eb8740cf97e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040497 Sep 14 19:47:34.673440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 476/969] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:34 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:34.942772 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e62d4c00-0010-453d-99c0-a299b9e2ba81 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:34.943680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e62d4c00-0010-453d-99c0-a299b9e2ba81 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:34.949520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e62d4c00-0010-453d-99c0-a299b9e2ba81 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:34.950010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e62d4c00-0010-453d-99c0-a299b9e2ba81 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:34.950780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e62d4c00-0010-453d-99c0-a299b9e2ba81 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:34.951215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e62d4c00-0010-453d-99c0-a299b9e2ba81 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:34.979733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e62d4c00-0010-453d-99c0-a299b9e2ba81 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040744 Sep 14 19:47:34.980285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 494/970] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:34 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:35.438635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fcf90a1f-7968-48cf-9bc7-c1256d166b56 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:35.439557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fcf90a1f-7968-48cf-9bc7-c1256d166b56 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:35.445329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fcf90a1f-7968-48cf-9bc7-c1256d166b56 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:35.445799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fcf90a1f-7968-48cf-9bc7-c1256d166b56 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:35.446554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fcf90a1f-7968-48cf-9bc7-c1256d166b56 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:35.446976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fcf90a1f-7968-48cf-9bc7-c1256d166b56 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:35.475817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fcf90a1f-7968-48cf-9bc7-c1256d166b56 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040918 Sep 14 19:47:35.476361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 477/971] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:35 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:35.568384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e3d5566e-7091-42f1-9df0-cc4338799109 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:35.568979 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e3d5566e-7091-42f1-9df0-cc4338799109 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:35.575239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3d5566e-7091-42f1-9df0-cc4338799109 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:35.575685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3d5566e-7091-42f1-9df0-cc4338799109 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:35.576417 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3d5566e-7091-42f1-9df0-cc4338799109 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:35.576839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3d5566e-7091-42f1-9df0-cc4338799109 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:35.684624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-368fb815-006e-4598-b7ff-2fc1e317be33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:35.685568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-368fb815-006e-4598-b7ff-2fc1e317be33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:35.691844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-368fb815-006e-4598-b7ff-2fc1e317be33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:35.692229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-368fb815-006e-4598-b7ff-2fc1e317be33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:35.693011 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-368fb815-006e-4598-b7ff-2fc1e317be33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:35.693452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-368fb815-006e-4598-b7ff-2fc1e317be33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:35.702324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e3d5566e-7091-42f1-9df0-cc4338799109 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:35.709725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e3d5566e-7091-42f1-9df0-cc4338799109 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.144934 Sep 14 19:47:35.710298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 495/972] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:35 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:35.723613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-368fb815-006e-4598-b7ff-2fc1e317be33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Sep 14 19:47:35.724168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 478/973] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:35 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:35.991551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-596d6366-955d-4066-b88d-e31e3a9e5e6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:35.992359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-596d6366-955d-4066-b88d-e31e3a9e5e6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:35.998661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-596d6366-955d-4066-b88d-e31e3a9e5e6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:35.999102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-596d6366-955d-4066-b88d-e31e3a9e5e6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:35.999862 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-596d6366-955d-4066-b88d-e31e3a9e5e6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:36.000286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-596d6366-955d-4066-b88d-e31e3a9e5e6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:36.030086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-596d6366-955d-4066-b88d-e31e3a9e5e6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042319 Sep 14 19:47:36.030642 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 496/974] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:35 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:36.488087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4a835b0f-5d96-4898-b9c5-db6e7f08f6d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:36.488985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4a835b0f-5d96-4898-b9c5-db6e7f08f6d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:36.494981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a835b0f-5d96-4898-b9c5-db6e7f08f6d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:36.498283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a835b0f-5d96-4898-b9c5-db6e7f08f6d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:36.498283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a835b0f-5d96-4898-b9c5-db6e7f08f6d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:36.498283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a835b0f-5d96-4898-b9c5-db6e7f08f6d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:36.525227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4a835b0f-5d96-4898-b9c5-db6e7f08f6d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041029 Sep 14 19:47:36.525836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 479/975] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:36 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:36.726614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b0bdbdba-7d18-43c4-a808-74ec51ff91cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:36.727222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b0bdbdba-7d18-43c4-a808-74ec51ff91cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:36.733780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0bdbdba-7d18-43c4-a808-74ec51ff91cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:36.734223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0bdbdba-7d18-43c4-a808-74ec51ff91cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:36.734984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0bdbdba-7d18-43c4-a808-74ec51ff91cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:36.735352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e026cecd-3b34-475f-81e6-56aaa7553fc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:36.735492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0bdbdba-7d18-43c4-a808-74ec51ff91cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:36.736252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e026cecd-3b34-475f-81e6-56aaa7553fc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:36.742015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e026cecd-3b34-475f-81e6-56aaa7553fc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:36.742453 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e026cecd-3b34-475f-81e6-56aaa7553fc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:36.743220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e026cecd-3b34-475f-81e6-56aaa7553fc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:36.743652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e026cecd-3b34-475f-81e6-56aaa7553fc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:36.772755 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e026cecd-3b34-475f-81e6-56aaa7553fc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041636 Sep 14 19:47:36.773319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 480/976] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:36 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:36.855058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b0bdbdba-7d18-43c4-a808-74ec51ff91cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:36.862887 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b0bdbdba-7d18-43c4-a808-74ec51ff91cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.139910 Sep 14 19:47:36.863448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 497/977] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:36 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:37.041570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5d11176a-b10c-481f-a7c7-e67bab6384b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:37.042384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5d11176a-b10c-481f-a7c7-e67bab6384b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:37.049050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d11176a-b10c-481f-a7c7-e67bab6384b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:37.049489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d11176a-b10c-481f-a7c7-e67bab6384b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:37.050269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d11176a-b10c-481f-a7c7-e67bab6384b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:37.050698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d11176a-b10c-481f-a7c7-e67bab6384b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:37.079216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5d11176a-b10c-481f-a7c7-e67bab6384b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041474 Sep 14 19:47:37.079770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 481/978] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:37 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:37.537433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d9b4702e-3918-491f-b87b-0ccb3614e199 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:37.538392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d9b4702e-3918-491f-b87b-0ccb3614e199 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:37.545176 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9b4702e-3918-491f-b87b-0ccb3614e199 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:37.545659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9b4702e-3918-491f-b87b-0ccb3614e199 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:37.546447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9b4702e-3918-491f-b87b-0ccb3614e199 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:37.546889 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9b4702e-3918-491f-b87b-0ccb3614e199 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:37.576525 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d9b4702e-3918-491f-b87b-0ccb3614e199 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042907 Sep 14 19:47:37.577082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 498/979] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:37.784574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ff14775a-597d-4543-a231-a89da8571284 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:37.785479 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ff14775a-597d-4543-a231-a89da8571284 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:37.791463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff14775a-597d-4543-a231-a89da8571284 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:37.791852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff14775a-597d-4543-a231-a89da8571284 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:37.792628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff14775a-597d-4543-a231-a89da8571284 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:37.793065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff14775a-597d-4543-a231-a89da8571284 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:37.822409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ff14775a-597d-4543-a231-a89da8571284 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041539 Sep 14 19:47:37.822976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 482/980] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:37 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:37.879615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9528a1c6-ebda-4c45-9dae-1674689ec1fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:37.880225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9528a1c6-ebda-4c45-9dae-1674689ec1fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:37.886146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9528a1c6-ebda-4c45-9dae-1674689ec1fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:37.886594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9528a1c6-ebda-4c45-9dae-1674689ec1fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:37.887878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9528a1c6-ebda-4c45-9dae-1674689ec1fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:37.888312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9528a1c6-ebda-4c45-9dae-1674689ec1fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:38.009796 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9528a1c6-ebda-4c45-9dae-1674689ec1fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:38.018211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9528a1c6-ebda-4c45-9dae-1674689ec1fc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142174 Sep 14 19:47:38.018796 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 499/981] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:37 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:38.090408 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-66b99fc5-01f8-4708-9168-a1717a3228ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:38.091234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-66b99fc5-01f8-4708-9168-a1717a3228ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:38.097057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66b99fc5-01f8-4708-9168-a1717a3228ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:38.097529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66b99fc5-01f8-4708-9168-a1717a3228ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:38.098319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66b99fc5-01f8-4708-9168-a1717a3228ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:38.098755 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66b99fc5-01f8-4708-9168-a1717a3228ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:38.127330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-66b99fc5-01f8-4708-9168-a1717a3228ae tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040768 Sep 14 19:47:38.127885 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 483/982] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:38 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:38.587771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fc9c738d-0d81-4c55-b97c-740a9f668230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:38.588715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fc9c738d-0d81-4c55-b97c-740a9f668230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:38.595169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fc9c738d-0d81-4c55-b97c-740a9f668230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:38.595612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fc9c738d-0d81-4c55-b97c-740a9f668230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:38.596379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fc9c738d-0d81-4c55-b97c-740a9f668230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:38.596811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fc9c738d-0d81-4c55-b97c-740a9f668230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:38.624394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fc9c738d-0d81-4c55-b97c-740a9f668230 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040737 Sep 14 19:47:38.624934 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 500/983] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:38 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:38.834332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-254dcd59-27eb-47c3-9016-2cfc27e657d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:38.835237 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-254dcd59-27eb-47c3-9016-2cfc27e657d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:38.841112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-254dcd59-27eb-47c3-9016-2cfc27e657d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:38.841585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-254dcd59-27eb-47c3-9016-2cfc27e657d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:38.842347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-254dcd59-27eb-47c3-9016-2cfc27e657d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:38.842775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-254dcd59-27eb-47c3-9016-2cfc27e657d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:38.870334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-254dcd59-27eb-47c3-9016-2cfc27e657d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039771 Sep 14 19:47:38.870878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 484/984] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:38 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:39.035365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f9b47cb4-2c54-487d-b5ab-5be84fd6a47e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:39.036020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f9b47cb4-2c54-487d-b5ab-5be84fd6a47e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:39.041969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9b47cb4-2c54-487d-b5ab-5be84fd6a47e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:39.042409 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9b47cb4-2c54-487d-b5ab-5be84fd6a47e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:39.043176 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9b47cb4-2c54-487d-b5ab-5be84fd6a47e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:39.044112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9b47cb4-2c54-487d-b5ab-5be84fd6a47e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:39.138750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ed9330c7-498a-4d78-9a82-bf6aa30f714c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:39.139750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ed9330c7-498a-4d78-9a82-bf6aa30f714c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:39.145538 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed9330c7-498a-4d78-9a82-bf6aa30f714c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:39.145988 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed9330c7-498a-4d78-9a82-bf6aa30f714c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:39.146782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed9330c7-498a-4d78-9a82-bf6aa30f714c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:39.147215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed9330c7-498a-4d78-9a82-bf6aa30f714c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:39.173013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f9b47cb4-2c54-487d-b5ab-5be84fd6a47e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:39.176800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ed9330c7-498a-4d78-9a82-bf6aa30f714c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041828 Sep 14 19:47:39.177443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 485/985] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:39 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:39.180487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f9b47cb4-2c54-487d-b5ab-5be84fd6a47e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.148924 Sep 14 19:47:39.181038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 501/986] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:39 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:39.635979 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-315bcd93-7976-43f2-8370-b7c87d0b0e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:39.637252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-315bcd93-7976-43f2-8370-b7c87d0b0e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:39.643180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-315bcd93-7976-43f2-8370-b7c87d0b0e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:39.643629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-315bcd93-7976-43f2-8370-b7c87d0b0e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:39.644472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-315bcd93-7976-43f2-8370-b7c87d0b0e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:39.644963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-315bcd93-7976-43f2-8370-b7c87d0b0e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:39.674996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-315bcd93-7976-43f2-8370-b7c87d0b0e22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042766 Sep 14 19:47:39.675549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 486/987] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:39 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:39.882205 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-954277f7-6544-4279-b5ef-fc12d55c23fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:39.883149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-954277f7-6544-4279-b5ef-fc12d55c23fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:39.889571 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-954277f7-6544-4279-b5ef-fc12d55c23fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:39.889955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-954277f7-6544-4279-b5ef-fc12d55c23fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:39.890727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-954277f7-6544-4279-b5ef-fc12d55c23fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:39.891166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-954277f7-6544-4279-b5ef-fc12d55c23fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:39.919987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-954277f7-6544-4279-b5ef-fc12d55c23fb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041562 Sep 14 19:47:39.920549 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 502/988] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:39 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:40.189592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7fa8207c-c04c-4974-8e5e-7cc5fc77a2a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:40.190442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7fa8207c-c04c-4974-8e5e-7cc5fc77a2a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:40.196818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7fa8207c-c04c-4974-8e5e-7cc5fc77a2a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:40.197315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7fa8207c-c04c-4974-8e5e-7cc5fc77a2a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:40.197606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cfff7398-0ab8-40a1-8cbc-694f8085f454 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:40.198116 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7fa8207c-c04c-4974-8e5e-7cc5fc77a2a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:40.198377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cfff7398-0ab8-40a1-8cbc-694f8085f454 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:40.198550 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7fa8207c-c04c-4974-8e5e-7cc5fc77a2a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:40.204796 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfff7398-0ab8-40a1-8cbc-694f8085f454 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:40.205229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfff7398-0ab8-40a1-8cbc-694f8085f454 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:40.206047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfff7398-0ab8-40a1-8cbc-694f8085f454 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:40.206478 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfff7398-0ab8-40a1-8cbc-694f8085f454 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:40.228647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7fa8207c-c04c-4974-8e5e-7cc5fc77a2a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043213 Sep 14 19:47:40.229428 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 487/989] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:40 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:40.328483 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cfff7398-0ab8-40a1-8cbc-694f8085f454 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:40.336435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cfff7398-0ab8-40a1-8cbc-694f8085f454 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142479 Sep 14 19:47:40.338701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 503/990] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:40 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:47:40.687443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-08cb27dc-9c61-4596-823a-946cde2c7413 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:40.688344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-08cb27dc-9c61-4596-823a-946cde2c7413 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:40.694184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08cb27dc-9c61-4596-823a-946cde2c7413 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:40.694649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08cb27dc-9c61-4596-823a-946cde2c7413 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:40.695396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08cb27dc-9c61-4596-823a-946cde2c7413 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:40.695835 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08cb27dc-9c61-4596-823a-946cde2c7413 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:40.723829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-08cb27dc-9c61-4596-823a-946cde2c7413 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041062 Sep 14 19:47:40.724378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 488/991] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:47:40.931664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a39f848b-8b04-4b05-9947-1410803c71c0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:40.932570 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a39f848b-8b04-4b05-9947-1410803c71c0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:40.938754 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a39f848b-8b04-4b05-9947-1410803c71c0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:40.939146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a39f848b-8b04-4b05-9947-1410803c71c0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:40.939959 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a39f848b-8b04-4b05-9947-1410803c71c0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:40.940502 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a39f848b-8b04-4b05-9947-1410803c71c0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:40.969301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a39f848b-8b04-4b05-9947-1410803c71c0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041395 Sep 14 19:47:40.969883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 504/992] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:40 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:41.239583 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b17db788-4088-4038-9cd8-11f816fab8e2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:41.240396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b17db788-4088-4038-9cd8-11f816fab8e2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:41.246338 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b17db788-4088-4038-9cd8-11f816fab8e2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:41.246777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b17db788-4088-4038-9cd8-11f816fab8e2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:41.247532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b17db788-4088-4038-9cd8-11f816fab8e2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:41.247954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b17db788-4088-4038-9cd8-11f816fab8e2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:41.276529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b17db788-4088-4038-9cd8-11f816fab8e2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040758 Sep 14 19:47:41.277079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 489/993] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:41 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:41.355139 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2f458a47-a979-49c4-a6c2-c7aad2928ecf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:41.355746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2f458a47-a979-49c4-a6c2-c7aad2928ecf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:41.361689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f458a47-a979-49c4-a6c2-c7aad2928ecf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:41.362142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f458a47-a979-49c4-a6c2-c7aad2928ecf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:41.362908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f458a47-a979-49c4-a6c2-c7aad2928ecf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:41.363341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f458a47-a979-49c4-a6c2-c7aad2928ecf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:41.480425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2f458a47-a979-49c4-a6c2-c7aad2928ecf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:41.489667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2f458a47-a979-49c4-a6c2-c7aad2928ecf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.137874 Sep 14 19:47:41.490436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 505/994] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:41 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:41.735411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4738fe06-e16f-409f-b607-1a8765a07a13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:41.736345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4738fe06-e16f-409f-b607-1a8765a07a13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:41.742376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4738fe06-e16f-409f-b607-1a8765a07a13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:41.742800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4738fe06-e16f-409f-b607-1a8765a07a13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:41.743612 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4738fe06-e16f-409f-b607-1a8765a07a13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:41.744048 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4738fe06-e16f-409f-b607-1a8765a07a13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:41.773893 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4738fe06-e16f-409f-b607-1a8765a07a13 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042264 Sep 14 19:47:41.774450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 490/995] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:41 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:41.980781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-107b145a-40be-43b6-bb21-784a4e42df70 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:41.981726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-107b145a-40be-43b6-bb21-784a4e42df70 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:41.987552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-107b145a-40be-43b6-bb21-784a4e42df70 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:41.987997 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-107b145a-40be-43b6-bb21-784a4e42df70 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:41.988769 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-107b145a-40be-43b6-bb21-784a4e42df70 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:41.989203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-107b145a-40be-43b6-bb21-784a4e42df70 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:42.018411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-107b145a-40be-43b6-bb21-784a4e42df70 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 Sep 14 19:47:42.018888 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 506/996] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:41 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:42.288185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-36db2165-f57d-4b0a-a14b-2f8006728504 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:42.289147 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-36db2165-f57d-4b0a-a14b-2f8006728504 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:42.295627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36db2165-f57d-4b0a-a14b-2f8006728504 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:42.296070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36db2165-f57d-4b0a-a14b-2f8006728504 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:42.296840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36db2165-f57d-4b0a-a14b-2f8006728504 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:42.297529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36db2165-f57d-4b0a-a14b-2f8006728504 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:42.327202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-36db2165-f57d-4b0a-a14b-2f8006728504 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Sep 14 19:47:42.327759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 491/997] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:42 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:42.511721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f76ce266-fe75-4b2f-8e23-d1a38bbd926e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:42.512339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f76ce266-fe75-4b2f-8e23-d1a38bbd926e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:42.518586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f76ce266-fe75-4b2f-8e23-d1a38bbd926e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:42.519034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f76ce266-fe75-4b2f-8e23-d1a38bbd926e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:42.519835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f76ce266-fe75-4b2f-8e23-d1a38bbd926e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:42.520272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f76ce266-fe75-4b2f-8e23-d1a38bbd926e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:42.640532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f76ce266-fe75-4b2f-8e23-d1a38bbd926e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:42.647716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f76ce266-fe75-4b2f-8e23-d1a38bbd926e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.139640 Sep 14 19:47:42.648284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 507/998] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:42 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:42.785335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-94e6a850-f468-4bcb-b6b9-99002cef74a6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:42.786273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-94e6a850-f468-4bcb-b6b9-99002cef74a6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:42.792146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-94e6a850-f468-4bcb-b6b9-99002cef74a6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:42.792597 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-94e6a850-f468-4bcb-b6b9-99002cef74a6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:42.793373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-94e6a850-f468-4bcb-b6b9-99002cef74a6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:42.793842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-94e6a850-f468-4bcb-b6b9-99002cef74a6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:42.823562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-94e6a850-f468-4bcb-b6b9-99002cef74a6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041843 Sep 14 19:47:42.824128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 492/999] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:42 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:43.030392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6501a4b1-e97c-4a70-bbeb-8b571d2986e1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:43.031328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6501a4b1-e97c-4a70-bbeb-8b571d2986e1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:43.037135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6501a4b1-e97c-4a70-bbeb-8b571d2986e1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:43.037619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6501a4b1-e97c-4a70-bbeb-8b571d2986e1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:43.038392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6501a4b1-e97c-4a70-bbeb-8b571d2986e1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:43.038833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6501a4b1-e97c-4a70-bbeb-8b571d2986e1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:43.067493 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6501a4b1-e97c-4a70-bbeb-8b571d2986e1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041396 Sep 14 19:47:43.068087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 508/1000] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:43 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:43.339059 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-21179b2b-8140-4862-b447-7c2dcb38f887 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:43.339879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-21179b2b-8140-4862-b447-7c2dcb38f887 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:43.345804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21179b2b-8140-4862-b447-7c2dcb38f887 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:43.346247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21179b2b-8140-4862-b447-7c2dcb38f887 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:43.346997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21179b2b-8140-4862-b447-7c2dcb38f887 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:43.347419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21179b2b-8140-4862-b447-7c2dcb38f887 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:43.375771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-21179b2b-8140-4862-b447-7c2dcb38f887 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040593 Sep 14 19:47:43.376315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 493/1001] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:43 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:43.664855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0c3599b0-9089-410e-88e0-0a13fbe7b25f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:43.665466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0c3599b0-9089-410e-88e0-0a13fbe7b25f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:43.671845 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0c3599b0-9089-410e-88e0-0a13fbe7b25f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:43.672547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0c3599b0-9089-410e-88e0-0a13fbe7b25f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:43.673320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0c3599b0-9089-410e-88e0-0a13fbe7b25f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:43.673796 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0c3599b0-9089-410e-88e0-0a13fbe7b25f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:43.790007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0c3599b0-9089-410e-88e0-0a13fbe7b25f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:43.798354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0c3599b0-9089-410e-88e0-0a13fbe7b25f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.136943 Sep 14 19:47:43.798930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 509/1002] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:43 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:43.834839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ceb570cf-7e92-4ad5-a3e6-f18875fea7c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:43.835741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ceb570cf-7e92-4ad5-a3e6-f18875fea7c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:43.841854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ceb570cf-7e92-4ad5-a3e6-f18875fea7c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:43.842299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ceb570cf-7e92-4ad5-a3e6-f18875fea7c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:43.843061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ceb570cf-7e92-4ad5-a3e6-f18875fea7c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:43.843487 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ceb570cf-7e92-4ad5-a3e6-f18875fea7c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:43.872125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ceb570cf-7e92-4ad5-a3e6-f18875fea7c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040425 Sep 14 19:47:43.872679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 494/1003] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:44.079110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5e46a6ba-856b-450e-be50-4034d90c8a1d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:44.079936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5e46a6ba-856b-450e-be50-4034d90c8a1d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:44.085697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e46a6ba-856b-450e-be50-4034d90c8a1d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:44.086145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e46a6ba-856b-450e-be50-4034d90c8a1d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:44.086918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e46a6ba-856b-450e-be50-4034d90c8a1d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:44.087337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e46a6ba-856b-450e-be50-4034d90c8a1d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:44.116339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5e46a6ba-856b-450e-be50-4034d90c8a1d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041040 Sep 14 19:47:44.116876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 510/1004] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:44 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:44.387667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ee0a6771-ef63-43c5-921f-f15c4a02777b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:44.388558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ee0a6771-ef63-43c5-921f-f15c4a02777b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:44.394347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee0a6771-ef63-43c5-921f-f15c4a02777b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:44.394783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee0a6771-ef63-43c5-921f-f15c4a02777b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:44.395532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee0a6771-ef63-43c5-921f-f15c4a02777b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:44.395958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee0a6771-ef63-43c5-921f-f15c4a02777b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:44.424412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ee0a6771-ef63-43c5-921f-f15c4a02777b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041097 Sep 14 19:47:44.424956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 495/1005] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:44 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:44.815868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-933d8ae9-d40c-4a16-8676-e743c957a886 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:44.816420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-933d8ae9-d40c-4a16-8676-e743c957a886 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:44.822240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-933d8ae9-d40c-4a16-8676-e743c957a886 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:44.822785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-933d8ae9-d40c-4a16-8676-e743c957a886 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:44.823468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-933d8ae9-d40c-4a16-8676-e743c957a886 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:44.823896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-933d8ae9-d40c-4a16-8676-e743c957a886 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:44.883782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-50af24fc-87df-4f05-9126-439cf9980684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:44.884691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-50af24fc-87df-4f05-9126-439cf9980684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:44.891335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50af24fc-87df-4f05-9126-439cf9980684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:44.891784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50af24fc-87df-4f05-9126-439cf9980684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:44.892645 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50af24fc-87df-4f05-9126-439cf9980684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:44.893083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50af24fc-87df-4f05-9126-439cf9980684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:44.922793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-50af24fc-87df-4f05-9126-439cf9980684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042495 Sep 14 19:47:44.923366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 496/1006] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:47:44.945433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-933d8ae9-d40c-4a16-8676-e743c957a886 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:44.953238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-933d8ae9-d40c-4a16-8676-e743c957a886 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.141171 Sep 14 19:47:44.953810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 511/1007] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:44 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:45.128406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-aa479e7e-502f-4c47-8c3e-e6199f8ad8ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:45.129330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-aa479e7e-502f-4c47-8c3e-e6199f8ad8ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:45.135139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa479e7e-502f-4c47-8c3e-e6199f8ad8ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:45.135591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa479e7e-502f-4c47-8c3e-e6199f8ad8ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:45.136350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa479e7e-502f-4c47-8c3e-e6199f8ad8ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:45.136779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aa479e7e-502f-4c47-8c3e-e6199f8ad8ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:45.164583 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-aa479e7e-502f-4c47-8c3e-e6199f8ad8ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039949 Sep 14 19:47:45.165131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 497/1008] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:45 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:45.435948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-402ce8e3-2ac5-40a5-aa98-f4630ad51727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:45.436801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-402ce8e3-2ac5-40a5-aa98-f4630ad51727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:45.442623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-402ce8e3-2ac5-40a5-aa98-f4630ad51727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:45.443078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-402ce8e3-2ac5-40a5-aa98-f4630ad51727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:45.443849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-402ce8e3-2ac5-40a5-aa98-f4630ad51727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:45.444294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-402ce8e3-2ac5-40a5-aa98-f4630ad51727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:45.473128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-402ce8e3-2ac5-40a5-aa98-f4630ad51727 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041070 Sep 14 19:47:45.473704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 512/1009] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:45 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:45.934358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-faee9591-922f-4788-8594-e3c1424aa608 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:45.935283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-faee9591-922f-4788-8594-e3c1424aa608 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:45.941427 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faee9591-922f-4788-8594-e3c1424aa608 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:45.941995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faee9591-922f-4788-8594-e3c1424aa608 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:45.942818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faee9591-922f-4788-8594-e3c1424aa608 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:45.943300 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faee9591-922f-4788-8594-e3c1424aa608 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:45.970315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7daa6b02-375f-40b7-9aec-eaf48dba0809 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:45.970920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7daa6b02-375f-40b7-9aec-eaf48dba0809 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:45.974214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-faee9591-922f-4788-8594-e3c1424aa608 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043595 Sep 14 19:47:45.974802 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 498/1010] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:45.976592 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7daa6b02-375f-40b7-9aec-eaf48dba0809 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:45.977051 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7daa6b02-375f-40b7-9aec-eaf48dba0809 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:45.977857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7daa6b02-375f-40b7-9aec-eaf48dba0809 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:45.978292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7daa6b02-375f-40b7-9aec-eaf48dba0809 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:46.101670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7daa6b02-375f-40b7-9aec-eaf48dba0809 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:46.108977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7daa6b02-375f-40b7-9aec-eaf48dba0809 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142330 Sep 14 19:47:46.109596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 513/1011] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:45 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:47:46.176333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d1f60a24-26b6-4a92-bdd6-ca24943952a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:46.177240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d1f60a24-26b6-4a92-bdd6-ca24943952a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:46.183301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1f60a24-26b6-4a92-bdd6-ca24943952a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:46.184247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1f60a24-26b6-4a92-bdd6-ca24943952a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:46.185014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1f60a24-26b6-4a92-bdd6-ca24943952a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:46.185451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1f60a24-26b6-4a92-bdd6-ca24943952a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:46.213785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d1f60a24-26b6-4a92-bdd6-ca24943952a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041452 Sep 14 19:47:46.214344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 499/1012] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:46 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:46.484386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-904d2038-0e96-466c-bf2b-9291c90faf8a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:46.485281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-904d2038-0e96-466c-bf2b-9291c90faf8a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:46.491046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-904d2038-0e96-466c-bf2b-9291c90faf8a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:46.491498 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-904d2038-0e96-466c-bf2b-9291c90faf8a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:46.492254 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-904d2038-0e96-466c-bf2b-9291c90faf8a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:46.492682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-904d2038-0e96-466c-bf2b-9291c90faf8a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:46.521817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-904d2038-0e96-466c-bf2b-9291c90faf8a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Sep 14 19:47:46.522368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 514/1013] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:46 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:46.986704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c076844e-b6b3-4e32-8ea8-c0ea473fe749 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:46.987607 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c076844e-b6b3-4e32-8ea8-c0ea473fe749 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:46.993510 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c076844e-b6b3-4e32-8ea8-c0ea473fe749 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:46.993979 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c076844e-b6b3-4e32-8ea8-c0ea473fe749 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:46.994742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c076844e-b6b3-4e32-8ea8-c0ea473fe749 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:46.995179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c076844e-b6b3-4e32-8ea8-c0ea473fe749 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:47.023799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c076844e-b6b3-4e32-8ea8-c0ea473fe749 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040845 Sep 14 19:47:47.024352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 500/1014] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:47.125459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-29abdeaa-a40d-48b1-b142-eef24b4c8c51 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:47.126095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-29abdeaa-a40d-48b1-b142-eef24b4c8c51 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:47.131965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29abdeaa-a40d-48b1-b142-eef24b4c8c51 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:47.132408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29abdeaa-a40d-48b1-b142-eef24b4c8c51 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:47.133177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29abdeaa-a40d-48b1-b142-eef24b4c8c51 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:47.133653 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29abdeaa-a40d-48b1-b142-eef24b4c8c51 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:47.225112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-36ee4814-4208-4f45-b8f5-bb4100da9ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:47.226071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-36ee4814-4208-4f45-b8f5-bb4100da9ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:47.232495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36ee4814-4208-4f45-b8f5-bb4100da9ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:47.232946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36ee4814-4208-4f45-b8f5-bb4100da9ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:47.233753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36ee4814-4208-4f45-b8f5-bb4100da9ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:47.234238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36ee4814-4208-4f45-b8f5-bb4100da9ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:47.255732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-29abdeaa-a40d-48b1-b142-eef24b4c8c51 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:47.263561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-29abdeaa-a40d-48b1-b142-eef24b4c8c51 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.141654 Sep 14 19:47:47.264124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 515/1015] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:47 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:47.276072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-36ee4814-4208-4f45-b8f5-bb4100da9ffe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054693 Sep 14 19:47:47.276706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 501/1016] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:47 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:47.532817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c31bc1bf-163c-4edf-ad7c-51bb2dadda03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:47.535426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c31bc1bf-163c-4edf-ad7c-51bb2dadda03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:47.539575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c31bc1bf-163c-4edf-ad7c-51bb2dadda03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:47.540017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c31bc1bf-163c-4edf-ad7c-51bb2dadda03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:47.540783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c31bc1bf-163c-4edf-ad7c-51bb2dadda03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:47.541219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c31bc1bf-163c-4edf-ad7c-51bb2dadda03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:47.569261 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c31bc1bf-163c-4edf-ad7c-51bb2dadda03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040250 Sep 14 19:47:47.569831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 516/1017] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:47 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:48.035404 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-74099a18-6c97-466b-89d1-e19853f87d22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:48.036306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-74099a18-6c97-466b-89d1-e19853f87d22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:48.042299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74099a18-6c97-466b-89d1-e19853f87d22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:48.042749 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74099a18-6c97-466b-89d1-e19853f87d22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:48.044028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74099a18-6c97-466b-89d1-e19853f87d22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:48.044453 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74099a18-6c97-466b-89d1-e19853f87d22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:48.073899 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-74099a18-6c97-466b-89d1-e19853f87d22 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042255 Sep 14 19:47:48.074512 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 502/1018] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:48 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:48.281353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b931dbf4-c48f-4d2a-bba1-feb1639a4851 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:48.282124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b931dbf4-c48f-4d2a-bba1-feb1639a4851 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:48.288021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5db83298-4f93-4dfc-8d0a-74c19afc6c4e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:48.288219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b931dbf4-c48f-4d2a-bba1-feb1639a4851 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:48.288536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b931dbf4-c48f-4d2a-bba1-feb1639a4851 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:48.288921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5db83298-4f93-4dfc-8d0a-74c19afc6c4e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:48.289314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b931dbf4-c48f-4d2a-bba1-feb1639a4851 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:48.289792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b931dbf4-c48f-4d2a-bba1-feb1639a4851 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:48.295215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5db83298-4f93-4dfc-8d0a-74c19afc6c4e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:48.295660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5db83298-4f93-4dfc-8d0a-74c19afc6c4e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:48.296420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5db83298-4f93-4dfc-8d0a-74c19afc6c4e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:48.296844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5db83298-4f93-4dfc-8d0a-74c19afc6c4e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:48.327336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5db83298-4f93-4dfc-8d0a-74c19afc6c4e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042981 Sep 14 19:47:48.327900 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 503/1019] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:48 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:48.409002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b931dbf4-c48f-4d2a-bba1-feb1639a4851 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:48.416168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b931dbf4-c48f-4d2a-bba1-feb1639a4851 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138513 Sep 14 19:47:48.416721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 517/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:48 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:48.580410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0d30a794-af5a-4f23-84d3-1f7fc2655ac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:48.581273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0d30a794-af5a-4f23-84d3-1f7fc2655ac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:48.587181 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d30a794-af5a-4f23-84d3-1f7fc2655ac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:48.587796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d30a794-af5a-4f23-84d3-1f7fc2655ac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:48.588573 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d30a794-af5a-4f23-84d3-1f7fc2655ac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:48.589016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d30a794-af5a-4f23-84d3-1f7fc2655ac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:48.619598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0d30a794-af5a-4f23-84d3-1f7fc2655ac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043241 Sep 14 19:47:48.620163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 504/1021] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:48 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:49.084791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6a42ba25-224e-4256-9190-fdfca1dbcb06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:49.094129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6a42ba25-224e-4256-9190-fdfca1dbcb06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:49.094129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6a42ba25-224e-4256-9190-fdfca1dbcb06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:49.094129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6a42ba25-224e-4256-9190-fdfca1dbcb06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:49.094129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6a42ba25-224e-4256-9190-fdfca1dbcb06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:49.094509 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6a42ba25-224e-4256-9190-fdfca1dbcb06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:49.122096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6a42ba25-224e-4256-9190-fdfca1dbcb06 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041081 Sep 14 19:47:49.122662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 518/1022] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:49 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:49.338125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-70a02dbf-cde9-429b-aae9-0f796cd695bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:49.339025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-70a02dbf-cde9-429b-aae9-0f796cd695bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:49.344902 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70a02dbf-cde9-429b-aae9-0f796cd695bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:49.345290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70a02dbf-cde9-429b-aae9-0f796cd695bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:49.346068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70a02dbf-cde9-429b-aae9-0f796cd695bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:49.346500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70a02dbf-cde9-429b-aae9-0f796cd695bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:49.374526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-70a02dbf-cde9-429b-aae9-0f796cd695bf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040220 Sep 14 19:47:49.375070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 505/1023] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:49 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:49.432891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-16b9353d-b174-4dec-b578-973a8e1bf7b0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:49.433530 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-16b9353d-b174-4dec-b578-973a8e1bf7b0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:49.439974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16b9353d-b174-4dec-b578-973a8e1bf7b0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:49.440418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16b9353d-b174-4dec-b578-973a8e1bf7b0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:49.441173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16b9353d-b174-4dec-b578-973a8e1bf7b0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:49.441633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16b9353d-b174-4dec-b578-973a8e1bf7b0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:49.564417 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-16b9353d-b174-4dec-b578-973a8e1bf7b0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:49.571782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-16b9353d-b174-4dec-b578-973a8e1bf7b0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142452 Sep 14 19:47:49.572345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 519/1024] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:49 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:49.630309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-01ce9295-b0f2-4c98-bf94-ad33b5303a0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:49.631210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-01ce9295-b0f2-4c98-bf94-ad33b5303a0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:49.636970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-01ce9295-b0f2-4c98-bf94-ad33b5303a0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:49.637407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-01ce9295-b0f2-4c98-bf94-ad33b5303a0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:49.638208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-01ce9295-b0f2-4c98-bf94-ad33b5303a0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:49.638639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-01ce9295-b0f2-4c98-bf94-ad33b5303a0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:49.666417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-01ce9295-b0f2-4c98-bf94-ad33b5303a0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039965 Sep 14 19:47:49.666964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 506/1025] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:49 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:50.134144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d643b22c-8346-4040-8922-b2f037ccb813 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:50.135054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d643b22c-8346-4040-8922-b2f037ccb813 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:50.140907 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d643b22c-8346-4040-8922-b2f037ccb813 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:50.141384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d643b22c-8346-4040-8922-b2f037ccb813 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:50.147141 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d643b22c-8346-4040-8922-b2f037ccb813 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:50.147141 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d643b22c-8346-4040-8922-b2f037ccb813 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:50.172841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d643b22c-8346-4040-8922-b2f037ccb813 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042223 Sep 14 19:47:50.177681 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 520/1026] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:50 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:50.386047 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-172e12b5-deb2-4083-93bc-894fa3c968c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:50.387425 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-172e12b5-deb2-4083-93bc-894fa3c968c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:50.393210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-172e12b5-deb2-4083-93bc-894fa3c968c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:50.393699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-172e12b5-deb2-4083-93bc-894fa3c968c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:50.394465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-172e12b5-deb2-4083-93bc-894fa3c968c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:50.394896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-172e12b5-deb2-4083-93bc-894fa3c968c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:50.423343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-172e12b5-deb2-4083-93bc-894fa3c968c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041187 Sep 14 19:47:50.423883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 507/1027] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:50 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:50.588467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-72484f4b-da6d-4203-82f4-5738237ee885 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:50.589070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-72484f4b-da6d-4203-82f4-5738237ee885 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:50.595512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72484f4b-da6d-4203-82f4-5738237ee885 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:50.595956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72484f4b-da6d-4203-82f4-5738237ee885 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:50.596709 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72484f4b-da6d-4203-82f4-5738237ee885 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:50.597137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72484f4b-da6d-4203-82f4-5738237ee885 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:50.678663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bcaa8278-ce5d-408f-9458-676524d7f8b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:50.679500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bcaa8278-ce5d-408f-9458-676524d7f8b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:50.685857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcaa8278-ce5d-408f-9458-676524d7f8b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:50.686378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcaa8278-ce5d-408f-9458-676524d7f8b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:50.687070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcaa8278-ce5d-408f-9458-676524d7f8b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:50.687502 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bcaa8278-ce5d-408f-9458-676524d7f8b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:50.716498 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bcaa8278-ce5d-408f-9458-676524d7f8b9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041708 Sep 14 19:47:50.717421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 508/1028] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:50 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:50.719787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-72484f4b-da6d-4203-82f4-5738237ee885 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:50.727200 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-72484f4b-da6d-4203-82f4-5738237ee885 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142745 Sep 14 19:47:50.727788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 521/1029] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:50 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:51.184878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e9ad2e9e-128e-40dd-8e8d-795e124bb270 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:51.185811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e9ad2e9e-128e-40dd-8e8d-795e124bb270 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:51.191593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e9ad2e9e-128e-40dd-8e8d-795e124bb270 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:51.192038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e9ad2e9e-128e-40dd-8e8d-795e124bb270 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:51.192796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e9ad2e9e-128e-40dd-8e8d-795e124bb270 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:51.193227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e9ad2e9e-128e-40dd-8e8d-795e124bb270 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:51.221551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e9ad2e9e-128e-40dd-8e8d-795e124bb270 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041054 Sep 14 19:47:51.222113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 509/1030] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:51 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:51.434459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c08341e7-392d-4d9e-86be-dc50674c2a96 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:51.435422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c08341e7-392d-4d9e-86be-dc50674c2a96 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:51.441280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c08341e7-392d-4d9e-86be-dc50674c2a96 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:51.441762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c08341e7-392d-4d9e-86be-dc50674c2a96 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:51.442538 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c08341e7-392d-4d9e-86be-dc50674c2a96 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:51.442975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c08341e7-392d-4d9e-86be-dc50674c2a96 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:51.471694 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c08341e7-392d-4d9e-86be-dc50674c2a96 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040975 Sep 14 19:47:51.472406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 522/1031] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:51 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:51.728160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fed7d6e3-9bf1-45f4-95bc-672b0537f6bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:51.728978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fed7d6e3-9bf1-45f4-95bc-672b0537f6bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:51.735417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fed7d6e3-9bf1-45f4-95bc-672b0537f6bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:51.735860 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fed7d6e3-9bf1-45f4-95bc-672b0537f6bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:51.736621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fed7d6e3-9bf1-45f4-95bc-672b0537f6bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:51.737069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fed7d6e3-9bf1-45f4-95bc-672b0537f6bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:51.743744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e3231db4-9a55-43a9-9030-43f68bacf79e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:51.744350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e3231db4-9a55-43a9-9030-43f68bacf79e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:51.750474 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3231db4-9a55-43a9-9030-43f68bacf79e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:51.750916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3231db4-9a55-43a9-9030-43f68bacf79e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:51.751692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3231db4-9a55-43a9-9030-43f68bacf79e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:51.752131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3231db4-9a55-43a9-9030-43f68bacf79e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:51.766527 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fed7d6e3-9bf1-45f4-95bc-672b0537f6bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042283 Sep 14 19:47:51.767085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 510/1032] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:51 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:51.871245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e3231db4-9a55-43a9-9030-43f68bacf79e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:51.878639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e3231db4-9a55-43a9-9030-43f68bacf79e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138467 Sep 14 19:47:51.879209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 523/1033] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:51 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:47:52.232491 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b4187dea-6797-4196-a004-814a8dea9473 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:52.233416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b4187dea-6797-4196-a004-814a8dea9473 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:52.239435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4187dea-6797-4196-a004-814a8dea9473 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:52.239917 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4187dea-6797-4196-a004-814a8dea9473 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:52.240689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4187dea-6797-4196-a004-814a8dea9473 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:52.241153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4187dea-6797-4196-a004-814a8dea9473 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:52.271827 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b4187dea-6797-4196-a004-814a8dea9473 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043066 Sep 14 19:47:52.272396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 511/1034] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:52.483333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c90e3122-d967-48c8-a7d7-7df0ad5e9060 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:52.484166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c90e3122-d967-48c8-a7d7-7df0ad5e9060 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:52.489987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c90e3122-d967-48c8-a7d7-7df0ad5e9060 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:52.490440 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c90e3122-d967-48c8-a7d7-7df0ad5e9060 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:52.491206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c90e3122-d967-48c8-a7d7-7df0ad5e9060 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:52.491645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c90e3122-d967-48c8-a7d7-7df0ad5e9060 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:52.520930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c90e3122-d967-48c8-a7d7-7df0ad5e9060 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Sep 14 19:47:52.521482 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 524/1035] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:52 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:52.778944 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b6a89e01-76cb-4795-bda8-8158d19f6233 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:52.779769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b6a89e01-76cb-4795-bda8-8158d19f6233 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:52.785513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6a89e01-76cb-4795-bda8-8158d19f6233 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:52.785975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6a89e01-76cb-4795-bda8-8158d19f6233 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:52.786753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6a89e01-76cb-4795-bda8-8158d19f6233 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:52.787190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6a89e01-76cb-4795-bda8-8158d19f6233 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:52.817790 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b6a89e01-76cb-4795-bda8-8158d19f6233 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 Sep 14 19:47:52.818357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 512/1036] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:52 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:52.895509 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-173803ee-8b43-4705-979a-cb875b320905 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:52.896110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-173803ee-8b43-4705-979a-cb875b320905 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:52.901894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-173803ee-8b43-4705-979a-cb875b320905 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:52.902827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-173803ee-8b43-4705-979a-cb875b320905 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:52.903630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-173803ee-8b43-4705-979a-cb875b320905 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:52.909408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-173803ee-8b43-4705-979a-cb875b320905 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:53.025159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-173803ee-8b43-4705-979a-cb875b320905 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:53.033304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-173803ee-8b43-4705-979a-cb875b320905 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.141332 Sep 14 19:47:53.033917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 525/1037] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:52 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:53.284562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1faeec39-3401-429e-b9f1-18891df0f7ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:53.285377 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1faeec39-3401-429e-b9f1-18891df0f7ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:53.291255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1faeec39-3401-429e-b9f1-18891df0f7ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:53.291702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1faeec39-3401-429e-b9f1-18891df0f7ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:53.292466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1faeec39-3401-429e-b9f1-18891df0f7ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:53.292900 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1faeec39-3401-429e-b9f1-18891df0f7ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:53.322737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1faeec39-3401-429e-b9f1-18891df0f7ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042164 Sep 14 19:47:53.323292 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 513/1038] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:53 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:53.532780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7506b195-c893-42f4-bda0-f99a23c209ab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:53.533710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7506b195-c893-42f4-bda0-f99a23c209ab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:53.539586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7506b195-c893-42f4-bda0-f99a23c209ab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:53.539971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7506b195-c893-42f4-bda0-f99a23c209ab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:53.540733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7506b195-c893-42f4-bda0-f99a23c209ab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:53.541165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7506b195-c893-42f4-bda0-f99a23c209ab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:53.569252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7506b195-c893-42f4-bda0-f99a23c209ab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040240 Sep 14 19:47:53.569816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 526/1039] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:53 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:53.830035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3af103e4-174c-40d6-a1b9-7ff86adb5e5f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:53.830868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3af103e4-174c-40d6-a1b9-7ff86adb5e5f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:53.836767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3af103e4-174c-40d6-a1b9-7ff86adb5e5f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:53.837214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3af103e4-174c-40d6-a1b9-7ff86adb5e5f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:53.838017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3af103e4-174c-40d6-a1b9-7ff86adb5e5f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:53.838715 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3af103e4-174c-40d6-a1b9-7ff86adb5e5f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:53.866582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3af103e4-174c-40d6-a1b9-7ff86adb5e5f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040539 Sep 14 19:47:53.867136 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 514/1040] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:53 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:54.051131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6812ba31-7f5e-4ad2-82c4-c24cc3c45479 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:54.051752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6812ba31-7f5e-4ad2-82c4-c24cc3c45479 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:54.057587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6812ba31-7f5e-4ad2-82c4-c24cc3c45479 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:54.058044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6812ba31-7f5e-4ad2-82c4-c24cc3c45479 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:54.058819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6812ba31-7f5e-4ad2-82c4-c24cc3c45479 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:54.059274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6812ba31-7f5e-4ad2-82c4-c24cc3c45479 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:54.176796 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6812ba31-7f5e-4ad2-82c4-c24cc3c45479 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:54.184026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6812ba31-7f5e-4ad2-82c4-c24cc3c45479 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.136809 Sep 14 19:47:54.184585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 527/1041] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:54 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:54.334869 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c0be2ccf-4087-4ff1-a2e5-dd6aa80c5421 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:54.336005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c0be2ccf-4087-4ff1-a2e5-dd6aa80c5421 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:54.341906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0be2ccf-4087-4ff1-a2e5-dd6aa80c5421 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:54.342354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0be2ccf-4087-4ff1-a2e5-dd6aa80c5421 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:54.343212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0be2ccf-4087-4ff1-a2e5-dd6aa80c5421 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:54.343647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0be2ccf-4087-4ff1-a2e5-dd6aa80c5421 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:54.373112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c0be2ccf-4087-4ff1-a2e5-dd6aa80c5421 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041445 Sep 14 19:47:54.378756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 515/1042] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:54.580222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a9b5fa5e-94fd-4469-bac5-037195cdeec5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:54.581236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a9b5fa5e-94fd-4469-bac5-037195cdeec5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:54.587052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9b5fa5e-94fd-4469-bac5-037195cdeec5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:54.587515 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9b5fa5e-94fd-4469-bac5-037195cdeec5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:54.588657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9b5fa5e-94fd-4469-bac5-037195cdeec5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:54.589104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9b5fa5e-94fd-4469-bac5-037195cdeec5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:54.626461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a9b5fa5e-94fd-4469-bac5-037195cdeec5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049731 Sep 14 19:47:54.627315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 528/1043] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:54 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:54.878616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fa3a31aa-2641-48c0-9687-4daee3f02124 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:54.879544 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fa3a31aa-2641-48c0-9687-4daee3f02124 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:54.885403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa3a31aa-2641-48c0-9687-4daee3f02124 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:54.885892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa3a31aa-2641-48c0-9687-4daee3f02124 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:54.886664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa3a31aa-2641-48c0-9687-4daee3f02124 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:54.887100 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa3a31aa-2641-48c0-9687-4daee3f02124 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:54.915777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fa3a31aa-2641-48c0-9687-4daee3f02124 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040856 Sep 14 19:47:54.916335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 516/1044] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:54 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:55.201704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2b739cc0-569e-40c1-921c-a76338d9b6c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:55.202311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2b739cc0-569e-40c1-921c-a76338d9b6c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:55.208169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b739cc0-569e-40c1-921c-a76338d9b6c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:55.208610 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b739cc0-569e-40c1-921c-a76338d9b6c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:55.209375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b739cc0-569e-40c1-921c-a76338d9b6c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:55.209853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b739cc0-569e-40c1-921c-a76338d9b6c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:55.330315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2b739cc0-569e-40c1-921c-a76338d9b6c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:55.337485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2b739cc0-569e-40c1-921c-a76338d9b6c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.139500 Sep 14 19:47:55.338053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 529/1045] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:55 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:55.384145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-02d8c29a-e97d-4bf6-b6d5-005c05a8bff2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:55.385077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-02d8c29a-e97d-4bf6-b6d5-005c05a8bff2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:55.390880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02d8c29a-e97d-4bf6-b6d5-005c05a8bff2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:55.391325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02d8c29a-e97d-4bf6-b6d5-005c05a8bff2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:55.392082 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02d8c29a-e97d-4bf6-b6d5-005c05a8bff2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:55.392516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-02d8c29a-e97d-4bf6-b6d5-005c05a8bff2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:55.422261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-02d8c29a-e97d-4bf6-b6d5-005c05a8bff2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041811 Sep 14 19:47:55.423080 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 517/1046] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:55 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:55.639492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-325bae07-d501-4879-b50a-846666334f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:55.640502 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-325bae07-d501-4879-b50a-846666334f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:55.646434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-325bae07-d501-4879-b50a-846666334f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:55.646879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-325bae07-d501-4879-b50a-846666334f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:55.647653 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-325bae07-d501-4879-b50a-846666334f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:55.648087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-325bae07-d501-4879-b50a-846666334f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:55.679262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-325bae07-d501-4879-b50a-846666334f1e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 Sep 14 19:47:55.679945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 530/1047] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:55 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:55.927775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6d7bb3e1-6b20-4bd8-b5da-c517c31cb8a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:55.928881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6d7bb3e1-6b20-4bd8-b5da-c517c31cb8a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:55.934693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d7bb3e1-6b20-4bd8-b5da-c517c31cb8a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:55.935137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d7bb3e1-6b20-4bd8-b5da-c517c31cb8a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:55.935909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d7bb3e1-6b20-4bd8-b5da-c517c31cb8a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:55.936341 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d7bb3e1-6b20-4bd8-b5da-c517c31cb8a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:55.966265 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6d7bb3e1-6b20-4bd8-b5da-c517c31cb8a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041638 Sep 14 19:47:55.966958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 518/1048] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:55 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:56.354773 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2ee05ea2-ace2-48df-9767-0c2e37661a21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:56.355416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2ee05ea2-ace2-48df-9767-0c2e37661a21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:56.361859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ee05ea2-ace2-48df-9767-0c2e37661a21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:56.362299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ee05ea2-ace2-48df-9767-0c2e37661a21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:56.363086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ee05ea2-ace2-48df-9767-0c2e37661a21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:56.363526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ee05ea2-ace2-48df-9767-0c2e37661a21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:56.434424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-419f7cd8-b576-417f-98df-22f52313c729 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:56.435955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-419f7cd8-b576-417f-98df-22f52313c729 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:56.441950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-419f7cd8-b576-417f-98df-22f52313c729 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:56.442393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-419f7cd8-b576-417f-98df-22f52313c729 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:56.443576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-419f7cd8-b576-417f-98df-22f52313c729 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:56.444013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-419f7cd8-b576-417f-98df-22f52313c729 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:56.477452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-419f7cd8-b576-417f-98df-22f52313c729 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046922 Sep 14 19:47:56.478069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 519/1049] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:56 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:47:56.501775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2ee05ea2-ace2-48df-9767-0c2e37661a21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:56.509266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2ee05ea2-ace2-48df-9767-0c2e37661a21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.158188 Sep 14 19:47:56.509860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 531/1050] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:56 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:56.690653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ccc034e0-7aba-4baa-8a0f-a9bef33f6388 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:56.691561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ccc034e0-7aba-4baa-8a0f-a9bef33f6388 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:56.697487 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ccc034e0-7aba-4baa-8a0f-a9bef33f6388 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:56.697970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ccc034e0-7aba-4baa-8a0f-a9bef33f6388 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:56.698737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ccc034e0-7aba-4baa-8a0f-a9bef33f6388 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:56.699180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ccc034e0-7aba-4baa-8a0f-a9bef33f6388 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:56.728451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ccc034e0-7aba-4baa-8a0f-a9bef33f6388 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041499 Sep 14 19:47:56.729025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 520/1051] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:56 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:56.977523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c4d55180-430f-415e-a9d6-2233e6a96824 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:56.978385 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c4d55180-430f-415e-a9d6-2233e6a96824 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:56.985013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4d55180-430f-415e-a9d6-2233e6a96824 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:56.985458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4d55180-430f-415e-a9d6-2233e6a96824 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:56.986254 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4d55180-430f-415e-a9d6-2233e6a96824 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:56.986795 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4d55180-430f-415e-a9d6-2233e6a96824 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:57.016130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c4d55180-430f-415e-a9d6-2233e6a96824 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042775 Sep 14 19:47:57.016691 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 532/1052] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:56 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:57.490065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-306e7908-7bed-493e-89ea-d49cc8efdecb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:57.491015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-306e7908-7bed-493e-89ea-d49cc8efdecb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:57.497000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-306e7908-7bed-493e-89ea-d49cc8efdecb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:57.498863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-306e7908-7bed-493e-89ea-d49cc8efdecb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:57.498863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-306e7908-7bed-493e-89ea-d49cc8efdecb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:57.498863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-306e7908-7bed-493e-89ea-d49cc8efdecb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:57.526151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-21d4613f-b60f-48e3-9ae7-e63a4f5d50f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:57.526760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-21d4613f-b60f-48e3-9ae7-e63a4f5d50f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:57.527021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-306e7908-7bed-493e-89ea-d49cc8efdecb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040761 Sep 14 19:47:57.527592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 521/1053] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:57 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:57.533366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21d4613f-b60f-48e3-9ae7-e63a4f5d50f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:57.533850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21d4613f-b60f-48e3-9ae7-e63a4f5d50f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:57.534635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21d4613f-b60f-48e3-9ae7-e63a4f5d50f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:57.535080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21d4613f-b60f-48e3-9ae7-e63a4f5d50f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:57.654183 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-21d4613f-b60f-48e3-9ae7-e63a4f5d50f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:57.661395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-21d4613f-b60f-48e3-9ae7-e63a4f5d50f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138938 Sep 14 19:47:57.661999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 533/1054] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:57 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:47:57.740580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-477c2d4e-694c-4448-a94d-190aa431c161 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:57.741401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-477c2d4e-694c-4448-a94d-190aa431c161 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:57.747541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-477c2d4e-694c-4448-a94d-190aa431c161 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:57.748190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-477c2d4e-694c-4448-a94d-190aa431c161 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:57.749321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-477c2d4e-694c-4448-a94d-190aa431c161 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:57.749896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-477c2d4e-694c-4448-a94d-190aa431c161 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:57.779428 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-477c2d4e-694c-4448-a94d-190aa431c161 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042708 Sep 14 19:47:57.779982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 522/1055] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:57 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:58.027164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e9a11396-b583-4f13-b28d-ecc41d12286a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:58.028083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e9a11396-b583-4f13-b28d-ecc41d12286a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:58.034612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9a11396-b583-4f13-b28d-ecc41d12286a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:58.035067 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9a11396-b583-4f13-b28d-ecc41d12286a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:58.035845 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9a11396-b583-4f13-b28d-ecc41d12286a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:58.036285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9a11396-b583-4f13-b28d-ecc41d12286a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:58.066268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e9a11396-b583-4f13-b28d-ecc41d12286a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043060 Sep 14 19:47:58.066824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 534/1056] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:58 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:58.539446 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-815b4c20-7a43-4a60-969f-4f7a89f615a5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:58.540370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-815b4c20-7a43-4a60-969f-4f7a89f615a5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:58.546686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-815b4c20-7a43-4a60-969f-4f7a89f615a5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:58.547126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-815b4c20-7a43-4a60-969f-4f7a89f615a5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:58.548141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-815b4c20-7a43-4a60-969f-4f7a89f615a5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:58.548565 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-815b4c20-7a43-4a60-969f-4f7a89f615a5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:58.577032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-815b4c20-7a43-4a60-969f-4f7a89f615a5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041659 Sep 14 19:47:58.577521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 523/1057] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:58 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:58.679072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-386983eb-b505-409e-b706-5edfeb541b97 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:58.679672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-386983eb-b505-409e-b706-5edfeb541b97 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:58.686142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-386983eb-b505-409e-b706-5edfeb541b97 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:58.686578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-386983eb-b505-409e-b706-5edfeb541b97 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:58.687336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-386983eb-b505-409e-b706-5edfeb541b97 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:58.687762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-386983eb-b505-409e-b706-5edfeb541b97 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:58.790849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5c3a2bf2-feca-4f11-8816-7ab5bc18703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:58.791786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5c3a2bf2-feca-4f11-8816-7ab5bc18703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:58.798496 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c3a2bf2-feca-4f11-8816-7ab5bc18703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:58.798943 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c3a2bf2-feca-4f11-8816-7ab5bc18703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:58.799720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c3a2bf2-feca-4f11-8816-7ab5bc18703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:58.800151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c3a2bf2-feca-4f11-8816-7ab5bc18703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:58.805314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-386983eb-b505-409e-b706-5edfeb541b97 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:58.813396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-386983eb-b505-409e-b706-5edfeb541b97 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.137889 Sep 14 19:47:58.813989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 535/1058] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:58 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:58.829862 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5c3a2bf2-feca-4f11-8816-7ab5bc18703a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042633 Sep 14 19:47:58.830368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 524/1059] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:58 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:59.077775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ed8daf1a-b3a7-453b-bc4a-81e1111f3e93 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:59.078686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ed8daf1a-b3a7-453b-bc4a-81e1111f3e93 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:59.084720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed8daf1a-b3a7-453b-bc4a-81e1111f3e93 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:59.085137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed8daf1a-b3a7-453b-bc4a-81e1111f3e93 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:59.085944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed8daf1a-b3a7-453b-bc4a-81e1111f3e93 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:59.086382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed8daf1a-b3a7-453b-bc4a-81e1111f3e93 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:59.116434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ed8daf1a-b3a7-453b-bc4a-81e1111f3e93 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042528 Sep 14 19:47:59.117037 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 536/1060] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:59 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:59.588959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-588e6c38-1075-4238-beb7-7b7229459e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:59.589878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-588e6c38-1075-4238-beb7-7b7229459e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:59.596550 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-588e6c38-1075-4238-beb7-7b7229459e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:59.596997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-588e6c38-1075-4238-beb7-7b7229459e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:59.597801 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-588e6c38-1075-4238-beb7-7b7229459e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:59.598242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-588e6c38-1075-4238-beb7-7b7229459e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:59.627068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-588e6c38-1075-4238-beb7-7b7229459e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042084 Sep 14 19:47:59.627632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 525/1061] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:47:59 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:59.830726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9dc077ad-69ec-4988-a85a-a37b0010fb2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:59.831356 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9dc077ad-69ec-4988-a85a-a37b0010fb2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:59.837816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9dc077ad-69ec-4988-a85a-a37b0010fb2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:59.838333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9dc077ad-69ec-4988-a85a-a37b0010fb2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:59.839206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9dc077ad-69ec-4988-a85a-a37b0010fb2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:59.839600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9dc077ad-69ec-4988-a85a-a37b0010fb2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:59.840436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-09c76e1d-2fe8-462a-8292-167fda309a13 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:59.841529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-09c76e1d-2fe8-462a-8292-167fda309a13 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:47:59.847421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09c76e1d-2fe8-462a-8292-167fda309a13 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:59.847894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09c76e1d-2fe8-462a-8292-167fda309a13 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:59.848661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09c76e1d-2fe8-462a-8292-167fda309a13 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:47:59.849095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09c76e1d-2fe8-462a-8292-167fda309a13 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:47:59.878498 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-09c76e1d-2fe8-462a-8292-167fda309a13 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041566 Sep 14 19:47:59.879073 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 526/1062] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:47:59 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:59.966672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9dc077ad-69ec-4988-a85a-a37b0010fb2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:47:59.974371 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9dc077ad-69ec-4988-a85a-a37b0010fb2c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.147301 Sep 14 19:47:59.974970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 537/1063] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:47:59 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:00.128500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-aab91604-5d79-45be-9d2f-098c9cf85846 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:00.129772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-aab91604-5d79-45be-9d2f-098c9cf85846 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:00.136793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aab91604-5d79-45be-9d2f-098c9cf85846 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:00.137227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aab91604-5d79-45be-9d2f-098c9cf85846 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:00.138033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aab91604-5d79-45be-9d2f-098c9cf85846 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:00.138470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aab91604-5d79-45be-9d2f-098c9cf85846 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:00.166880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-aab91604-5d79-45be-9d2f-098c9cf85846 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042104 Sep 14 19:48:00.167434 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 527/1064] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:00 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:00.638201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cb8a145d-814c-4791-8453-b853a3711f51 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:00.639144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cb8a145d-814c-4791-8453-b853a3711f51 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:00.647004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb8a145d-814c-4791-8453-b853a3711f51 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:00.647458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb8a145d-814c-4791-8453-b853a3711f51 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:00.648621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb8a145d-814c-4791-8453-b853a3711f51 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:00.649181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb8a145d-814c-4791-8453-b853a3711f51 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:00.679279 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cb8a145d-814c-4791-8453-b853a3711f51 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045145 Sep 14 19:48:00.679839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 538/1065] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:00 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:00.890270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8eae84ee-4f6d-4387-84f5-478d4abbee31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:00.891214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8eae84ee-4f6d-4387-84f5-478d4abbee31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:00.897120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8eae84ee-4f6d-4387-84f5-478d4abbee31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:00.897604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8eae84ee-4f6d-4387-84f5-478d4abbee31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:00.898378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8eae84ee-4f6d-4387-84f5-478d4abbee31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:00.898814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8eae84ee-4f6d-4387-84f5-478d4abbee31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:00.932030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8eae84ee-4f6d-4387-84f5-478d4abbee31 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Sep 14 19:48:00.932666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 528/1066] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:00 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:00.991034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1f99cef3-df62-4aec-bc7c-4f3b458f97eb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:00.991654 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1f99cef3-df62-4aec-bc7c-4f3b458f97eb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:00.997463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f99cef3-df62-4aec-bc7c-4f3b458f97eb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:00.997933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f99cef3-df62-4aec-bc7c-4f3b458f97eb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:00.998693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f99cef3-df62-4aec-bc7c-4f3b458f97eb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:00.999122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f99cef3-df62-4aec-bc7c-4f3b458f97eb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:01.119716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1f99cef3-df62-4aec-bc7c-4f3b458f97eb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:01.127487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1f99cef3-df62-4aec-bc7c-4f3b458f97eb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140100 Sep 14 19:48:01.128041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 539/1067] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:00 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:01.179274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-af8b5590-3452-48c0-9db9-62923de6ab23 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:01.180126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-af8b5590-3452-48c0-9db9-62923de6ab23 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:01.186717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-af8b5590-3452-48c0-9db9-62923de6ab23 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:01.187164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-af8b5590-3452-48c0-9db9-62923de6ab23 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:01.187955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-af8b5590-3452-48c0-9db9-62923de6ab23 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:01.188396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-af8b5590-3452-48c0-9db9-62923de6ab23 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:01.217763 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-af8b5590-3452-48c0-9db9-62923de6ab23 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042494 Sep 14 19:48:01.218324 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 529/1068] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:01 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:01.691567 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-92e07972-e17c-4851-8a1f-c8afbb1d9b12 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:01.692549 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-92e07972-e17c-4851-8a1f-c8afbb1d9b12 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:01.698705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-92e07972-e17c-4851-8a1f-c8afbb1d9b12 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:01.699160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-92e07972-e17c-4851-8a1f-c8afbb1d9b12 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:01.699937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-92e07972-e17c-4851-8a1f-c8afbb1d9b12 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:01.700402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-92e07972-e17c-4851-8a1f-c8afbb1d9b12 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:01.728532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-92e07972-e17c-4851-8a1f-c8afbb1d9b12 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040799 Sep 14 19:48:01.729071 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 540/1069] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:01 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:01.943840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-032d4c53-0449-4514-a50f-43b4a1c1b4b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:01.944667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-032d4c53-0449-4514-a50f-43b4a1c1b4b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:01.950722 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-032d4c53-0449-4514-a50f-43b4a1c1b4b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:01.951890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-032d4c53-0449-4514-a50f-43b4a1c1b4b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:01.952740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-032d4c53-0449-4514-a50f-43b4a1c1b4b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:01.953239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-032d4c53-0449-4514-a50f-43b4a1c1b4b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:01.982014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-032d4c53-0449-4514-a50f-43b4a1c1b4b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042023 Sep 14 19:48:01.983249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 530/1070] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:01 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:02.144510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-65a68d15-ab8c-434d-8317-83867d076ce9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:02.145117 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-65a68d15-ab8c-434d-8317-83867d076ce9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:02.151332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65a68d15-ab8c-434d-8317-83867d076ce9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:02.151780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65a68d15-ab8c-434d-8317-83867d076ce9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:02.152540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65a68d15-ab8c-434d-8317-83867d076ce9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:02.152992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65a68d15-ab8c-434d-8317-83867d076ce9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:02.228996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5ae26bac-a665-4c5a-93c6-bd4118aed125 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:02.229933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5ae26bac-a665-4c5a-93c6-bd4118aed125 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:02.236355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ae26bac-a665-4c5a-93c6-bd4118aed125 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:02.236799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ae26bac-a665-4c5a-93c6-bd4118aed125 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:02.237591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ae26bac-a665-4c5a-93c6-bd4118aed125 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:02.238028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ae26bac-a665-4c5a-93c6-bd4118aed125 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:02.269529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5ae26bac-a665-4c5a-93c6-bd4118aed125 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Sep 14 19:48:02.270116 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 531/1071] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:02 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:02.277070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-65a68d15-ab8c-434d-8317-83867d076ce9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:02.284783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-65a68d15-ab8c-434d-8317-83867d076ce9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.144123 Sep 14 19:48:02.285342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 541/1072] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:02 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:02.740137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c5949be7-b7f6-406e-8cf1-90108fdee78c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:02.741058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c5949be7-b7f6-406e-8cf1-90108fdee78c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:02.746948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5949be7-b7f6-406e-8cf1-90108fdee78c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:02.747396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5949be7-b7f6-406e-8cf1-90108fdee78c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:02.748161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5949be7-b7f6-406e-8cf1-90108fdee78c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:02.748597 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5949be7-b7f6-406e-8cf1-90108fdee78c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:02.777961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c5949be7-b7f6-406e-8cf1-90108fdee78c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041539 Sep 14 19:48:02.778526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 532/1073] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:02 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:02.995716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8c622320-e57e-43df-aec4-043ab48b44ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:02.996568 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8c622320-e57e-43df-aec4-043ab48b44ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:03.003287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c622320-e57e-43df-aec4-043ab48b44ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:03.003802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c622320-e57e-43df-aec4-043ab48b44ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:03.004590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c622320-e57e-43df-aec4-043ab48b44ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:03.005066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c622320-e57e-43df-aec4-043ab48b44ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:03.035073 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8c622320-e57e-43df-aec4-043ab48b44ed tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 Sep 14 19:48:03.035640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 542/1074] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:02 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:03.281261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-06628f4f-b608-4516-b3b6-49b8b4ad7c64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:03.282111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-06628f4f-b608-4516-b3b6-49b8b4ad7c64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:03.288431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06628f4f-b608-4516-b3b6-49b8b4ad7c64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:03.288887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06628f4f-b608-4516-b3b6-49b8b4ad7c64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:03.289863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06628f4f-b608-4516-b3b6-49b8b4ad7c64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:03.290409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06628f4f-b608-4516-b3b6-49b8b4ad7c64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:03.301719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9f574ce2-fb94-4908-9a77-5ee66927bd99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:03.302484 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9f574ce2-fb94-4908-9a77-5ee66927bd99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:03.308490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f574ce2-fb94-4908-9a77-5ee66927bd99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:03.308938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f574ce2-fb94-4908-9a77-5ee66927bd99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:03.309782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f574ce2-fb94-4908-9a77-5ee66927bd99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:03.310203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f574ce2-fb94-4908-9a77-5ee66927bd99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:03.321676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-06628f4f-b608-4516-b3b6-49b8b4ad7c64 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Sep 14 19:48:03.322267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 533/1075] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:03 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:03.436114 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9f574ce2-fb94-4908-9a77-5ee66927bd99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:03.443724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9f574ce2-fb94-4908-9a77-5ee66927bd99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.145939 Sep 14 19:48:03.444301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 543/1076] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:03 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:48:03.790126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-371091de-2451-4566-af2a-f1e91626e124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:03.791016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-371091de-2451-4566-af2a-f1e91626e124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:03.797879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-371091de-2451-4566-af2a-f1e91626e124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:03.798315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-371091de-2451-4566-af2a-f1e91626e124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:03.799088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-371091de-2451-4566-af2a-f1e91626e124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:03.799518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-371091de-2451-4566-af2a-f1e91626e124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:03.827685 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-371091de-2451-4566-af2a-f1e91626e124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041322 Sep 14 19:48:03.828232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 534/1077] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:04.046330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-49cb7eca-9924-4f69-9026-c2e11020cfd3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:04.047988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-49cb7eca-9924-4f69-9026-c2e11020cfd3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:04.053987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49cb7eca-9924-4f69-9026-c2e11020cfd3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:04.054450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49cb7eca-9924-4f69-9026-c2e11020cfd3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:04.055237 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49cb7eca-9924-4f69-9026-c2e11020cfd3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:04.055682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49cb7eca-9924-4f69-9026-c2e11020cfd3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:04.085238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-49cb7eca-9924-4f69-9026-c2e11020cfd3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042778 Sep 14 19:48:04.085867 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 544/1078] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:04 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:04.333234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8c356ad1-8ad9-49b1-a37e-9437efdf2ab5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:04.334191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8c356ad1-8ad9-49b1-a37e-9437efdf2ab5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:04.340225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c356ad1-8ad9-49b1-a37e-9437efdf2ab5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:04.340667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c356ad1-8ad9-49b1-a37e-9437efdf2ab5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:04.341436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c356ad1-8ad9-49b1-a37e-9437efdf2ab5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:04.341897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c356ad1-8ad9-49b1-a37e-9437efdf2ab5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:04.371695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8c356ad1-8ad9-49b1-a37e-9437efdf2ab5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042320 Sep 14 19:48:04.372242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 535/1079] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:04 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:04.460526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a6869cb7-5742-4edb-89df-a4cbc8ee4bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:04.461153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a6869cb7-5742-4edb-89df-a4cbc8ee4bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:04.467020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6869cb7-5742-4edb-89df-a4cbc8ee4bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:04.467474 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6869cb7-5742-4edb-89df-a4cbc8ee4bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:04.468219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6869cb7-5742-4edb-89df-a4cbc8ee4bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:04.469138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6869cb7-5742-4edb-89df-a4cbc8ee4bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:04.589706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a6869cb7-5742-4edb-89df-a4cbc8ee4bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:04.597576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a6869cb7-5742-4edb-89df-a4cbc8ee4bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140711 Sep 14 19:48:04.598174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 545/1080] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:04 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:04.839313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-45eeaf2e-b456-4c77-8b43-a91e0e6caded tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:04.840223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-45eeaf2e-b456-4c77-8b43-a91e0e6caded tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:04.846754 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-45eeaf2e-b456-4c77-8b43-a91e0e6caded tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:04.847204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-45eeaf2e-b456-4c77-8b43-a91e0e6caded tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:04.847979 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-45eeaf2e-b456-4c77-8b43-a91e0e6caded tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:04.848416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-45eeaf2e-b456-4c77-8b43-a91e0e6caded tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:04.876990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-45eeaf2e-b456-4c77-8b43-a91e0e6caded tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041512 Sep 14 19:48:04.877561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 536/1081] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:04 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:48:05.096716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c2dde3db-e89c-4994-9626-3d06ccec2899 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:05.097561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c2dde3db-e89c-4994-9626-3d06ccec2899 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:05.103364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c2dde3db-e89c-4994-9626-3d06ccec2899 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:05.103843 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c2dde3db-e89c-4994-9626-3d06ccec2899 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:05.104617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c2dde3db-e89c-4994-9626-3d06ccec2899 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:05.105046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c2dde3db-e89c-4994-9626-3d06ccec2899 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:05.133059 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c2dde3db-e89c-4994-9626-3d06ccec2899 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040806 Sep 14 19:48:05.133628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 546/1082] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:05 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:05.384499 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9e2feb91-152f-4be5-ac7e-61b99ba229af tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:05.385407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9e2feb91-152f-4be5-ac7e-61b99ba229af tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:05.393583 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2feb91-152f-4be5-ac7e-61b99ba229af tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:05.394028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2feb91-152f-4be5-ac7e-61b99ba229af tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:05.394790 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2feb91-152f-4be5-ac7e-61b99ba229af tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:05.395220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2feb91-152f-4be5-ac7e-61b99ba229af tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:05.425459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9e2feb91-152f-4be5-ac7e-61b99ba229af tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044746 Sep 14 19:48:05.426051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 537/1083] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:05 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:05.614729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-76cb1003-a161-4eef-98fc-06bce4cfbc14 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:05.615336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-76cb1003-a161-4eef-98fc-06bce4cfbc14 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:05.621250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76cb1003-a161-4eef-98fc-06bce4cfbc14 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:05.621736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76cb1003-a161-4eef-98fc-06bce4cfbc14 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:05.622506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76cb1003-a161-4eef-98fc-06bce4cfbc14 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:05.622939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76cb1003-a161-4eef-98fc-06bce4cfbc14 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:05.743558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-76cb1003-a161-4eef-98fc-06bce4cfbc14 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:05.751865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-76cb1003-a161-4eef-98fc-06bce4cfbc14 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140782 Sep 14 19:48:05.752462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 547/1084] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:05 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:05.888158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f8d85597-9064-44ff-802e-303233887a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:05.889042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f8d85597-9064-44ff-802e-303233887a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:05.894826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8d85597-9064-44ff-802e-303233887a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:05.895267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8d85597-9064-44ff-802e-303233887a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:05.896017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8d85597-9064-44ff-802e-303233887a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:05.896449 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8d85597-9064-44ff-802e-303233887a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:05.924822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f8d85597-9064-44ff-802e-303233887a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040411 Sep 14 19:48:05.925361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 538/1085] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:05 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:06.144412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d973b5d7-f586-488d-b5e5-7be9693847df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:06.145339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d973b5d7-f586-488d-b5e5-7be9693847df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:06.151143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d973b5d7-f586-488d-b5e5-7be9693847df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:06.151589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d973b5d7-f586-488d-b5e5-7be9693847df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:06.152352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d973b5d7-f586-488d-b5e5-7be9693847df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:06.152784 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d973b5d7-f586-488d-b5e5-7be9693847df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:06.183075 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d973b5d7-f586-488d-b5e5-7be9693847df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042369 Sep 14 19:48:06.183634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 548/1086] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:06 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:06.437149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-781921b0-0c15-43ec-8172-e8f8355c975e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:06.438002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-781921b0-0c15-43ec-8172-e8f8355c975e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:06.443878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-781921b0-0c15-43ec-8172-e8f8355c975e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:06.444325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-781921b0-0c15-43ec-8172-e8f8355c975e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:06.445083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-781921b0-0c15-43ec-8172-e8f8355c975e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:06.445542 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-781921b0-0c15-43ec-8172-e8f8355c975e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:06.474642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-781921b0-0c15-43ec-8172-e8f8355c975e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041272 Sep 14 19:48:06.475197 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 539/1087] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:06 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:06.769674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9c063d2b-b6fd-4e02-9f7f-d81e3fff85c6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:06.770209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9c063d2b-b6fd-4e02-9f7f-d81e3fff85c6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:06.776239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c063d2b-b6fd-4e02-9f7f-d81e3fff85c6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:06.776711 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c063d2b-b6fd-4e02-9f7f-d81e3fff85c6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:06.777481 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c063d2b-b6fd-4e02-9f7f-d81e3fff85c6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:06.777944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c063d2b-b6fd-4e02-9f7f-d81e3fff85c6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:06.902396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9c063d2b-b6fd-4e02-9f7f-d81e3fff85c6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:06.910204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9c063d2b-b6fd-4e02-9f7f-d81e3fff85c6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.145254 Sep 14 19:48:06.910786 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 549/1088] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:06 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:06.936012 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-32860c5b-cad0-431e-a2a6-15d8aa20b8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:06.936917 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-32860c5b-cad0-431e-a2a6-15d8aa20b8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:06.942780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32860c5b-cad0-431e-a2a6-15d8aa20b8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:06.943229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32860c5b-cad0-431e-a2a6-15d8aa20b8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:06.943990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32860c5b-cad0-431e-a2a6-15d8aa20b8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:06.944424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32860c5b-cad0-431e-a2a6-15d8aa20b8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:06.972899 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-32860c5b-cad0-431e-a2a6-15d8aa20b8e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040585 Sep 14 19:48:06.973544 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 540/1089] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:06 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:07.194566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6d85f6cf-8671-4f8b-88dc-552c6546fe4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:07.195461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6d85f6cf-8671-4f8b-88dc-552c6546fe4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:07.201350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d85f6cf-8671-4f8b-88dc-552c6546fe4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:07.201825 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d85f6cf-8671-4f8b-88dc-552c6546fe4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:07.202583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d85f6cf-8671-4f8b-88dc-552c6546fe4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:07.203012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d85f6cf-8671-4f8b-88dc-552c6546fe4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:07.233079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6d85f6cf-8671-4f8b-88dc-552c6546fe4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042247 Sep 14 19:48:07.233672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 550/1090] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:07 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:07.486007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e2db2f61-17d4-416c-a9b7-3b83e86df452 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:07.486932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e2db2f61-17d4-416c-a9b7-3b83e86df452 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:07.492716 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e2db2f61-17d4-416c-a9b7-3b83e86df452 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:07.493200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e2db2f61-17d4-416c-a9b7-3b83e86df452 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:07.493939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e2db2f61-17d4-416c-a9b7-3b83e86df452 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:07.494366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e2db2f61-17d4-416c-a9b7-3b83e86df452 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:07.523304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e2db2f61-17d4-416c-a9b7-3b83e86df452 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040986 Sep 14 19:48:07.523857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 541/1091] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:07 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:07.927365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9e73b06d-7b11-4df2-85e4-20f435f2ddbb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:07.927978 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9e73b06d-7b11-4df2-85e4-20f435f2ddbb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:07.933785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e73b06d-7b11-4df2-85e4-20f435f2ddbb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:07.934244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e73b06d-7b11-4df2-85e4-20f435f2ddbb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:07.935011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e73b06d-7b11-4df2-85e4-20f435f2ddbb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:07.935474 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e73b06d-7b11-4df2-85e4-20f435f2ddbb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:07.984400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-635ceebb-e176-4228-adb0-5b9c59355a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:07.985353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-635ceebb-e176-4228-adb0-5b9c59355a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:07.991336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-635ceebb-e176-4228-adb0-5b9c59355a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:07.991791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-635ceebb-e176-4228-adb0-5b9c59355a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:07.992564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-635ceebb-e176-4228-adb0-5b9c59355a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:07.993001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-635ceebb-e176-4228-adb0-5b9c59355a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:08.024783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-635ceebb-e176-4228-adb0-5b9c59355a19 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044118 Sep 14 19:48:08.025511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 542/1092] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:07 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:48:08.058008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9e73b06d-7b11-4df2-85e4-20f435f2ddbb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:08.065531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9e73b06d-7b11-4df2-85e4-20f435f2ddbb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.141846 Sep 14 19:48:08.066090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 551/1093] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:07 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:08.244401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5c31bda8-e7ac-413f-87e3-457611ba797c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:08.245313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5c31bda8-e7ac-413f-87e3-457611ba797c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:08.251802 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c31bda8-e7ac-413f-87e3-457611ba797c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:08.252247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c31bda8-e7ac-413f-87e3-457611ba797c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:08.253005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c31bda8-e7ac-413f-87e3-457611ba797c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:08.253439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c31bda8-e7ac-413f-87e3-457611ba797c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:08.282566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5c31bda8-e7ac-413f-87e3-457611ba797c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041830 Sep 14 19:48:08.283135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 543/1094] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:08 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:08.534924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3e5672c3-8ce5-4adf-9c53-3a912654e1c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:08.535813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3e5672c3-8ce5-4adf-9c53-3a912654e1c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:08.541922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3e5672c3-8ce5-4adf-9c53-3a912654e1c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:08.542378 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3e5672c3-8ce5-4adf-9c53-3a912654e1c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:08.543162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3e5672c3-8ce5-4adf-9c53-3a912654e1c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:08.543598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3e5672c3-8ce5-4adf-9c53-3a912654e1c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:08.573431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3e5672c3-8ce5-4adf-9c53-3a912654e1c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 Sep 14 19:48:08.574014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 552/1095] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:08 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:09.037364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-11ff0289-0fd4-47f6-a640-e3ac8521995a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:09.038284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-11ff0289-0fd4-47f6-a640-e3ac8521995a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:09.044204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11ff0289-0fd4-47f6-a640-e3ac8521995a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:09.044653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11ff0289-0fd4-47f6-a640-e3ac8521995a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:09.045419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11ff0289-0fd4-47f6-a640-e3ac8521995a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:09.045885 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11ff0289-0fd4-47f6-a640-e3ac8521995a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:09.074886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-11ff0289-0fd4-47f6-a640-e3ac8521995a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041571 Sep 14 19:48:09.075435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 544/1096] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:09.082260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-895aee9b-84d9-4433-ac7b-62c0a86b641b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:09.082870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-895aee9b-84d9-4433-ac7b-62c0a86b641b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:09.088692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-895aee9b-84d9-4433-ac7b-62c0a86b641b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:09.089058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-895aee9b-84d9-4433-ac7b-62c0a86b641b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:09.089850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-895aee9b-84d9-4433-ac7b-62c0a86b641b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:09.090280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-895aee9b-84d9-4433-ac7b-62c0a86b641b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:09.209459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-895aee9b-84d9-4433-ac7b-62c0a86b641b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:09.217129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-895aee9b-84d9-4433-ac7b-62c0a86b641b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138479 Sep 14 19:48:09.217726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 553/1097] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:09 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:09.294464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cc89d081-474c-4ad3-8706-014440c08aa3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:09.295367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cc89d081-474c-4ad3-8706-014440c08aa3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:09.302165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cc89d081-474c-4ad3-8706-014440c08aa3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:09.302615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cc89d081-474c-4ad3-8706-014440c08aa3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:09.303385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cc89d081-474c-4ad3-8706-014440c08aa3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:09.303820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cc89d081-474c-4ad3-8706-014440c08aa3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:09.335766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cc89d081-474c-4ad3-8706-014440c08aa3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Sep 14 19:48:09.336747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 545/1098] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:09 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:09.585289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-28a208b4-4ba5-480a-bb27-ff0153360ee5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:09.586280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-28a208b4-4ba5-480a-bb27-ff0153360ee5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:09.592031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-28a208b4-4ba5-480a-bb27-ff0153360ee5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:09.592468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-28a208b4-4ba5-480a-bb27-ff0153360ee5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:09.593224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-28a208b4-4ba5-480a-bb27-ff0153360ee5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:09.593687 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-28a208b4-4ba5-480a-bb27-ff0153360ee5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:09.621789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-28a208b4-4ba5-480a-bb27-ff0153360ee5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040185 Sep 14 19:48:09.622324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 554/1099] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:09 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:10.086679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a3754dee-b6fa-4d4e-bb6e-7b8cdbd95983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:10.087569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a3754dee-b6fa-4d4e-bb6e-7b8cdbd95983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:10.093652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a3754dee-b6fa-4d4e-bb6e-7b8cdbd95983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:10.094033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a3754dee-b6fa-4d4e-bb6e-7b8cdbd95983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:10.094809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a3754dee-b6fa-4d4e-bb6e-7b8cdbd95983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:10.095237 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a3754dee-b6fa-4d4e-bb6e-7b8cdbd95983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:10.124017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a3754dee-b6fa-4d4e-bb6e-7b8cdbd95983 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041180 Sep 14 19:48:10.124746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 546/1100] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:10.233979 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f6139f19-bd2b-4f36-9774-ed489542ff01 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:10.235066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f6139f19-bd2b-4f36-9774-ed489542ff01 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:10.240721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6139f19-bd2b-4f36-9774-ed489542ff01 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:10.241718 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6139f19-bd2b-4f36-9774-ed489542ff01 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:10.241939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6139f19-bd2b-4f36-9774-ed489542ff01 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:10.242366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6139f19-bd2b-4f36-9774-ed489542ff01 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:10.347750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-929f753e-db02-48ec-b5b3-c1f4dbcd3bb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:10.348582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-929f753e-db02-48ec-b5b3-c1f4dbcd3bb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:10.354552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-929f753e-db02-48ec-b5b3-c1f4dbcd3bb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:10.354995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-929f753e-db02-48ec-b5b3-c1f4dbcd3bb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:10.355789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-929f753e-db02-48ec-b5b3-c1f4dbcd3bb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:10.356221 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-929f753e-db02-48ec-b5b3-c1f4dbcd3bb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:10.367437 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f6139f19-bd2b-4f36-9774-ed489542ff01 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:10.374909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f6139f19-bd2b-4f36-9774-ed489542ff01 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.144524 Sep 14 19:48:10.376156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 555/1101] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:10 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:48:10.389650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-929f753e-db02-48ec-b5b3-c1f4dbcd3bb4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 Sep 14 19:48:10.390238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 547/1102] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:10 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:10.633354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e7db9e43-2cad-4c23-8b3a-a7ca6965e0c6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:10.634290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e7db9e43-2cad-4c23-8b3a-a7ca6965e0c6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:10.640191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e7db9e43-2cad-4c23-8b3a-a7ca6965e0c6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:10.640734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e7db9e43-2cad-4c23-8b3a-a7ca6965e0c6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:10.641531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e7db9e43-2cad-4c23-8b3a-a7ca6965e0c6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:10.642026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e7db9e43-2cad-4c23-8b3a-a7ca6965e0c6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:10.673089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e7db9e43-2cad-4c23-8b3a-a7ca6965e0c6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042567 Sep 14 19:48:10.673667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 556/1103] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:10 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:11.136281 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a13d85ab-141e-48df-ac3e-a3f81ed74e7f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:11.137192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a13d85ab-141e-48df-ac3e-a3f81ed74e7f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:11.143559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a13d85ab-141e-48df-ac3e-a3f81ed74e7f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:11.143999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a13d85ab-141e-48df-ac3e-a3f81ed74e7f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:11.144765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a13d85ab-141e-48df-ac3e-a3f81ed74e7f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:11.145199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a13d85ab-141e-48df-ac3e-a3f81ed74e7f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:11.174438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a13d85ab-141e-48df-ac3e-a3f81ed74e7f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041977 Sep 14 19:48:11.175000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 548/1104] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:11 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:11.393084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-917ee3d1-384a-4ff9-b1c2-6118572fec27 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:11.393641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-917ee3d1-384a-4ff9-b1c2-6118572fec27 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:11.399798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-917ee3d1-384a-4ff9-b1c2-6118572fec27 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:11.399980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8381a182-4304-495f-82d2-5f941df7910b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:11.400250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-917ee3d1-384a-4ff9-b1c2-6118572fec27 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:11.400796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8381a182-4304-495f-82d2-5f941df7910b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:11.401027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-917ee3d1-384a-4ff9-b1c2-6118572fec27 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:11.401466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-917ee3d1-384a-4ff9-b1c2-6118572fec27 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:11.406518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8381a182-4304-495f-82d2-5f941df7910b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:11.406967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8381a182-4304-495f-82d2-5f941df7910b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:11.407727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8381a182-4304-495f-82d2-5f941df7910b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:11.408162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8381a182-4304-495f-82d2-5f941df7910b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:11.436822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8381a182-4304-495f-82d2-5f941df7910b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040557 Sep 14 19:48:11.438034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 549/1105] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:11.520639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-917ee3d1-384a-4ff9-b1c2-6118572fec27 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:11.528304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-917ee3d1-384a-4ff9-b1c2-6118572fec27 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.139639 Sep 14 19:48:11.528862 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 557/1106] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:11 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:11.684700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-efb60f3b-5289-4a8a-9ff4-9252319efb02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:11.685603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-efb60f3b-5289-4a8a-9ff4-9252319efb02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:11.692131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efb60f3b-5289-4a8a-9ff4-9252319efb02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:11.692613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efb60f3b-5289-4a8a-9ff4-9252319efb02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:11.693420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efb60f3b-5289-4a8a-9ff4-9252319efb02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:11.693932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efb60f3b-5289-4a8a-9ff4-9252319efb02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:11.722069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-efb60f3b-5289-4a8a-9ff4-9252319efb02 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041402 Sep 14 19:48:11.722634 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 550/1107] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:11 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:12.185196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0ee3f30f-83cb-4025-aadd-76e4522b6356 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:12.186136 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0ee3f30f-83cb-4025-aadd-76e4522b6356 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:12.192472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ee3f30f-83cb-4025-aadd-76e4522b6356 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:12.192922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ee3f30f-83cb-4025-aadd-76e4522b6356 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:12.193727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ee3f30f-83cb-4025-aadd-76e4522b6356 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:12.194169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ee3f30f-83cb-4025-aadd-76e4522b6356 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:12.222606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0ee3f30f-83cb-4025-aadd-76e4522b6356 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041217 Sep 14 19:48:12.223151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 558/1108] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:12 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:12.448652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9b559b00-2855-417e-9ce6-c24d4f8f340c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:12.449467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9b559b00-2855-417e-9ce6-c24d4f8f340c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:12.455364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b559b00-2855-417e-9ce6-c24d4f8f340c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:12.455804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b559b00-2855-417e-9ce6-c24d4f8f340c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:12.456563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b559b00-2855-417e-9ce6-c24d4f8f340c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:12.456989 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b559b00-2855-417e-9ce6-c24d4f8f340c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:12.486240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9b559b00-2855-417e-9ce6-c24d4f8f340c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041327 Sep 14 19:48:12.486887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 551/1109] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:12 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:12.545042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-773200fa-8156-41a8-87a3-0e4e6ac66862 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:12.545670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-773200fa-8156-41a8-87a3-0e4e6ac66862 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:12.552178 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-773200fa-8156-41a8-87a3-0e4e6ac66862 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:12.552613 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-773200fa-8156-41a8-87a3-0e4e6ac66862 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:12.553365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-773200fa-8156-41a8-87a3-0e4e6ac66862 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:12.553820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-773200fa-8156-41a8-87a3-0e4e6ac66862 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:12.670823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-773200fa-8156-41a8-87a3-0e4e6ac66862 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:12.678331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-773200fa-8156-41a8-87a3-0e4e6ac66862 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.136966 Sep 14 19:48:12.678895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 559/1110] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:12 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:12.733170 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f11a3ed1-db41-4a1d-b133-91af172b899e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:12.734018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f11a3ed1-db41-4a1d-b133-91af172b899e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:12.739775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f11a3ed1-db41-4a1d-b133-91af172b899e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:12.740211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f11a3ed1-db41-4a1d-b133-91af172b899e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:12.740955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f11a3ed1-db41-4a1d-b133-91af172b899e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:12.741380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f11a3ed1-db41-4a1d-b133-91af172b899e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:12.769965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f11a3ed1-db41-4a1d-b133-91af172b899e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040514 Sep 14 19:48:12.770510 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 552/1111] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:12 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:13.234804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bf31da9d-f960-4574-a726-ec353d5475d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:13.235738 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bf31da9d-f960-4574-a726-ec353d5475d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:13.241797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bf31da9d-f960-4574-a726-ec353d5475d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:13.242239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bf31da9d-f960-4574-a726-ec353d5475d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:13.242999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bf31da9d-f960-4574-a726-ec353d5475d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:13.243428 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bf31da9d-f960-4574-a726-ec353d5475d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:13.272352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bf31da9d-f960-4574-a726-ec353d5475d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041986 Sep 14 19:48:13.272916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 560/1112] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:13.497413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-70774b34-44e2-4554-bbfd-4d9d9dde2e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:13.498315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-70774b34-44e2-4554-bbfd-4d9d9dde2e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:13.504386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70774b34-44e2-4554-bbfd-4d9d9dde2e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:13.504824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70774b34-44e2-4554-bbfd-4d9d9dde2e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:13.505608 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70774b34-44e2-4554-bbfd-4d9d9dde2e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:13.506039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-70774b34-44e2-4554-bbfd-4d9d9dde2e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:13.534195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-70774b34-44e2-4554-bbfd-4d9d9dde2e88 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040592 Sep 14 19:48:13.534747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 553/1113] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:13 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:13.695850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-efadd884-4688-4166-b243-e125cc8cc5f5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:13.696464 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-efadd884-4688-4166-b243-e125cc8cc5f5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:13.702473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efadd884-4688-4166-b243-e125cc8cc5f5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:13.702928 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efadd884-4688-4166-b243-e125cc8cc5f5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:13.704343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efadd884-4688-4166-b243-e125cc8cc5f5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:13.705124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efadd884-4688-4166-b243-e125cc8cc5f5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:13.781888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8b301098-9d70-4556-8ea6-95859ac8be47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:13.782728 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8b301098-9d70-4556-8ea6-95859ac8be47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:13.788443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8b301098-9d70-4556-8ea6-95859ac8be47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:13.788893 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8b301098-9d70-4556-8ea6-95859ac8be47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:13.789694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8b301098-9d70-4556-8ea6-95859ac8be47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:13.790131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8b301098-9d70-4556-8ea6-95859ac8be47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:13.820976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8b301098-9d70-4556-8ea6-95859ac8be47 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043436 Sep 14 19:48:13.821561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 554/1114] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:13 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:13.829091 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-efadd884-4688-4166-b243-e125cc8cc5f5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:13.836768 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-efadd884-4688-4166-b243-e125cc8cc5f5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.144596 Sep 14 19:48:13.837348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 561/1115] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:13 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:14.284141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8ceaf0be-0eab-4fc0-a0fa-8725c818d051 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:14.285184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8ceaf0be-0eab-4fc0-a0fa-8725c818d051 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:14.291076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ceaf0be-0eab-4fc0-a0fa-8725c818d051 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:14.291520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ceaf0be-0eab-4fc0-a0fa-8725c818d051 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:14.292290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ceaf0be-0eab-4fc0-a0fa-8725c818d051 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:14.292730 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ceaf0be-0eab-4fc0-a0fa-8725c818d051 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:14.322318 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8ceaf0be-0eab-4fc0-a0fa-8725c818d051 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042068 Sep 14 19:48:14.322878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 555/1116] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:14 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:14.544926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ecb44bba-ec3f-4f9b-8579-26f1be5ca6ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:14.545798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ecb44bba-ec3f-4f9b-8579-26f1be5ca6ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:14.552580 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ecb44bba-ec3f-4f9b-8579-26f1be5ca6ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:14.553019 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ecb44bba-ec3f-4f9b-8579-26f1be5ca6ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:14.553812 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ecb44bba-ec3f-4f9b-8579-26f1be5ca6ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:14.554238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ecb44bba-ec3f-4f9b-8579-26f1be5ca6ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:14.582978 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ecb44bba-ec3f-4f9b-8579-26f1be5ca6ac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 Sep 14 19:48:14.583542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 562/1117] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:14 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:14.832304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-575b0577-f730-4e1e-ba14-a7689252b4ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:14.833135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-575b0577-f730-4e1e-ba14-a7689252b4ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:14.839367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-575b0577-f730-4e1e-ba14-a7689252b4ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:14.839816 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-575b0577-f730-4e1e-ba14-a7689252b4ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:14.840632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-575b0577-f730-4e1e-ba14-a7689252b4ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:14.841065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-575b0577-f730-4e1e-ba14-a7689252b4ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:14.854155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d3642d40-b35c-43d1-b8ec-9f5f14a21343 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:14.854772 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d3642d40-b35c-43d1-b8ec-9f5f14a21343 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:14.860924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3642d40-b35c-43d1-b8ec-9f5f14a21343 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:14.861366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3642d40-b35c-43d1-b8ec-9f5f14a21343 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:14.862162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3642d40-b35c-43d1-b8ec-9f5f14a21343 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:14.862620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3642d40-b35c-43d1-b8ec-9f5f14a21343 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:14.870636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-575b0577-f730-4e1e-ba14-a7689252b4ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042180 Sep 14 19:48:14.871504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 556/1118] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:14 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:14.982296 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d3642d40-b35c-43d1-b8ec-9f5f14a21343 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:14.990207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d3642d40-b35c-43d1-b8ec-9f5f14a21343 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.139723 Sep 14 19:48:14.990789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 563/1119] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:14 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:48:15.334582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d5abd3fe-26ff-4fd2-8d40-6eb517a3c2b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:15.335508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d5abd3fe-26ff-4fd2-8d40-6eb517a3c2b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:15.341301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d5abd3fe-26ff-4fd2-8d40-6eb517a3c2b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:15.341770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d5abd3fe-26ff-4fd2-8d40-6eb517a3c2b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:15.342526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d5abd3fe-26ff-4fd2-8d40-6eb517a3c2b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:15.342951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d5abd3fe-26ff-4fd2-8d40-6eb517a3c2b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:15.371117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d5abd3fe-26ff-4fd2-8d40-6eb517a3c2b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040412 Sep 14 19:48:15.371668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 557/1120] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:15 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:15.595078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-29f04839-3275-498b-8980-e12cf2814d33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:15.595902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-29f04839-3275-498b-8980-e12cf2814d33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:15.602505 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29f04839-3275-498b-8980-e12cf2814d33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:15.602949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29f04839-3275-498b-8980-e12cf2814d33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:15.603709 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29f04839-3275-498b-8980-e12cf2814d33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:15.604137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29f04839-3275-498b-8980-e12cf2814d33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:15.632461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-29f04839-3275-498b-8980-e12cf2814d33 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041745 Sep 14 19:48:15.633012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 564/1121] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:15 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:15.882269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0ab7b612-0b30-4d69-9d0c-ba8c94afda49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:15.883209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0ab7b612-0b30-4d69-9d0c-ba8c94afda49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:15.889118 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ab7b612-0b30-4d69-9d0c-ba8c94afda49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:15.889591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ab7b612-0b30-4d69-9d0c-ba8c94afda49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:15.890384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ab7b612-0b30-4d69-9d0c-ba8c94afda49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:15.891359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ab7b612-0b30-4d69-9d0c-ba8c94afda49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:15.919410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0ab7b612-0b30-4d69-9d0c-ba8c94afda49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041123 Sep 14 19:48:15.919960 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 558/1122] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:15 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:16.010138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f57d7dfd-cf64-4ecc-8644-b320d7527daf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:16.010745 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f57d7dfd-cf64-4ecc-8644-b320d7527daf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:16.017700 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f57d7dfd-cf64-4ecc-8644-b320d7527daf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:16.018150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f57d7dfd-cf64-4ecc-8644-b320d7527daf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:16.018933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f57d7dfd-cf64-4ecc-8644-b320d7527daf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:16.019365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f57d7dfd-cf64-4ecc-8644-b320d7527daf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:16.138949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f57d7dfd-cf64-4ecc-8644-b320d7527daf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:16.146122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f57d7dfd-cf64-4ecc-8644-b320d7527daf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.139621 Sep 14 19:48:16.146675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 565/1123] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:16 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:16.382392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dd3ed685-a26e-47ce-835e-e8614f96e9bf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:16.383289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dd3ed685-a26e-47ce-835e-e8614f96e9bf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:16.389280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dd3ed685-a26e-47ce-835e-e8614f96e9bf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:16.389703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dd3ed685-a26e-47ce-835e-e8614f96e9bf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:16.390471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dd3ed685-a26e-47ce-835e-e8614f96e9bf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:16.390900 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dd3ed685-a26e-47ce-835e-e8614f96e9bf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:16.418497 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dd3ed685-a26e-47ce-835e-e8614f96e9bf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039943 Sep 14 19:48:16.419046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 559/1124] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:16 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:16.643543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b70b2fa3-5250-4ad9-81ae-1f24a6eaf0b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:16.644351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b70b2fa3-5250-4ad9-81ae-1f24a6eaf0b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:16.650232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b70b2fa3-5250-4ad9-81ae-1f24a6eaf0b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:16.650685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b70b2fa3-5250-4ad9-81ae-1f24a6eaf0b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:16.651458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b70b2fa3-5250-4ad9-81ae-1f24a6eaf0b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:16.651900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b70b2fa3-5250-4ad9-81ae-1f24a6eaf0b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:16.683227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b70b2fa3-5250-4ad9-81ae-1f24a6eaf0b4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043824 Sep 14 19:48:16.683788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 566/1125] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:16 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:16.931131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d329bca9-8990-41c5-acef-fd6b4dd909fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:16.931999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d329bca9-8990-41c5-acef-fd6b4dd909fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:16.937824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d329bca9-8990-41c5-acef-fd6b4dd909fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:16.938272 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d329bca9-8990-41c5-acef-fd6b4dd909fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:16.939034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d329bca9-8990-41c5-acef-fd6b4dd909fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:16.939471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d329bca9-8990-41c5-acef-fd6b4dd909fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:16.967624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d329bca9-8990-41c5-acef-fd6b4dd909fb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040403 Sep 14 19:48:16.968175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 560/1126] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:16 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:17.162957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b558c2be-cd8c-434a-b2b9-a1f35f83dcb7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:17.163571 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b558c2be-cd8c-434a-b2b9-a1f35f83dcb7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:17.169398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b558c2be-cd8c-434a-b2b9-a1f35f83dcb7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:17.169878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b558c2be-cd8c-434a-b2b9-a1f35f83dcb7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:17.170649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b558c2be-cd8c-434a-b2b9-a1f35f83dcb7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:17.171087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b558c2be-cd8c-434a-b2b9-a1f35f83dcb7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:17.294813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b558c2be-cd8c-434a-b2b9-a1f35f83dcb7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:17.302405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b558c2be-cd8c-434a-b2b9-a1f35f83dcb7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.143049 Sep 14 19:48:17.302969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 567/1127] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:17 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:17.430858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-661cfc44-6ed1-41b6-a8e9-61b3bf8916b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:17.431771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-661cfc44-6ed1-41b6-a8e9-61b3bf8916b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:17.438220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-661cfc44-6ed1-41b6-a8e9-61b3bf8916b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:17.438657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-661cfc44-6ed1-41b6-a8e9-61b3bf8916b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:17.439417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-661cfc44-6ed1-41b6-a8e9-61b3bf8916b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:17.439846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-661cfc44-6ed1-41b6-a8e9-61b3bf8916b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:17.468365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-661cfc44-6ed1-41b6-a8e9-61b3bf8916b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041268 Sep 14 19:48:17.468913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 561/1128] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:17 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:17.694599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c4b4c2fb-9489-489f-83ee-93b2e5f2bfd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:17.695512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c4b4c2fb-9489-489f-83ee-93b2e5f2bfd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:17.701412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4b4c2fb-9489-489f-83ee-93b2e5f2bfd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:17.701890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4b4c2fb-9489-489f-83ee-93b2e5f2bfd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:17.702663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4b4c2fb-9489-489f-83ee-93b2e5f2bfd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:17.703158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4b4c2fb-9489-489f-83ee-93b2e5f2bfd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:17.731781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c4b4c2fb-9489-489f-83ee-93b2e5f2bfd0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040927 Sep 14 19:48:17.732331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 568/1129] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:17 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:17.980004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-efb9ee37-6bf0-4a13-b490-b02e68256cc2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:17.980839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-efb9ee37-6bf0-4a13-b490-b02e68256cc2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:17.987322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efb9ee37-6bf0-4a13-b490-b02e68256cc2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:17.987803 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efb9ee37-6bf0-4a13-b490-b02e68256cc2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:17.988564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efb9ee37-6bf0-4a13-b490-b02e68256cc2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:17.988992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-efb9ee37-6bf0-4a13-b490-b02e68256cc2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:18.018106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-efb9ee37-6bf0-4a13-b490-b02e68256cc2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 Sep 14 19:48:18.018632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 562/1130] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:17 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:18.319147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8ea47e56-b72a-48eb-8853-9046f92d2c63 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:18.319644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8ea47e56-b72a-48eb-8853-9046f92d2c63 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:18.325816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ea47e56-b72a-48eb-8853-9046f92d2c63 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:18.326266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ea47e56-b72a-48eb-8853-9046f92d2c63 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:18.327040 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ea47e56-b72a-48eb-8853-9046f92d2c63 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:18.327493 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ea47e56-b72a-48eb-8853-9046f92d2c63 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:18.449986 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8ea47e56-b72a-48eb-8853-9046f92d2c63 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:18.458457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8ea47e56-b72a-48eb-8853-9046f92d2c63 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.143068 Sep 14 19:48:18.459019 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 569/1131] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:18 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:18.483814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-08689a97-866e-458a-9bc1-a61e5010d87c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:18.485314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-08689a97-866e-458a-9bc1-a61e5010d87c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:18.491128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08689a97-866e-458a-9bc1-a61e5010d87c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:18.491574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08689a97-866e-458a-9bc1-a61e5010d87c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:18.492331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08689a97-866e-458a-9bc1-a61e5010d87c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:18.492764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-08689a97-866e-458a-9bc1-a61e5010d87c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:18.521519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-08689a97-866e-458a-9bc1-a61e5010d87c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041438 Sep 14 19:48:18.522052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 563/1132] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:18 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:18.743349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e1a8df3d-7c43-4597-a39f-8b06a3909238 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:18.744259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e1a8df3d-7c43-4597-a39f-8b06a3909238 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:18.750707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1a8df3d-7c43-4597-a39f-8b06a3909238 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:18.751158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1a8df3d-7c43-4597-a39f-8b06a3909238 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:18.751930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1a8df3d-7c43-4597-a39f-8b06a3909238 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:18.752368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1a8df3d-7c43-4597-a39f-8b06a3909238 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:18.781736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e1a8df3d-7c43-4597-a39f-8b06a3909238 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041606 Sep 14 19:48:18.782280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 570/1133] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:18 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:19.030024 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a97e4a30-9772-4a73-8e77-74281b341bcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:19.031380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a97e4a30-9772-4a73-8e77-74281b341bcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:19.037218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a97e4a30-9772-4a73-8e77-74281b341bcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:19.037701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a97e4a30-9772-4a73-8e77-74281b341bcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:19.038467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a97e4a30-9772-4a73-8e77-74281b341bcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:19.038901 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a97e4a30-9772-4a73-8e77-74281b341bcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:19.068055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a97e4a30-9772-4a73-8e77-74281b341bcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041945 Sep 14 19:48:19.068604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 564/1134] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:19 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:19.474698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-212406d0-dbee-40e7-a9a8-82de50133e3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:19.475311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-212406d0-dbee-40e7-a9a8-82de50133e3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:19.481312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-212406d0-dbee-40e7-a9a8-82de50133e3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:19.481795 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-212406d0-dbee-40e7-a9a8-82de50133e3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:19.482564 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-212406d0-dbee-40e7-a9a8-82de50133e3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:19.483000 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-212406d0-dbee-40e7-a9a8-82de50133e3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:19.532877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-363ad48c-c68b-4ee4-b773-f5036e81ec73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:19.533797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-363ad48c-c68b-4ee4-b773-f5036e81ec73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:19.539532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-363ad48c-c68b-4ee4-b773-f5036e81ec73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:19.539966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-363ad48c-c68b-4ee4-b773-f5036e81ec73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:19.540720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-363ad48c-c68b-4ee4-b773-f5036e81ec73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:19.541145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-363ad48c-c68b-4ee4-b773-f5036e81ec73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:19.570290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-363ad48c-c68b-4ee4-b773-f5036e81ec73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041233 Sep 14 19:48:19.570838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 565/1135] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:48:19.605322 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-212406d0-dbee-40e7-a9a8-82de50133e3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:19.612590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-212406d0-dbee-40e7-a9a8-82de50133e3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.141784 Sep 14 19:48:19.613149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 571/1136] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:19 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:19.793858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b90b754a-d70b-46a1-8d14-cdd08809b878 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:19.794689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b90b754a-d70b-46a1-8d14-cdd08809b878 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:19.801429 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b90b754a-d70b-46a1-8d14-cdd08809b878 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:19.801905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b90b754a-d70b-46a1-8d14-cdd08809b878 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:19.802680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b90b754a-d70b-46a1-8d14-cdd08809b878 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:19.803112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b90b754a-d70b-46a1-8d14-cdd08809b878 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:19.831719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b90b754a-d70b-46a1-8d14-cdd08809b878 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041987 Sep 14 19:48:19.832311 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 566/1137] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:20.079734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6c1f51e0-f692-4ede-a77c-f237802c20a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:20.080540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6c1f51e0-f692-4ede-a77c-f237802c20a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:20.086400 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c1f51e0-f692-4ede-a77c-f237802c20a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:20.086842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c1f51e0-f692-4ede-a77c-f237802c20a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:20.087610 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c1f51e0-f692-4ede-a77c-f237802c20a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:20.088044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6c1f51e0-f692-4ede-a77c-f237802c20a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:20.117671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6c1f51e0-f692-4ede-a77c-f237802c20a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041709 Sep 14 19:48:20.118229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 572/1138] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:20 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:20.582363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-58f2fca3-73a1-4a69-8514-144dd192415a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:20.583252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-58f2fca3-73a1-4a69-8514-144dd192415a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:20.589071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58f2fca3-73a1-4a69-8514-144dd192415a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:20.589545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58f2fca3-73a1-4a69-8514-144dd192415a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:20.590310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58f2fca3-73a1-4a69-8514-144dd192415a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:20.590742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58f2fca3-73a1-4a69-8514-144dd192415a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:20.619210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-58f2fca3-73a1-4a69-8514-144dd192415a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041338 Sep 14 19:48:20.619755 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 567/1139] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:20.628987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4a131030-af19-43d6-863d-7111bfadc5bf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:20.629807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4a131030-af19-43d6-863d-7111bfadc5bf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:20.635652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a131030-af19-43d6-863d-7111bfadc5bf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:20.636106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a131030-af19-43d6-863d-7111bfadc5bf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:20.636877 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a131030-af19-43d6-863d-7111bfadc5bf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:20.637313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a131030-af19-43d6-863d-7111bfadc5bf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:20.761123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4a131030-af19-43d6-863d-7111bfadc5bf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:20.768905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4a131030-af19-43d6-863d-7111bfadc5bf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.143573 Sep 14 19:48:20.769469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 573/1140] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:20 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:20.843198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-559a6609-1811-408f-882d-557e8e7a8692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:20.844687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-559a6609-1811-408f-882d-557e8e7a8692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:20.850541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-559a6609-1811-408f-882d-557e8e7a8692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:20.850990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-559a6609-1811-408f-882d-557e8e7a8692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:20.851786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-559a6609-1811-408f-882d-557e8e7a8692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:20.852222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-559a6609-1811-408f-882d-557e8e7a8692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:20.880529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-559a6609-1811-408f-882d-557e8e7a8692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041207 Sep 14 19:48:20.881088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 568/1141] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:20 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:21.130494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7b842028-943c-426b-9a49-14d5514d44b4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:21.131494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7b842028-943c-426b-9a49-14d5514d44b4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:21.137522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b842028-943c-426b-9a49-14d5514d44b4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:21.137983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b842028-943c-426b-9a49-14d5514d44b4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:21.138785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b842028-943c-426b-9a49-14d5514d44b4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:21.139281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b842028-943c-426b-9a49-14d5514d44b4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:21.168579 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7b842028-943c-426b-9a49-14d5514d44b4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042575 Sep 14 19:48:21.169182 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 574/1142] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:21 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:21.631253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-299c18f8-4042-47d2-9eb1-abbf5af8fe91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:21.632190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-299c18f8-4042-47d2-9eb1-abbf5af8fe91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:21.638091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-299c18f8-4042-47d2-9eb1-abbf5af8fe91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:21.638521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-299c18f8-4042-47d2-9eb1-abbf5af8fe91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:21.639284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-299c18f8-4042-47d2-9eb1-abbf5af8fe91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:21.639720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-299c18f8-4042-47d2-9eb1-abbf5af8fe91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:21.667679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-299c18f8-4042-47d2-9eb1-abbf5af8fe91 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040213 Sep 14 19:48:21.668231 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 569/1143] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:21 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:21.786517 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cc12bdc3-7032-4372-af16-c9fffac23cc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:21.787040 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cc12bdc3-7032-4372-af16-c9fffac23cc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:21.793833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc12bdc3-7032-4372-af16-c9fffac23cc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:21.794281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc12bdc3-7032-4372-af16-c9fffac23cc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:21.795069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc12bdc3-7032-4372-af16-c9fffac23cc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:21.795501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc12bdc3-7032-4372-af16-c9fffac23cc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:21.892602 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cd8eb4e5-85bb-4ba9-9d88-fa9ab52878ce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:21.893666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cd8eb4e5-85bb-4ba9-9d88-fa9ab52878ce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:21.900180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd8eb4e5-85bb-4ba9-9d88-fa9ab52878ce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:21.900640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd8eb4e5-85bb-4ba9-9d88-fa9ab52878ce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:21.901426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd8eb4e5-85bb-4ba9-9d88-fa9ab52878ce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:21.901886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd8eb4e5-85bb-4ba9-9d88-fa9ab52878ce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:21.923243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cc12bdc3-7032-4372-af16-c9fffac23cc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:21.930967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cc12bdc3-7032-4372-af16-c9fffac23cc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.148109 Sep 14 19:48:21.931701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 575/1144] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:21 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:21.934557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cd8eb4e5-85bb-4ba9-9d88-fa9ab52878ce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046299 Sep 14 19:48:21.935251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 570/1145] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:21 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:22.179605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9ea9e0fd-4fc1-40f0-af35-8314bd4b8ebc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:22.180618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9ea9e0fd-4fc1-40f0-af35-8314bd4b8ebc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:22.186942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ea9e0fd-4fc1-40f0-af35-8314bd4b8ebc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:22.187395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ea9e0fd-4fc1-40f0-af35-8314bd4b8ebc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:22.188335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ea9e0fd-4fc1-40f0-af35-8314bd4b8ebc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:22.188772 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ea9e0fd-4fc1-40f0-af35-8314bd4b8ebc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:22.217491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9ea9e0fd-4fc1-40f0-af35-8314bd4b8ebc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041766 Sep 14 19:48:22.218061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 576/1146] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:22 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:22.679578 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fff5062c-30ce-49fa-bff3-4ff589fe975e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:22.680492 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fff5062c-30ce-49fa-bff3-4ff589fe975e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:22.686359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fff5062c-30ce-49fa-bff3-4ff589fe975e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:22.686789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fff5062c-30ce-49fa-bff3-4ff589fe975e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:22.688046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fff5062c-30ce-49fa-bff3-4ff589fe975e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:22.688488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fff5062c-30ce-49fa-bff3-4ff589fe975e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:22.716857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fff5062c-30ce-49fa-bff3-4ff589fe975e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040990 Sep 14 19:48:22.717400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 571/1147] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:22 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:22.946003 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f5557556-1265-4f0f-a6d9-662b66fbc3d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:22.946866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f5557556-1265-4f0f-a6d9-662b66fbc3d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:22.947558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d8fee4f0-422c-478d-add0-d9bd12da7f22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:22.948161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d8fee4f0-422c-478d-add0-d9bd12da7f22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:22.953138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f5557556-1265-4f0f-a6d9-662b66fbc3d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:22.953604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f5557556-1265-4f0f-a6d9-662b66fbc3d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:22.955514 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f5557556-1265-4f0f-a6d9-662b66fbc3d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:22.955628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d8fee4f0-422c-478d-add0-d9bd12da7f22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:22.955735 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f5557556-1265-4f0f-a6d9-662b66fbc3d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:22.955846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d8fee4f0-422c-478d-add0-d9bd12da7f22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:22.955846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d8fee4f0-422c-478d-add0-d9bd12da7f22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:22.955991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d8fee4f0-422c-478d-add0-d9bd12da7f22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:22.984649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f5557556-1265-4f0f-a6d9-662b66fbc3d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042494 Sep 14 19:48:22.985216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 577/1148] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:22 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:23.077348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d8fee4f0-422c-478d-add0-d9bd12da7f22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:23.085264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d8fee4f0-422c-478d-add0-d9bd12da7f22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.141209 Sep 14 19:48:23.085870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 572/1149] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:22 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:48:23.229404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4593e47b-b4d3-4967-bde8-ed1c5dfd08c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:23.230306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4593e47b-b4d3-4967-bde8-ed1c5dfd08c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:23.236120 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4593e47b-b4d3-4967-bde8-ed1c5dfd08c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:23.236568 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4593e47b-b4d3-4967-bde8-ed1c5dfd08c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:23.237334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4593e47b-b4d3-4967-bde8-ed1c5dfd08c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:23.237798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4593e47b-b4d3-4967-bde8-ed1c5dfd08c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:23.266860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4593e47b-b4d3-4967-bde8-ed1c5dfd08c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041230 Sep 14 19:48:23.267424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 578/1150] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:23 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:23.728595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1f3a8be8-6b31-40b8-b731-762f56abb16e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:23.729487 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1f3a8be8-6b31-40b8-b731-762f56abb16e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:23.735752 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f3a8be8-6b31-40b8-b731-762f56abb16e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:23.736194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f3a8be8-6b31-40b8-b731-762f56abb16e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:23.736942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f3a8be8-6b31-40b8-b731-762f56abb16e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:23.737371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1f3a8be8-6b31-40b8-b731-762f56abb16e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:23.765586 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1f3a8be8-6b31-40b8-b731-762f56abb16e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040888 Sep 14 19:48:23.766135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 573/1151] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:23.996515 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c4d290c5-5741-4c2d-a86d-eec461de96c5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:23.997332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c4d290c5-5741-4c2d-a86d-eec461de96c5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:24.003386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4d290c5-5741-4c2d-a86d-eec461de96c5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:24.003839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4d290c5-5741-4c2d-a86d-eec461de96c5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:24.004640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4d290c5-5741-4c2d-a86d-eec461de96c5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:24.005082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4d290c5-5741-4c2d-a86d-eec461de96c5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:24.033961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c4d290c5-5741-4c2d-a86d-eec461de96c5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041242 Sep 14 19:48:24.034515 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 579/1152] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:23 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:24.102494 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ac809679-0b8a-4968-aa0b-88cc107a3434 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:24.103095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ac809679-0b8a-4968-aa0b-88cc107a3434 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:24.108757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac809679-0b8a-4968-aa0b-88cc107a3434 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:24.109850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac809679-0b8a-4968-aa0b-88cc107a3434 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:24.110607 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac809679-0b8a-4968-aa0b-88cc107a3434 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:24.111034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac809679-0b8a-4968-aa0b-88cc107a3434 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:24.227819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ac809679-0b8a-4968-aa0b-88cc107a3434 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:24.235604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ac809679-0b8a-4968-aa0b-88cc107a3434 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.136826 Sep 14 19:48:24.236165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 574/1153] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:24 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:24.278261 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-416a7255-2f57-45e5-9237-50f9feaa10ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:24.279094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-416a7255-2f57-45e5-9237-50f9feaa10ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:24.285485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-416a7255-2f57-45e5-9237-50f9feaa10ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:24.285969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-416a7255-2f57-45e5-9237-50f9feaa10ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:24.286746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-416a7255-2f57-45e5-9237-50f9feaa10ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:24.287186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-416a7255-2f57-45e5-9237-50f9feaa10ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:24.316555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-416a7255-2f57-45e5-9237-50f9feaa10ec tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042117 Sep 14 19:48:24.317115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 580/1154] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:24 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:24.777009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a601a31e-b5fc-4853-947e-2c5167415617 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:24.777934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a601a31e-b5fc-4853-947e-2c5167415617 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:24.784330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a601a31e-b5fc-4853-947e-2c5167415617 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:24.784775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a601a31e-b5fc-4853-947e-2c5167415617 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:24.785565 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a601a31e-b5fc-4853-947e-2c5167415617 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:24.786010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a601a31e-b5fc-4853-947e-2c5167415617 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:24.815394 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a601a31e-b5fc-4853-947e-2c5167415617 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042142 Sep 14 19:48:24.815951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 575/1155] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:25.045522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-119dee9f-489c-4eab-bdac-e6274d2d1d8c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:25.047100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-119dee9f-489c-4eab-bdac-e6274d2d1d8c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:25.053178 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-119dee9f-489c-4eab-bdac-e6274d2d1d8c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:25.053653 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-119dee9f-489c-4eab-bdac-e6274d2d1d8c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:25.054411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-119dee9f-489c-4eab-bdac-e6274d2d1d8c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:25.054840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-119dee9f-489c-4eab-bdac-e6274d2d1d8c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:25.083069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-119dee9f-489c-4eab-bdac-e6274d2d1d8c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041312 Sep 14 19:48:25.083602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 581/1156] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:25 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:25.252653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-98568ea8-3786-4bb6-8761-2e598b4bf0ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:25.253252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-98568ea8-3786-4bb6-8761-2e598b4bf0ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:25.259091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98568ea8-3786-4bb6-8761-2e598b4bf0ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:25.259531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98568ea8-3786-4bb6-8761-2e598b4bf0ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:25.260283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98568ea8-3786-4bb6-8761-2e598b4bf0ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:25.260709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98568ea8-3786-4bb6-8761-2e598b4bf0ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:25.328602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ee8b9e27-38ff-4f64-90a0-9392d33181a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:25.329520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ee8b9e27-38ff-4f64-90a0-9392d33181a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:25.335399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8b9e27-38ff-4f64-90a0-9392d33181a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:25.335899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8b9e27-38ff-4f64-90a0-9392d33181a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:25.336749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8b9e27-38ff-4f64-90a0-9392d33181a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:25.337188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8b9e27-38ff-4f64-90a0-9392d33181a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:25.367024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ee8b9e27-38ff-4f64-90a0-9392d33181a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Sep 14 19:48:25.367612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 582/1157] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:25 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:25.387066 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-98568ea8-3786-4bb6-8761-2e598b4bf0ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:25.404194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-98568ea8-3786-4bb6-8761-2e598b4bf0ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.146130 Sep 14 19:48:25.406721 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 576/1158] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:25 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:25.826706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4246a7d7-9ee2-458f-a7b1-4e7b68d8fc55 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:25.828108 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4246a7d7-9ee2-458f-a7b1-4e7b68d8fc55 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:25.834034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4246a7d7-9ee2-458f-a7b1-4e7b68d8fc55 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:25.834470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4246a7d7-9ee2-458f-a7b1-4e7b68d8fc55 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:25.835230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4246a7d7-9ee2-458f-a7b1-4e7b68d8fc55 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:25.835652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4246a7d7-9ee2-458f-a7b1-4e7b68d8fc55 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:25.864481 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4246a7d7-9ee2-458f-a7b1-4e7b68d8fc55 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041479 Sep 14 19:48:25.865022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 583/1159] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:26.095528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0d3f66bc-3102-4759-bc49-afefd635469b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:26.096339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0d3f66bc-3102-4759-bc49-afefd635469b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:26.102122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d3f66bc-3102-4759-bc49-afefd635469b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:26.102547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d3f66bc-3102-4759-bc49-afefd635469b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:26.103307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d3f66bc-3102-4759-bc49-afefd635469b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:26.103733 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d3f66bc-3102-4759-bc49-afefd635469b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:26.132074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0d3f66bc-3102-4759-bc49-afefd635469b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040995 Sep 14 19:48:26.132638 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 577/1160] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:26 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:26.379175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6fffb660-4441-48bb-8873-70ef1417561e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:26.380092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6fffb660-4441-48bb-8873-70ef1417561e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:26.386003 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6fffb660-4441-48bb-8873-70ef1417561e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:26.386456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6fffb660-4441-48bb-8873-70ef1417561e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:26.387222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6fffb660-4441-48bb-8873-70ef1417561e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:26.387690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6fffb660-4441-48bb-8873-70ef1417561e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:26.417366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6fffb660-4441-48bb-8873-70ef1417561e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041934 Sep 14 19:48:26.417974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 584/1161] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:26 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:26.422452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5cb31b53-e3a6-4e68-ad46-ad46bbad41a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:26.423327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5cb31b53-e3a6-4e68-ad46-ad46bbad41a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:26.429083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cb31b53-e3a6-4e68-ad46-ad46bbad41a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:26.429547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cb31b53-e3a6-4e68-ad46-ad46bbad41a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:26.430306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cb31b53-e3a6-4e68-ad46-ad46bbad41a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:26.430731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cb31b53-e3a6-4e68-ad46-ad46bbad41a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:26.549945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5cb31b53-e3a6-4e68-ad46-ad46bbad41a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:26.557187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5cb31b53-e3a6-4e68-ad46-ad46bbad41a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.139057 Sep 14 19:48:26.557770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 578/1162] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:26 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:48:26.876590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1946c8a4-d810-44f5-a38c-1787bbc7d294 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:26.877489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1946c8a4-d810-44f5-a38c-1787bbc7d294 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:26.883433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1946c8a4-d810-44f5-a38c-1787bbc7d294 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:26.883879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1946c8a4-d810-44f5-a38c-1787bbc7d294 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:26.884649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1946c8a4-d810-44f5-a38c-1787bbc7d294 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:26.885087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1946c8a4-d810-44f5-a38c-1787bbc7d294 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:26.913082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1946c8a4-d810-44f5-a38c-1787bbc7d294 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040953 Sep 14 19:48:26.913657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 585/1163] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:27.143735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-98a4211a-7aff-4ae2-ad48-ce9d7769435c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:27.144661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-98a4211a-7aff-4ae2-ad48-ce9d7769435c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:27.150794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98a4211a-7aff-4ae2-ad48-ce9d7769435c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:27.151235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98a4211a-7aff-4ae2-ad48-ce9d7769435c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:27.151986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98a4211a-7aff-4ae2-ad48-ce9d7769435c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:27.152410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98a4211a-7aff-4ae2-ad48-ce9d7769435c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:27.182284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-98a4211a-7aff-4ae2-ad48-ce9d7769435c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042574 Sep 14 19:48:27.182818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 579/1164] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:27 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:27.429993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f374c60a-5e55-4e42-aa2d-37374854ff3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:27.430828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f374c60a-5e55-4e42-aa2d-37374854ff3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:27.436673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f374c60a-5e55-4e42-aa2d-37374854ff3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:27.437122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f374c60a-5e55-4e42-aa2d-37374854ff3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:27.437924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f374c60a-5e55-4e42-aa2d-37374854ff3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:27.438366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f374c60a-5e55-4e42-aa2d-37374854ff3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:27.466629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f374c60a-5e55-4e42-aa2d-37374854ff3c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040546 Sep 14 19:48:27.467198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 586/1165] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:27 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:27.574143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-352af1d4-fca9-416f-a45c-4ac83fe80792 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:27.574748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-352af1d4-fca9-416f-a45c-4ac83fe80792 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:27.581254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-352af1d4-fca9-416f-a45c-4ac83fe80792 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:27.581763 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-352af1d4-fca9-416f-a45c-4ac83fe80792 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:27.582540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-352af1d4-fca9-416f-a45c-4ac83fe80792 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:27.582975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-352af1d4-fca9-416f-a45c-4ac83fe80792 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:27.713916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-352af1d4-fca9-416f-a45c-4ac83fe80792 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:27.721171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-352af1d4-fca9-416f-a45c-4ac83fe80792 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.150909 Sep 14 19:48:27.721764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 580/1166] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:27 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:27.924506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5b1ca513-dfa8-46a8-bc21-c7fbf07b0b08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:27.925426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5b1ca513-dfa8-46a8-bc21-c7fbf07b0b08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:27.931229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5b1ca513-dfa8-46a8-bc21-c7fbf07b0b08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:27.931670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5b1ca513-dfa8-46a8-bc21-c7fbf07b0b08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:27.932422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5b1ca513-dfa8-46a8-bc21-c7fbf07b0b08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:27.932850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5b1ca513-dfa8-46a8-bc21-c7fbf07b0b08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:27.962007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5b1ca513-dfa8-46a8-bc21-c7fbf07b0b08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041401 Sep 14 19:48:27.962479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 587/1167] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:27 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:28.194082 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4422dec5-2a44-4071-a0a4-208ffda27821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:28.195016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4422dec5-2a44-4071-a0a4-208ffda27821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:28.200839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4422dec5-2a44-4071-a0a4-208ffda27821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:28.201287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4422dec5-2a44-4071-a0a4-208ffda27821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:28.202090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4422dec5-2a44-4071-a0a4-208ffda27821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:28.202640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4422dec5-2a44-4071-a0a4-208ffda27821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:28.231288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4422dec5-2a44-4071-a0a4-208ffda27821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041022 Sep 14 19:48:28.231765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 581/1168] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:28 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:28.478487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bceebe44-fa46-4d83-a338-a909e9a911a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:28.479526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bceebe44-fa46-4d83-a338-a909e9a911a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:28.486251 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bceebe44-fa46-4d83-a338-a909e9a911a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:28.486632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bceebe44-fa46-4d83-a338-a909e9a911a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:28.487397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bceebe44-fa46-4d83-a338-a909e9a911a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:28.487825 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bceebe44-fa46-4d83-a338-a909e9a911a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:28.515993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bceebe44-fa46-4d83-a338-a909e9a911a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041205 Sep 14 19:48:28.516539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 588/1169] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:28 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:28.738417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b459707e-3aeb-4bae-b4b6-f9d5b7a6c5c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:28.738930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b459707e-3aeb-4bae-b4b6-f9d5b7a6c5c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:28.744702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b459707e-3aeb-4bae-b4b6-f9d5b7a6c5c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:28.745138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b459707e-3aeb-4bae-b4b6-f9d5b7a6c5c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:28.745918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b459707e-3aeb-4bae-b4b6-f9d5b7a6c5c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:28.746344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b459707e-3aeb-4bae-b4b6-f9d5b7a6c5c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:28.868165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b459707e-3aeb-4bae-b4b6-f9d5b7a6c5c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:28.875363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b459707e-3aeb-4bae-b4b6-f9d5b7a6c5c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140678 Sep 14 19:48:28.875928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 582/1170] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:28 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:28.974321 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2a35042b-ebc4-4482-9e46-dce10ca5e856 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:28.975256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2a35042b-ebc4-4482-9e46-dce10ca5e856 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:28.981275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a35042b-ebc4-4482-9e46-dce10ca5e856 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:28.981761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a35042b-ebc4-4482-9e46-dce10ca5e856 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:28.982532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a35042b-ebc4-4482-9e46-dce10ca5e856 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:28.982967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a35042b-ebc4-4482-9e46-dce10ca5e856 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:29.011670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2a35042b-ebc4-4482-9e46-dce10ca5e856 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041072 Sep 14 19:48:29.012152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 589/1171] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:28 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:29.243443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3afe1292-7b3c-4c7d-b8d4-0de796f8bac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:29.244382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3afe1292-7b3c-4c7d-b8d4-0de796f8bac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:29.250702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3afe1292-7b3c-4c7d-b8d4-0de796f8bac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:29.251144 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3afe1292-7b3c-4c7d-b8d4-0de796f8bac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:29.251922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3afe1292-7b3c-4c7d-b8d4-0de796f8bac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:29.252356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3afe1292-7b3c-4c7d-b8d4-0de796f8bac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:29.282073 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3afe1292-7b3c-4c7d-b8d4-0de796f8bac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042250 Sep 14 19:48:29.282553 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 583/1172] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:29 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:29.526701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-eaae81d9-a2ad-41a5-8999-cc9568308a9c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:29.527607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-eaae81d9-a2ad-41a5-8999-cc9568308a9c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:29.533545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaae81d9-a2ad-41a5-8999-cc9568308a9c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:29.533938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaae81d9-a2ad-41a5-8999-cc9568308a9c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:29.534701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaae81d9-a2ad-41a5-8999-cc9568308a9c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:29.535135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eaae81d9-a2ad-41a5-8999-cc9568308a9c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:29.564392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-eaae81d9-a2ad-41a5-8999-cc9568308a9c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041387 Sep 14 19:48:29.564943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 590/1173] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:29 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:29.892096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-10975a73-d81c-4fc5-a4e0-589391b25c21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:29.892703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-10975a73-d81c-4fc5-a4e0-589391b25c21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:29.898524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-10975a73-d81c-4fc5-a4e0-589391b25c21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:29.898975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-10975a73-d81c-4fc5-a4e0-589391b25c21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:29.899738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-10975a73-d81c-4fc5-a4e0-589391b25c21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:29.900175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-10975a73-d81c-4fc5-a4e0-589391b25c21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:30.018441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-10975a73-d81c-4fc5-a4e0-589391b25c21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:30.023611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cd8eb34d-c204-4961-bfdc-6afc811e85fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:30.024620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cd8eb34d-c204-4961-bfdc-6afc811e85fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:30.025731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-10975a73-d81c-4fc5-a4e0-589391b25c21 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.137224 Sep 14 19:48:30.026306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 584/1174] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:29 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:30.030994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd8eb34d-c204-4961-bfdc-6afc811e85fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:30.031436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd8eb34d-c204-4961-bfdc-6afc811e85fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:30.032195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd8eb34d-c204-4961-bfdc-6afc811e85fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:30.032623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd8eb34d-c204-4961-bfdc-6afc811e85fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:30.062180 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cd8eb34d-c204-4961-bfdc-6afc811e85fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042287 Sep 14 19:48:30.062728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 591/1175] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:30 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:48:30.293773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4717c38b-c8ca-4268-a018-5464ab306d67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:30.294684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4717c38b-c8ca-4268-a018-5464ab306d67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:30.301557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4717c38b-c8ca-4268-a018-5464ab306d67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:30.302008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4717c38b-c8ca-4268-a018-5464ab306d67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:30.302784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4717c38b-c8ca-4268-a018-5464ab306d67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:30.303224 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4717c38b-c8ca-4268-a018-5464ab306d67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:30.332357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4717c38b-c8ca-4268-a018-5464ab306d67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042649 Sep 14 19:48:30.332912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 585/1176] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:30 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:30.576419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a5fc8302-1c0b-490e-b5d5-b6dc974466a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:30.577255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a5fc8302-1c0b-490e-b5d5-b6dc974466a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:30.583780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5fc8302-1c0b-490e-b5d5-b6dc974466a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:30.584226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5fc8302-1c0b-490e-b5d5-b6dc974466a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:30.584997 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5fc8302-1c0b-490e-b5d5-b6dc974466a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:30.585432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5fc8302-1c0b-490e-b5d5-b6dc974466a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:30.613791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a5fc8302-1c0b-490e-b5d5-b6dc974466a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041362 Sep 14 19:48:30.614340 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 592/1177] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:30 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:31.043019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dc9b7950-3a09-47c9-8787-0592a4a90923 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:31.043623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dc9b7950-3a09-47c9-8787-0592a4a90923 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:31.050206 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc9b7950-3a09-47c9-8787-0592a4a90923 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:31.050652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc9b7950-3a09-47c9-8787-0592a4a90923 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:31.051414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc9b7950-3a09-47c9-8787-0592a4a90923 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:31.051844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc9b7950-3a09-47c9-8787-0592a4a90923 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:31.074241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5ec310e1-39e5-4351-9b6c-6dc3f99f55f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:31.075144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5ec310e1-39e5-4351-9b6c-6dc3f99f55f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:31.080889 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5ec310e1-39e5-4351-9b6c-6dc3f99f55f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:31.081349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5ec310e1-39e5-4351-9b6c-6dc3f99f55f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:31.082156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5ec310e1-39e5-4351-9b6c-6dc3f99f55f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:31.082596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5ec310e1-39e5-4351-9b6c-6dc3f99f55f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:31.113928 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5ec310e1-39e5-4351-9b6c-6dc3f99f55f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043652 Sep 14 19:48:31.114558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 593/1178] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:31 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:31.175702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dc9b7950-3a09-47c9-8787-0592a4a90923 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:31.183066 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dc9b7950-3a09-47c9-8787-0592a4a90923 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.143718 Sep 14 19:48:31.183625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 586/1179] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:31 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:31.343850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-aa7ffe8a-8cb6-4cdf-b144-02aca4684e75 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:31.344776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-aa7ffe8a-8cb6-4cdf-b144-02aca4684e75 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:31.350726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa7ffe8a-8cb6-4cdf-b144-02aca4684e75 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:31.351181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa7ffe8a-8cb6-4cdf-b144-02aca4684e75 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:31.351951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa7ffe8a-8cb6-4cdf-b144-02aca4684e75 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:31.352389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa7ffe8a-8cb6-4cdf-b144-02aca4684e75 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:31.381585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-aa7ffe8a-8cb6-4cdf-b144-02aca4684e75 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041493 Sep 14 19:48:31.382080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 594/1180] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:31 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:31.625134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-67040d14-7e43-4685-94ab-286d5ab69455 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:31.626057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-67040d14-7e43-4685-94ab-286d5ab69455 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:31.632013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-67040d14-7e43-4685-94ab-286d5ab69455 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:31.632376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-67040d14-7e43-4685-94ab-286d5ab69455 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:31.633134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-67040d14-7e43-4685-94ab-286d5ab69455 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:31.633599 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-67040d14-7e43-4685-94ab-286d5ab69455 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:31.662309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-67040d14-7e43-4685-94ab-286d5ab69455 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041002 Sep 14 19:48:31.662899 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 587/1181] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:31 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:32.125310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b3303035-47b9-48c2-8260-5f6ff3068ec9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:32.126230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b3303035-47b9-48c2-8260-5f6ff3068ec9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:32.132014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3303035-47b9-48c2-8260-5f6ff3068ec9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:32.132459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3303035-47b9-48c2-8260-5f6ff3068ec9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:32.133216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3303035-47b9-48c2-8260-5f6ff3068ec9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:32.133678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3303035-47b9-48c2-8260-5f6ff3068ec9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:32.162520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b3303035-47b9-48c2-8260-5f6ff3068ec9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041031 Sep 14 19:48:32.163063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 595/1182] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:32 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:32.199701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dcfa75d3-30bc-47a7-81af-8278ebb48e0f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:32.200304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dcfa75d3-30bc-47a7-81af-8278ebb48e0f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:32.206841 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcfa75d3-30bc-47a7-81af-8278ebb48e0f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:32.207278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcfa75d3-30bc-47a7-81af-8278ebb48e0f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:32.208141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcfa75d3-30bc-47a7-81af-8278ebb48e0f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:32.208465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcfa75d3-30bc-47a7-81af-8278ebb48e0f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:32.335053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dcfa75d3-30bc-47a7-81af-8278ebb48e0f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:32.342345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dcfa75d3-30bc-47a7-81af-8278ebb48e0f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.146240 Sep 14 19:48:32.342974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 588/1183] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:32 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:32.393409 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9fb29c22-00d7-482b-977e-f23186e47466 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:32.394290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9fb29c22-00d7-482b-977e-f23186e47466 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:32.400035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fb29c22-00d7-482b-977e-f23186e47466 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:32.400477 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fb29c22-00d7-482b-977e-f23186e47466 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:32.401238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fb29c22-00d7-482b-977e-f23186e47466 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:32.401704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9fb29c22-00d7-482b-977e-f23186e47466 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:32.430063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9fb29c22-00d7-482b-977e-f23186e47466 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040970 Sep 14 19:48:32.430614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 596/1184] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:32 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:32.674405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f6b5c32e-a078-47d5-8b37-db2755e82e9f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:32.675225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f6b5c32e-a078-47d5-8b37-db2755e82e9f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:32.680998 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6b5c32e-a078-47d5-8b37-db2755e82e9f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:32.681444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6b5c32e-a078-47d5-8b37-db2755e82e9f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:32.682239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6b5c32e-a078-47d5-8b37-db2755e82e9f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:32.682672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f6b5c32e-a078-47d5-8b37-db2755e82e9f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:32.712323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f6b5c32e-a078-47d5-8b37-db2755e82e9f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042518 Sep 14 19:48:32.712878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 589/1185] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:32 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:33.175029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0a593f6e-e6f4-48c7-8292-71ac7910d7dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:33.175945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0a593f6e-e6f4-48c7-8292-71ac7910d7dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:33.181875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a593f6e-e6f4-48c7-8292-71ac7910d7dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:33.182323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a593f6e-e6f4-48c7-8292-71ac7910d7dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:33.183108 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a593f6e-e6f4-48c7-8292-71ac7910d7dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:33.183545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a593f6e-e6f4-48c7-8292-71ac7910d7dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:33.213046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0a593f6e-e6f4-48c7-8292-71ac7910d7dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042618 Sep 14 19:48:33.213624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 597/1186] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:33 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:33.359687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-022a06b7-f64d-4b14-8ad7-2bc3c856ab23 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:33.360296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-022a06b7-f64d-4b14-8ad7-2bc3c856ab23 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:33.366241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-022a06b7-f64d-4b14-8ad7-2bc3c856ab23 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:33.366686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-022a06b7-f64d-4b14-8ad7-2bc3c856ab23 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:33.367454 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-022a06b7-f64d-4b14-8ad7-2bc3c856ab23 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:33.367892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-022a06b7-f64d-4b14-8ad7-2bc3c856ab23 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:33.441105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4bfb7919-00ed-4328-b405-6039985fca53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:33.441985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4bfb7919-00ed-4328-b405-6039985fca53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:33.447957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4bfb7919-00ed-4328-b405-6039985fca53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:33.448408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4bfb7919-00ed-4328-b405-6039985fca53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:33.449194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4bfb7919-00ed-4328-b405-6039985fca53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:33.450071 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4bfb7919-00ed-4328-b405-6039985fca53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:33.480546 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4bfb7919-00ed-4328-b405-6039985fca53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043310 Sep 14 19:48:33.481257 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 598/1187] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:33 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:33.488804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-022a06b7-f64d-4b14-8ad7-2bc3c856ab23 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:33.496223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-022a06b7-f64d-4b14-8ad7-2bc3c856ab23 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140267 Sep 14 19:48:33.496792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 590/1188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:33 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:33.723863 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a1cb8d9b-c8a8-4a1f-9d97-7ed2dd195534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:33.724683 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a1cb8d9b-c8a8-4a1f-9d97-7ed2dd195534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:33.730727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1cb8d9b-c8a8-4a1f-9d97-7ed2dd195534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:33.731179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1cb8d9b-c8a8-4a1f-9d97-7ed2dd195534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:33.731955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1cb8d9b-c8a8-4a1f-9d97-7ed2dd195534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:33.732392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1cb8d9b-c8a8-4a1f-9d97-7ed2dd195534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:33.761913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a1cb8d9b-c8a8-4a1f-9d97-7ed2dd195534 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041819 Sep 14 19:48:33.762474 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 599/1189] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:33 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:34.224755 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-178098bc-8dbd-44a1-986f-2fb65056e5b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:34.225685 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-178098bc-8dbd-44a1-986f-2fb65056e5b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:34.231470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-178098bc-8dbd-44a1-986f-2fb65056e5b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:34.231914 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-178098bc-8dbd-44a1-986f-2fb65056e5b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:34.232670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-178098bc-8dbd-44a1-986f-2fb65056e5b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:34.233101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-178098bc-8dbd-44a1-986f-2fb65056e5b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:34.261934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-178098bc-8dbd-44a1-986f-2fb65056e5b1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041089 Sep 14 19:48:34.262489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 591/1190] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:34 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:34.492018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8c2f360a-229d-4582-95fa-e2a3fd9c4200 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:34.492851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8c2f360a-229d-4582-95fa-e2a3fd9c4200 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:34.498684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c2f360a-229d-4582-95fa-e2a3fd9c4200 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:34.499133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c2f360a-229d-4582-95fa-e2a3fd9c4200 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:34.499896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c2f360a-229d-4582-95fa-e2a3fd9c4200 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:34.500331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c2f360a-229d-4582-95fa-e2a3fd9c4200 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:34.513380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-32b29d88-6523-44c5-9a97-b22d5e47f3b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:34.514056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-32b29d88-6523-44c5-9a97-b22d5e47f3b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:34.519886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32b29d88-6523-44c5-9a97-b22d5e47f3b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:34.520328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32b29d88-6523-44c5-9a97-b22d5e47f3b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:34.528983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32b29d88-6523-44c5-9a97-b22d5e47f3b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:34.528983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32b29d88-6523-44c5-9a97-b22d5e47f3b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:34.529745 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8c2f360a-229d-4582-95fa-e2a3fd9c4200 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041669 Sep 14 19:48:34.530885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 600/1191] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:34 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:34.640258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-32b29d88-6523-44c5-9a97-b22d5e47f3b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:34.647492 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-32b29d88-6523-44c5-9a97-b22d5e47f3b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.137926 Sep 14 19:48:34.648082 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 592/1192] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:34 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:34.773670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cac922ec-c2bf-4a67-b6a9-48c8297dcfde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:34.774506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cac922ec-c2bf-4a67-b6a9-48c8297dcfde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:34.780880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cac922ec-c2bf-4a67-b6a9-48c8297dcfde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:34.781334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cac922ec-c2bf-4a67-b6a9-48c8297dcfde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:34.782127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cac922ec-c2bf-4a67-b6a9-48c8297dcfde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:34.782567 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cac922ec-c2bf-4a67-b6a9-48c8297dcfde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:34.812198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cac922ec-c2bf-4a67-b6a9-48c8297dcfde tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042395 Sep 14 19:48:34.812751 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 601/1193] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:34 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:35.273845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3224a4d6-dfcf-4d87-af97-c80a0dfb5430 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:35.274751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3224a4d6-dfcf-4d87-af97-c80a0dfb5430 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:35.280679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3224a4d6-dfcf-4d87-af97-c80a0dfb5430 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:35.281129 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3224a4d6-dfcf-4d87-af97-c80a0dfb5430 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:35.281925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3224a4d6-dfcf-4d87-af97-c80a0dfb5430 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:35.282371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3224a4d6-dfcf-4d87-af97-c80a0dfb5430 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:35.311357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3224a4d6-dfcf-4d87-af97-c80a0dfb5430 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041250 Sep 14 19:48:35.312418 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 593/1194] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:35 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:35.542293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ea091aff-9cc2-4143-9b76-9d0614080700 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:35.543123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ea091aff-9cc2-4143-9b76-9d0614080700 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:35.549804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea091aff-9cc2-4143-9b76-9d0614080700 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:35.550288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea091aff-9cc2-4143-9b76-9d0614080700 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:35.551062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea091aff-9cc2-4143-9b76-9d0614080700 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:35.551502 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea091aff-9cc2-4143-9b76-9d0614080700 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:35.580372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ea091aff-9cc2-4143-9b76-9d0614080700 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Sep 14 19:48:35.580930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 602/1195] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:35 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:35.664089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a935a269-f1d9-4d20-b158-77e309cdb002 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:35.664672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a935a269-f1d9-4d20-b158-77e309cdb002 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:35.670448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a935a269-f1d9-4d20-b158-77e309cdb002 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:35.671386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a935a269-f1d9-4d20-b158-77e309cdb002 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:35.672141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a935a269-f1d9-4d20-b158-77e309cdb002 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:35.672809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a935a269-f1d9-4d20-b158-77e309cdb002 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:35.795382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a935a269-f1d9-4d20-b158-77e309cdb002 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:35.804078 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a935a269-f1d9-4d20-b158-77e309cdb002 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.143533 Sep 14 19:48:35.804703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 594/1196] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:35 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:35.823588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9646c519-8cc4-4fd6-ba29-9bbe97574ab8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:35.824491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9646c519-8cc4-4fd6-ba29-9bbe97574ab8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:35.830366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9646c519-8cc4-4fd6-ba29-9bbe97574ab8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:35.830812 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9646c519-8cc4-4fd6-ba29-9bbe97574ab8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:35.831576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9646c519-8cc4-4fd6-ba29-9bbe97574ab8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:35.832008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9646c519-8cc4-4fd6-ba29-9bbe97574ab8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:35.860874 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9646c519-8cc4-4fd6-ba29-9bbe97574ab8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041028 Sep 14 19:48:35.861427 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 603/1197] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:35 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:36.323367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-65c2553f-eac9-45f8-a716-29a687d77ba6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:36.324258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-65c2553f-eac9-45f8-a716-29a687d77ba6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:36.330216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65c2553f-eac9-45f8-a716-29a687d77ba6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:36.330656 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65c2553f-eac9-45f8-a716-29a687d77ba6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:36.331577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65c2553f-eac9-45f8-a716-29a687d77ba6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:36.331928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65c2553f-eac9-45f8-a716-29a687d77ba6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:36.361749 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-65c2553f-eac9-45f8-a716-29a687d77ba6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042112 Sep 14 19:48:36.362295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 595/1198] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:36 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:36.591874 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-53f480e6-b526-4754-80ec-cb2a9ee0b557 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:36.592734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-53f480e6-b526-4754-80ec-cb2a9ee0b557 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:36.598532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-53f480e6-b526-4754-80ec-cb2a9ee0b557 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:36.598979 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-53f480e6-b526-4754-80ec-cb2a9ee0b557 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:36.599738 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-53f480e6-b526-4754-80ec-cb2a9ee0b557 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:36.600168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-53f480e6-b526-4754-80ec-cb2a9ee0b557 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:36.628960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-53f480e6-b526-4754-80ec-cb2a9ee0b557 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040987 Sep 14 19:48:36.629525 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 604/1199] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:36 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:36.821702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-32267d14-c9c3-45fe-8bb0-c31f6463c8a6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:36.822304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-32267d14-c9c3-45fe-8bb0-c31f6463c8a6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:36.828789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32267d14-c9c3-45fe-8bb0-c31f6463c8a6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:36.829233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32267d14-c9c3-45fe-8bb0-c31f6463c8a6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:36.830022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32267d14-c9c3-45fe-8bb0-c31f6463c8a6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:36.830456 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32267d14-c9c3-45fe-8bb0-c31f6463c8a6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:36.872055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e282f489-d1ef-4067-af4e-e254be923691 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:36.873043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e282f489-d1ef-4067-af4e-e254be923691 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:36.879316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e282f489-d1ef-4067-af4e-e254be923691 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:36.879829 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e282f489-d1ef-4067-af4e-e254be923691 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:36.880659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e282f489-d1ef-4067-af4e-e254be923691 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:36.881194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e282f489-d1ef-4067-af4e-e254be923691 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:36.910794 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e282f489-d1ef-4067-af4e-e254be923691 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042428 Sep 14 19:48:36.911366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 605/1200] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:36 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:36.948795 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-32267d14-c9c3-45fe-8bb0-c31f6463c8a6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:36.956845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-32267d14-c9c3-45fe-8bb0-c31f6463c8a6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138807 Sep 14 19:48:36.957400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 596/1201] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:36 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:37.373177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e24f53c8-676f-4633-ab8e-ab1f02ec424b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:37.374114 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e24f53c8-676f-4633-ab8e-ab1f02ec424b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:37.380556 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e24f53c8-676f-4633-ab8e-ab1f02ec424b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:37.381011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e24f53c8-676f-4633-ab8e-ab1f02ec424b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:37.381799 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e24f53c8-676f-4633-ab8e-ab1f02ec424b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:37.382237 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e24f53c8-676f-4633-ab8e-ab1f02ec424b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:37.412636 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e24f53c8-676f-4633-ab8e-ab1f02ec424b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042968 Sep 14 19:48:37.413462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 606/1202] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:37.639820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1c503255-a95d-41f6-a94f-2de882888655 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:37.640752 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1c503255-a95d-41f6-a94f-2de882888655 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:37.647786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c503255-a95d-41f6-a94f-2de882888655 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:37.647786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c503255-a95d-41f6-a94f-2de882888655 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:37.648082 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c503255-a95d-41f6-a94f-2de882888655 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:37.648368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c503255-a95d-41f6-a94f-2de882888655 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:37.679936 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1c503255-a95d-41f6-a94f-2de882888655 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Sep 14 19:48:37.680486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 597/1203] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:37 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:37.922189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5b1869fb-33e2-4dc2-96ba-05baa1be0ee6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:37.923290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5b1869fb-33e2-4dc2-96ba-05baa1be0ee6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:37.929112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5b1869fb-33e2-4dc2-96ba-05baa1be0ee6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:37.929595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5b1869fb-33e2-4dc2-96ba-05baa1be0ee6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:37.930394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5b1869fb-33e2-4dc2-96ba-05baa1be0ee6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:37.930834 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5b1869fb-33e2-4dc2-96ba-05baa1be0ee6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:37.959026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5b1869fb-33e2-4dc2-96ba-05baa1be0ee6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040737 Sep 14 19:48:37.959585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 607/1204] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:37 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:37.973248 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-84ddb846-c374-4fda-a9fc-54b27278d188 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:37.973888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-84ddb846-c374-4fda-a9fc-54b27278d188 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:37.979662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84ddb846-c374-4fda-a9fc-54b27278d188 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:37.980098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84ddb846-c374-4fda-a9fc-54b27278d188 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:37.980848 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84ddb846-c374-4fda-a9fc-54b27278d188 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:37.981272 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84ddb846-c374-4fda-a9fc-54b27278d188 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:38.198811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-84ddb846-c374-4fda-a9fc-54b27278d188 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:38.207014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-84ddb846-c374-4fda-a9fc-54b27278d188 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.237349 Sep 14 19:48:38.207584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 598/1205] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:37 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:38.426298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-51d4872b-5b93-43a4-90a8-a02555c1ec3e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:38.427198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-51d4872b-5b93-43a4-90a8-a02555c1ec3e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:38.432951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51d4872b-5b93-43a4-90a8-a02555c1ec3e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:38.433394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51d4872b-5b93-43a4-90a8-a02555c1ec3e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:38.434309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51d4872b-5b93-43a4-90a8-a02555c1ec3e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:38.434737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51d4872b-5b93-43a4-90a8-a02555c1ec3e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:38.464021 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-51d4872b-5b93-43a4-90a8-a02555c1ec3e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041647 Sep 14 19:48:38.464504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 608/1206] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:38 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:38.691534 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0ac14de5-2743-491a-8d42-2d4f43737f63 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:38.692441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0ac14de5-2743-491a-8d42-2d4f43737f63 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:38.698446 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ac14de5-2743-491a-8d42-2d4f43737f63 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:38.698888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ac14de5-2743-491a-8d42-2d4f43737f63 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:38.699749 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ac14de5-2743-491a-8d42-2d4f43737f63 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:38.700176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ac14de5-2743-491a-8d42-2d4f43737f63 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:38.728219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0ac14de5-2743-491a-8d42-2d4f43737f63 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041003 Sep 14 19:48:38.728691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 599/1207] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:38 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:38.970390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-45f4b5ec-2ecf-470a-9b09-f19bde511941 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:38.971303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-45f4b5ec-2ecf-470a-9b09-f19bde511941 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:38.977134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45f4b5ec-2ecf-470a-9b09-f19bde511941 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:38.977616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45f4b5ec-2ecf-470a-9b09-f19bde511941 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:38.978439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45f4b5ec-2ecf-470a-9b09-f19bde511941 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:38.978823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45f4b5ec-2ecf-470a-9b09-f19bde511941 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:39.007615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-45f4b5ec-2ecf-470a-9b09-f19bde511941 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041029 Sep 14 19:48:39.008169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 609/1208] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:38 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:39.224170 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-419ab6e9-9811-46e8-85fa-26c03f6df831 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:39.224773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-419ab6e9-9811-46e8-85fa-26c03f6df831 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:39.230720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-419ab6e9-9811-46e8-85fa-26c03f6df831 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:39.231104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-419ab6e9-9811-46e8-85fa-26c03f6df831 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:39.231854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-419ab6e9-9811-46e8-85fa-26c03f6df831 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:39.232284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-419ab6e9-9811-46e8-85fa-26c03f6df831 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:39.360101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-419ab6e9-9811-46e8-85fa-26c03f6df831 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:39.367409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-419ab6e9-9811-46e8-85fa-26c03f6df831 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.146867 Sep 14 19:48:39.367987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 600/1209] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:39 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:39.475585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b722e2e5-813a-48e5-9a06-aea70d1ebcdc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:39.476506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b722e2e5-813a-48e5-9a06-aea70d1ebcdc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:39.482348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b722e2e5-813a-48e5-9a06-aea70d1ebcdc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:39.482729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b722e2e5-813a-48e5-9a06-aea70d1ebcdc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:39.483481 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b722e2e5-813a-48e5-9a06-aea70d1ebcdc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:39.484982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b722e2e5-813a-48e5-9a06-aea70d1ebcdc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:39.513389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b722e2e5-813a-48e5-9a06-aea70d1ebcdc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041624 Sep 14 19:48:39.513967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 610/1210] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:39 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:39.739496 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-058b7527-0b9d-4e39-afa0-4ff533cfcb27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:39.740345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-058b7527-0b9d-4e39-afa0-4ff533cfcb27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:39.746345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-058b7527-0b9d-4e39-afa0-4ff533cfcb27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:39.746795 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-058b7527-0b9d-4e39-afa0-4ff533cfcb27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:39.747560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-058b7527-0b9d-4e39-afa0-4ff533cfcb27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:39.747999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-058b7527-0b9d-4e39-afa0-4ff533cfcb27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:39.777536 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-058b7527-0b9d-4e39-afa0-4ff533cfcb27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041854 Sep 14 19:48:39.778085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 601/1211] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:39 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:40.019641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f1bb38d0-792d-4d7a-8da3-990062cac72e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:40.020517 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f1bb38d0-792d-4d7a-8da3-990062cac72e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:40.026363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f1bb38d0-792d-4d7a-8da3-990062cac72e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:40.026819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f1bb38d0-792d-4d7a-8da3-990062cac72e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:40.027688 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f1bb38d0-792d-4d7a-8da3-990062cac72e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:40.028129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f1bb38d0-792d-4d7a-8da3-990062cac72e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:40.057989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f1bb38d0-792d-4d7a-8da3-990062cac72e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042698 Sep 14 19:48:40.058561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 611/1212] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:40 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:40.384055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7506c80d-0b8a-4821-951e-1fecb4157894 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:40.384659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7506c80d-0b8a-4821-951e-1fecb4157894 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:40.391053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7506c80d-0b8a-4821-951e-1fecb4157894 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:40.391501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7506c80d-0b8a-4821-951e-1fecb4157894 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:40.392263 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7506c80d-0b8a-4821-951e-1fecb4157894 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:40.392696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7506c80d-0b8a-4821-951e-1fecb4157894 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:40.509267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7506c80d-0b8a-4821-951e-1fecb4157894 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:40.517375 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7506c80d-0b8a-4821-951e-1fecb4157894 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.137009 Sep 14 19:48:40.517986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 602/1213] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:40 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:40.525379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8b135396-fb8b-4a8e-8ae5-1bdfbb8515bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:40.526393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8b135396-fb8b-4a8e-8ae5-1bdfbb8515bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:40.532187 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b135396-fb8b-4a8e-8ae5-1bdfbb8515bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:40.532642 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b135396-fb8b-4a8e-8ae5-1bdfbb8515bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:40.533411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b135396-fb8b-4a8e-8ae5-1bdfbb8515bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:40.533889 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b135396-fb8b-4a8e-8ae5-1bdfbb8515bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:40.561936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8b135396-fb8b-4a8e-8ae5-1bdfbb8515bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040455 Sep 14 19:48:40.563004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 612/1214] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:40.789516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fa63147e-50f0-4c60-8297-e218b1a841cc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:40.790463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fa63147e-50f0-4c60-8297-e218b1a841cc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:40.796991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa63147e-50f0-4c60-8297-e218b1a841cc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:40.797439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa63147e-50f0-4c60-8297-e218b1a841cc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:40.798501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa63147e-50f0-4c60-8297-e218b1a841cc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:40.798964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa63147e-50f0-4c60-8297-e218b1a841cc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:40.828916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fa63147e-50f0-4c60-8297-e218b1a841cc tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 Sep 14 19:48:40.829545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 603/1215] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:40 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:41.069671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ed137f08-ba2c-4356-a218-362ee4b4a682 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:41.070502 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ed137f08-ba2c-4356-a218-362ee4b4a682 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:41.076323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed137f08-ba2c-4356-a218-362ee4b4a682 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:41.076770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed137f08-ba2c-4356-a218-362ee4b4a682 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:41.077557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed137f08-ba2c-4356-a218-362ee4b4a682 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:41.077993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed137f08-ba2c-4356-a218-362ee4b4a682 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:41.105633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ed137f08-ba2c-4356-a218-362ee4b4a682 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039783 Sep 14 19:48:41.106176 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 613/1216] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:41 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:41.535328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0e580f67-42d1-4a4f-afda-33470f87ef29 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:41.535921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0e580f67-42d1-4a4f-afda-33470f87ef29 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:41.541775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0e580f67-42d1-4a4f-afda-33470f87ef29 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:41.542210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0e580f67-42d1-4a4f-afda-33470f87ef29 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:41.542968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0e580f67-42d1-4a4f-afda-33470f87ef29 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:41.543399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0e580f67-42d1-4a4f-afda-33470f87ef29 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:41.574628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b7781004-f0dc-4f3d-8a41-6f05556e082d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:41.575642 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b7781004-f0dc-4f3d-8a41-6f05556e082d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:41.582368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7781004-f0dc-4f3d-8a41-6f05556e082d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:41.582908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7781004-f0dc-4f3d-8a41-6f05556e082d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:41.583805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7781004-f0dc-4f3d-8a41-6f05556e082d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:41.584463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b7781004-f0dc-4f3d-8a41-6f05556e082d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:41.615849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b7781004-f0dc-4f3d-8a41-6f05556e082d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045046 Sep 14 19:48:41.616692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 614/1217] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:41 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:48:41.667332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0e580f67-42d1-4a4f-afda-33470f87ef29 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:41.674889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0e580f67-42d1-4a4f-afda-33470f87ef29 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.143921 Sep 14 19:48:41.675460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 604/1218] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:41 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:41.840739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-00350895-4411-4ba8-9205-a6ba8d0d0fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:41.841734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-00350895-4411-4ba8-9205-a6ba8d0d0fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:41.848244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00350895-4411-4ba8-9205-a6ba8d0d0fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:41.848699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00350895-4411-4ba8-9205-a6ba8d0d0fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:41.849470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00350895-4411-4ba8-9205-a6ba8d0d0fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:41.849933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00350895-4411-4ba8-9205-a6ba8d0d0fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:41.877712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-00350895-4411-4ba8-9205-a6ba8d0d0fe7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040813 Sep 14 19:48:41.878275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 615/1219] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:41 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:42.117606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-41430620-d887-452f-ba92-69c5f6eec543 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:42.118606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-41430620-d887-452f-ba92-69c5f6eec543 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:42.124380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41430620-d887-452f-ba92-69c5f6eec543 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:42.125378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41430620-d887-452f-ba92-69c5f6eec543 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:42.126153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41430620-d887-452f-ba92-69c5f6eec543 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:42.126584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41430620-d887-452f-ba92-69c5f6eec543 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:42.154731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-41430620-d887-452f-ba92-69c5f6eec543 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040978 Sep 14 19:48:42.155272 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 605/1220] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:42 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:42.628365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1989be7d-3886-466c-9691-cc563cbd9621 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:42.629299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1989be7d-3886-466c-9691-cc563cbd9621 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:42.635138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1989be7d-3886-466c-9691-cc563cbd9621 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:42.635583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1989be7d-3886-466c-9691-cc563cbd9621 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:42.636344 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1989be7d-3886-466c-9691-cc563cbd9621 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:42.636774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1989be7d-3886-466c-9691-cc563cbd9621 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:42.665088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1989be7d-3886-466c-9691-cc563cbd9621 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041185 Sep 14 19:48:42.665688 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 616/1221] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:42 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:42.691031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5609863d-d66b-4a19-97a8-8cff48cba21a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:42.691642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5609863d-d66b-4a19-97a8-8cff48cba21a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:42.697417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5609863d-d66b-4a19-97a8-8cff48cba21a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:42.697898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5609863d-d66b-4a19-97a8-8cff48cba21a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:42.698893 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5609863d-d66b-4a19-97a8-8cff48cba21a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:42.699333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5609863d-d66b-4a19-97a8-8cff48cba21a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:42.821049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5609863d-d66b-4a19-97a8-8cff48cba21a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:42.828366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5609863d-d66b-4a19-97a8-8cff48cba21a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140982 Sep 14 19:48:42.828938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 606/1222] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:42 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:42.891634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4ebb71c9-f9a1-4733-8453-d52b175322a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:42.891634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4ebb71c9-f9a1-4733-8453-d52b175322a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:42.895742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4ebb71c9-f9a1-4733-8453-d52b175322a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:42.896194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4ebb71c9-f9a1-4733-8453-d52b175322a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:42.897094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4ebb71c9-f9a1-4733-8453-d52b175322a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:42.897568 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4ebb71c9-f9a1-4733-8453-d52b175322a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:42.927608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4ebb71c9-f9a1-4733-8453-d52b175322a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042384 Sep 14 19:48:42.928172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 617/1223] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:42 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:43.166143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c74748c5-cf41-4b80-b445-fa7e2164e853 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:43.167019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c74748c5-cf41-4b80-b445-fa7e2164e853 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:43.173108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c74748c5-cf41-4b80-b445-fa7e2164e853 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:43.173589 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c74748c5-cf41-4b80-b445-fa7e2164e853 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:43.174356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c74748c5-cf41-4b80-b445-fa7e2164e853 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:43.174792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c74748c5-cf41-4b80-b445-fa7e2164e853 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:43.203128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c74748c5-cf41-4b80-b445-fa7e2164e853 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040252 Sep 14 19:48:43.203692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 607/1224] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:43 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:43.677873 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e21d316c-06cc-45c2-b6f3-d7c29437cc1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:43.678779 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e21d316c-06cc-45c2-b6f3-d7c29437cc1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:43.684660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e21d316c-06cc-45c2-b6f3-d7c29437cc1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:43.685105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e21d316c-06cc-45c2-b6f3-d7c29437cc1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:43.685911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e21d316c-06cc-45c2-b6f3-d7c29437cc1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:43.686353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e21d316c-06cc-45c2-b6f3-d7c29437cc1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:43.716824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e21d316c-06cc-45c2-b6f3-d7c29437cc1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042887 Sep 14 19:48:43.717389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 618/1225] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:43.845265 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c716d27e-d506-4d80-9baf-c424c8148378 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:43.845933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c716d27e-d506-4d80-9baf-c424c8148378 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:43.851724 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c716d27e-d506-4d80-9baf-c424c8148378 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:43.852176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c716d27e-d506-4d80-9baf-c424c8148378 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:43.852940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c716d27e-d506-4d80-9baf-c424c8148378 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:43.853375 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c716d27e-d506-4d80-9baf-c424c8148378 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:43.939048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-37204946-6b87-4a4d-8f1e-1b5d1cb78038 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:43.939956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-37204946-6b87-4a4d-8f1e-1b5d1cb78038 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:43.945884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37204946-6b87-4a4d-8f1e-1b5d1cb78038 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:43.946333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37204946-6b87-4a4d-8f1e-1b5d1cb78038 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:43.947107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37204946-6b87-4a4d-8f1e-1b5d1cb78038 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:43.947544 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37204946-6b87-4a4d-8f1e-1b5d1cb78038 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:43.971080 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c716d27e-d506-4d80-9baf-c424c8148378 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:43.976518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-37204946-6b87-4a4d-8f1e-1b5d1cb78038 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041688 Sep 14 19:48:43.977097 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 619/1226] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:43 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:43.978554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c716d27e-d506-4d80-9baf-c424c8148378 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.136897 Sep 14 19:48:43.979194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 608/1227] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:43 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:48:44.214421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-581cbc3f-570e-4407-9e60-f20caf4cc166 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:44.215237 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-581cbc3f-570e-4407-9e60-f20caf4cc166 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:44.221666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-581cbc3f-570e-4407-9e60-f20caf4cc166 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:44.222109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-581cbc3f-570e-4407-9e60-f20caf4cc166 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:44.222861 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-581cbc3f-570e-4407-9e60-f20caf4cc166 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:44.223289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-581cbc3f-570e-4407-9e60-f20caf4cc166 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:44.251575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-581cbc3f-570e-4407-9e60-f20caf4cc166 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040925 Sep 14 19:48:44.252112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 620/1228] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:44 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:44.730005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-355543e9-aa18-4f63-8182-cfec9cc149a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:44.730909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-355543e9-aa18-4f63-8182-cfec9cc149a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:44.736703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-355543e9-aa18-4f63-8182-cfec9cc149a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:44.737150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-355543e9-aa18-4f63-8182-cfec9cc149a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:44.737960 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-355543e9-aa18-4f63-8182-cfec9cc149a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:44.738390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-355543e9-aa18-4f63-8182-cfec9cc149a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:44.766804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-355543e9-aa18-4f63-8182-cfec9cc149a2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040671 Sep 14 19:48:44.767277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 609/1229] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:44.987469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-85120b1e-613c-4079-96db-824d7cee4949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:44.988368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-85120b1e-613c-4079-96db-824d7cee4949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:44.994414 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85120b1e-613c-4079-96db-824d7cee4949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:44.994859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85120b1e-613c-4079-96db-824d7cee4949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:44.995626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85120b1e-613c-4079-96db-824d7cee4949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:44.995823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a1871542-4b0f-4096-8f6f-b0f1d7097270 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:44.996056 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85120b1e-613c-4079-96db-824d7cee4949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:44.996433 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a1871542-4b0f-4096-8f6f-b0f1d7097270 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:45.002836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a1871542-4b0f-4096-8f6f-b0f1d7097270 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:45.003288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a1871542-4b0f-4096-8f6f-b0f1d7097270 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:45.004055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a1871542-4b0f-4096-8f6f-b0f1d7097270 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:45.004567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a1871542-4b0f-4096-8f6f-b0f1d7097270 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:45.027033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-85120b1e-613c-4079-96db-824d7cee4949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Sep 14 19:48:45.027626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 621/1230] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:44 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:45.122364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a1871542-4b0f-4096-8f6f-b0f1d7097270 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:45.130250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a1871542-4b0f-4096-8f6f-b0f1d7097270 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138116 Sep 14 19:48:45.130837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 610/1231] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:44 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:48:45.262430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0de07984-e321-4e89-b4d1-de5b78aa0898 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:45.263357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0de07984-e321-4e89-b4d1-de5b78aa0898 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:45.269926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0de07984-e321-4e89-b4d1-de5b78aa0898 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:45.270376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0de07984-e321-4e89-b4d1-de5b78aa0898 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:45.271164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0de07984-e321-4e89-b4d1-de5b78aa0898 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:45.271603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0de07984-e321-4e89-b4d1-de5b78aa0898 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:45.301472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0de07984-e321-4e89-b4d1-de5b78aa0898 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042857 Sep 14 19:48:45.301988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 622/1232] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:45 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:45.778358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-93bdd227-d6b1-4e00-a449-023d902c264d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:45.779331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-93bdd227-d6b1-4e00-a449-023d902c264d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:45.785733 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93bdd227-d6b1-4e00-a449-023d902c264d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:45.786175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93bdd227-d6b1-4e00-a449-023d902c264d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:45.786918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93bdd227-d6b1-4e00-a449-023d902c264d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:45.787401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93bdd227-d6b1-4e00-a449-023d902c264d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:45.819940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-93bdd227-d6b1-4e00-a449-023d902c264d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045401 Sep 14 19:48:45.820530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 611/1233] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:46.038581 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f704d0e0-5d1d-47d8-9a1e-df7e10afe3cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:46.039463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f704d0e0-5d1d-47d8-9a1e-df7e10afe3cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:46.045406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f704d0e0-5d1d-47d8-9a1e-df7e10afe3cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:46.045900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f704d0e0-5d1d-47d8-9a1e-df7e10afe3cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:46.046736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f704d0e0-5d1d-47d8-9a1e-df7e10afe3cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:46.047174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f704d0e0-5d1d-47d8-9a1e-df7e10afe3cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:46.076052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f704d0e0-5d1d-47d8-9a1e-df7e10afe3cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041316 Sep 14 19:48:46.076608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 623/1234] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:46 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:46.146757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-03bd0920-4570-474f-8475-bb749e2a57aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:46.147511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-03bd0920-4570-474f-8475-bb749e2a57aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:46.153653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03bd0920-4570-474f-8475-bb749e2a57aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:46.154104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03bd0920-4570-474f-8475-bb749e2a57aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:46.154874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03bd0920-4570-474f-8475-bb749e2a57aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:46.155306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-03bd0920-4570-474f-8475-bb749e2a57aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:46.277905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-03bd0920-4570-474f-8475-bb749e2a57aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:46.285964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-03bd0920-4570-474f-8475-bb749e2a57aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142765 Sep 14 19:48:46.286612 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 612/1235] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:46 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:46.312782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3763f7d7-8aff-4cf7-ad11-68a3e1e92eba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:46.313656 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3763f7d7-8aff-4cf7-ad11-68a3e1e92eba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:46.319534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3763f7d7-8aff-4cf7-ad11-68a3e1e92eba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:46.319983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3763f7d7-8aff-4cf7-ad11-68a3e1e92eba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:46.320752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3763f7d7-8aff-4cf7-ad11-68a3e1e92eba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:46.321244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3763f7d7-8aff-4cf7-ad11-68a3e1e92eba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:46.350470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3763f7d7-8aff-4cf7-ad11-68a3e1e92eba tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041608 Sep 14 19:48:46.351023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 624/1236] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:46 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:46.831569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e7baf2ba-f3be-43a5-a951-2bc6048130ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:46.832469 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e7baf2ba-f3be-43a5-a951-2bc6048130ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:46.838759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7baf2ba-f3be-43a5-a951-2bc6048130ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:46.839208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7baf2ba-f3be-43a5-a951-2bc6048130ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:46.839977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7baf2ba-f3be-43a5-a951-2bc6048130ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:46.840485 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7baf2ba-f3be-43a5-a951-2bc6048130ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:46.868982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e7baf2ba-f3be-43a5-a951-2bc6048130ac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041249 Sep 14 19:48:46.869556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 613/1237] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:47.088022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e71d9220-6210-47bd-9b07-368a05efa64a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:47.088860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e71d9220-6210-47bd-9b07-368a05efa64a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:47.094692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e71d9220-6210-47bd-9b07-368a05efa64a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:47.095145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e71d9220-6210-47bd-9b07-368a05efa64a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:47.095918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e71d9220-6210-47bd-9b07-368a05efa64a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:47.096353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e71d9220-6210-47bd-9b07-368a05efa64a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:47.125664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e71d9220-6210-47bd-9b07-368a05efa64a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041433 Sep 14 19:48:47.126221 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 625/1238] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:47 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:47.303744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a7c028c3-d4cf-4e7c-be52-1f8f64c96174 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:47.304354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a7c028c3-d4cf-4e7c-be52-1f8f64c96174 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:47.310214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7c028c3-d4cf-4e7c-be52-1f8f64c96174 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:47.310672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7c028c3-d4cf-4e7c-be52-1f8f64c96174 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:47.311445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7c028c3-d4cf-4e7c-be52-1f8f64c96174 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:47.311883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7c028c3-d4cf-4e7c-be52-1f8f64c96174 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:47.362819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-11b072a2-36dd-4d1a-8ed4-d029e48f2241 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:47.363968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-11b072a2-36dd-4d1a-8ed4-d029e48f2241 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:47.369726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11b072a2-36dd-4d1a-8ed4-d029e48f2241 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:47.370250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11b072a2-36dd-4d1a-8ed4-d029e48f2241 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:47.371017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11b072a2-36dd-4d1a-8ed4-d029e48f2241 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:47.371445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-11b072a2-36dd-4d1a-8ed4-d029e48f2241 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:47.399662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-11b072a2-36dd-4d1a-8ed4-d029e48f2241 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 Sep 14 19:48:47.400218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 626/1239] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:47 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:47.430805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a7c028c3-d4cf-4e7c-be52-1f8f64c96174 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:47.438165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a7c028c3-d4cf-4e7c-be52-1f8f64c96174 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138131 Sep 14 19:48:47.438687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 614/1240] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:47 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:47.879937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a7172597-90f9-4b87-b99c-4f7b229de2d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:47.880828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a7172597-90f9-4b87-b99c-4f7b229de2d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:47.886644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7172597-90f9-4b87-b99c-4f7b229de2d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:47.887086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7172597-90f9-4b87-b99c-4f7b229de2d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:47.887851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7172597-90f9-4b87-b99c-4f7b229de2d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:47.888279 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7172597-90f9-4b87-b99c-4f7b229de2d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:47.917961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a7172597-90f9-4b87-b99c-4f7b229de2d6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041728 Sep 14 19:48:47.918510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 627/1241] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:47 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:48.136216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ecd2efef-d8dd-47dc-a52e-d91ccbea49b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:48.137161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ecd2efef-d8dd-47dc-a52e-d91ccbea49b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:48.143655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecd2efef-d8dd-47dc-a52e-d91ccbea49b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:48.144140 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecd2efef-d8dd-47dc-a52e-d91ccbea49b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:48.144910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecd2efef-d8dd-47dc-a52e-d91ccbea49b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:48.145349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecd2efef-d8dd-47dc-a52e-d91ccbea49b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:48.174028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ecd2efef-d8dd-47dc-a52e-d91ccbea49b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041528 Sep 14 19:48:48.174580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 615/1242] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:48 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:48.410226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5848e67a-ff8b-4c8b-9f90-adaaad7f718f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:48.411095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5848e67a-ff8b-4c8b-9f90-adaaad7f718f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:48.417008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5848e67a-ff8b-4c8b-9f90-adaaad7f718f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:48.417457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5848e67a-ff8b-4c8b-9f90-adaaad7f718f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:48.418255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5848e67a-ff8b-4c8b-9f90-adaaad7f718f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:48.418694 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5848e67a-ff8b-4c8b-9f90-adaaad7f718f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:48.447928 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5848e67a-ff8b-4c8b-9f90-adaaad7f718f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 Sep 14 19:48:48.448493 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 628/1243] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:48 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:48.454194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b36ee2a7-4ed3-4a6c-aaaa-cb640b74ebaf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:48.454800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b36ee2a7-4ed3-4a6c-aaaa-cb640b74ebaf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:48.460516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b36ee2a7-4ed3-4a6c-aaaa-cb640b74ebaf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:48.460961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b36ee2a7-4ed3-4a6c-aaaa-cb640b74ebaf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:48.461753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b36ee2a7-4ed3-4a6c-aaaa-cb640b74ebaf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:48.462186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b36ee2a7-4ed3-4a6c-aaaa-cb640b74ebaf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:48.583247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b36ee2a7-4ed3-4a6c-aaaa-cb640b74ebaf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:48.589438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b36ee2a7-4ed3-4a6c-aaaa-cb640b74ebaf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138794 Sep 14 19:48:48.590035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 616/1244] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:48 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:48:48.930158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f155b5c2-9817-41af-801d-4f2177bec5a8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:48.931061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f155b5c2-9817-41af-801d-4f2177bec5a8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:48.937642 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f155b5c2-9817-41af-801d-4f2177bec5a8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:48.938092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f155b5c2-9817-41af-801d-4f2177bec5a8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:48.938865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f155b5c2-9817-41af-801d-4f2177bec5a8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:48.939298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f155b5c2-9817-41af-801d-4f2177bec5a8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:48.967211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f155b5c2-9817-41af-801d-4f2177bec5a8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041475 Sep 14 19:48:48.967756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 629/1245] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:48 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:49.184954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7384bc7a-836c-4dd0-93d5-5d99159d74d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:49.186238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7384bc7a-836c-4dd0-93d5-5d99159d74d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:49.192432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7384bc7a-836c-4dd0-93d5-5d99159d74d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:49.192908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7384bc7a-836c-4dd0-93d5-5d99159d74d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:49.193706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7384bc7a-836c-4dd0-93d5-5d99159d74d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:49.194132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7384bc7a-836c-4dd0-93d5-5d99159d74d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:49.223367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7384bc7a-836c-4dd0-93d5-5d99159d74d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042560 Sep 14 19:48:49.223929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 617/1246] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:49 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:49.459898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-40501ad1-1550-42ee-8e42-834799664a8f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:49.460727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-40501ad1-1550-42ee-8e42-834799664a8f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:49.466654 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40501ad1-1550-42ee-8e42-834799664a8f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:49.467102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40501ad1-1550-42ee-8e42-834799664a8f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:49.467867 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40501ad1-1550-42ee-8e42-834799664a8f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:49.468326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40501ad1-1550-42ee-8e42-834799664a8f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:49.496667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-40501ad1-1550-42ee-8e42-834799664a8f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040609 Sep 14 19:48:49.497226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 630/1247] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:49 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:49.605521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-abac0177-564c-4bf7-a35e-7cd7a4b73424 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:49.606125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-abac0177-564c-4bf7-a35e-7cd7a4b73424 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:49.611981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-abac0177-564c-4bf7-a35e-7cd7a4b73424 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:49.612424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-abac0177-564c-4bf7-a35e-7cd7a4b73424 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:49.613177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-abac0177-564c-4bf7-a35e-7cd7a4b73424 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:49.613635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-abac0177-564c-4bf7-a35e-7cd7a4b73424 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:49.736085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-abac0177-564c-4bf7-a35e-7cd7a4b73424 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:49.743549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-abac0177-564c-4bf7-a35e-7cd7a4b73424 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.141692 Sep 14 19:48:49.744125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 618/1248] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:49 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:49.979930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-421c7692-0f57-4318-bc5e-1a8bd2b5afc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:49.981011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-421c7692-0f57-4318-bc5e-1a8bd2b5afc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:49.987621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-421c7692-0f57-4318-bc5e-1a8bd2b5afc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:49.987998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-421c7692-0f57-4318-bc5e-1a8bd2b5afc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:49.988755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-421c7692-0f57-4318-bc5e-1a8bd2b5afc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:49.989180 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-421c7692-0f57-4318-bc5e-1a8bd2b5afc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:50.017682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-421c7692-0f57-4318-bc5e-1a8bd2b5afc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041785 Sep 14 19:48:50.018232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 631/1249] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:49 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:50.234802 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f88ac909-f014-456d-8448-9a68054062c7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:50.235714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f88ac909-f014-456d-8448-9a68054062c7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:50.247291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f88ac909-f014-456d-8448-9a68054062c7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:50.247291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f88ac909-f014-456d-8448-9a68054062c7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:50.247291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f88ac909-f014-456d-8448-9a68054062c7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:50.247291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f88ac909-f014-456d-8448-9a68054062c7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:50.272545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f88ac909-f014-456d-8448-9a68054062c7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 Sep 14 19:48:50.273156 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 619/1250] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:50 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:50.508447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7d317a6e-1ed7-4081-bb7b-7235ecc6e3c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:50.509331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7d317a6e-1ed7-4081-bb7b-7235ecc6e3c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:50.515613 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d317a6e-1ed7-4081-bb7b-7235ecc6e3c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:50.516110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d317a6e-1ed7-4081-bb7b-7235ecc6e3c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:50.516879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d317a6e-1ed7-4081-bb7b-7235ecc6e3c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:50.517310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d317a6e-1ed7-4081-bb7b-7235ecc6e3c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:50.546268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7d317a6e-1ed7-4081-bb7b-7235ecc6e3c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041440 Sep 14 19:48:50.546829 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 632/1251] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:50 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:50.761366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-01c5461e-326f-4935-ace3-264be1574631 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:50.761911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-01c5461e-326f-4935-ace3-264be1574631 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:50.768263 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-01c5461e-326f-4935-ace3-264be1574631 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:50.768712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-01c5461e-326f-4935-ace3-264be1574631 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:50.769475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-01c5461e-326f-4935-ace3-264be1574631 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:50.769938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-01c5461e-326f-4935-ace3-264be1574631 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:50.888425 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-01c5461e-326f-4935-ace3-264be1574631 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:50.896270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-01c5461e-326f-4935-ace3-264be1574631 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138751 Sep 14 19:48:50.896844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 620/1252] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:50 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:51.029033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6044312c-37ad-4f85-afce-dbd1b87f52c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:51.029925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6044312c-37ad-4f85-afce-dbd1b87f52c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:51.035709 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6044312c-37ad-4f85-afce-dbd1b87f52c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:51.036159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6044312c-37ad-4f85-afce-dbd1b87f52c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:51.036919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6044312c-37ad-4f85-afce-dbd1b87f52c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:51.037352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6044312c-37ad-4f85-afce-dbd1b87f52c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:51.065983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6044312c-37ad-4f85-afce-dbd1b87f52c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040756 Sep 14 19:48:51.066528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 633/1253] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:51 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:51.284366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-227a17f7-eba1-44f1-84bc-0e5a0ec6d59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:51.285305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-227a17f7-eba1-44f1-84bc-0e5a0ec6d59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:51.291226 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-227a17f7-eba1-44f1-84bc-0e5a0ec6d59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:51.291671 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-227a17f7-eba1-44f1-84bc-0e5a0ec6d59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:51.292437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-227a17f7-eba1-44f1-84bc-0e5a0ec6d59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:51.292873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-227a17f7-eba1-44f1-84bc-0e5a0ec6d59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:51.322393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-227a17f7-eba1-44f1-84bc-0e5a0ec6d59e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041892 Sep 14 19:48:51.322954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 621/1254] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:51 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:51.557936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ea1caf9f-a253-457c-8c8c-399d0103ed24 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:51.558752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ea1caf9f-a253-457c-8c8c-399d0103ed24 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:51.565103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea1caf9f-a253-457c-8c8c-399d0103ed24 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:51.565566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea1caf9f-a253-457c-8c8c-399d0103ed24 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:51.566329 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea1caf9f-a253-457c-8c8c-399d0103ed24 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:51.566761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea1caf9f-a253-457c-8c8c-399d0103ed24 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:51.595671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ea1caf9f-a253-457c-8c8c-399d0103ed24 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041483 Sep 14 19:48:51.596218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 634/1255] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:51 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:51.914036 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b25b7ebf-b0ee-4189-bd7e-612ffc818bf8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:51.914650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b25b7ebf-b0ee-4189-bd7e-612ffc818bf8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:51.920692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b25b7ebf-b0ee-4189-bd7e-612ffc818bf8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:51.921140 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b25b7ebf-b0ee-4189-bd7e-612ffc818bf8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:51.921950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b25b7ebf-b0ee-4189-bd7e-612ffc818bf8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:51.922388 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b25b7ebf-b0ee-4189-bd7e-612ffc818bf8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:52.041294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b25b7ebf-b0ee-4189-bd7e-612ffc818bf8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:52.048822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b25b7ebf-b0ee-4189-bd7e-612ffc818bf8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138556 Sep 14 19:48:52.049390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 622/1256] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:51 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:52.077433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ce808507-1ea5-42b8-93fa-aa1e5842d32c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:52.078420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ce808507-1ea5-42b8-93fa-aa1e5842d32c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:52.084702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce808507-1ea5-42b8-93fa-aa1e5842d32c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:52.085151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce808507-1ea5-42b8-93fa-aa1e5842d32c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:52.085960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce808507-1ea5-42b8-93fa-aa1e5842d32c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:52.086401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce808507-1ea5-42b8-93fa-aa1e5842d32c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:52.115977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ce808507-1ea5-42b8-93fa-aa1e5842d32c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042299 Sep 14 19:48:52.116572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 635/1257] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:52.334622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fd2e2664-3941-4460-af94-4975a3f09425 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:52.335696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fd2e2664-3941-4460-af94-4975a3f09425 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:52.341896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd2e2664-3941-4460-af94-4975a3f09425 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:52.342335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd2e2664-3941-4460-af94-4975a3f09425 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:52.343094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd2e2664-3941-4460-af94-4975a3f09425 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:52.343518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd2e2664-3941-4460-af94-4975a3f09425 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:52.372032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fd2e2664-3941-4460-af94-4975a3f09425 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041307 Sep 14 19:48:52.372501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 623/1258] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:52 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:52.607010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0d9a80e5-8544-419f-91a1-5d431adaac4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:52.607919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0d9a80e5-8544-419f-91a1-5d431adaac4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:52.613762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d9a80e5-8544-419f-91a1-5d431adaac4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:52.614216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d9a80e5-8544-419f-91a1-5d431adaac4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:52.614981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d9a80e5-8544-419f-91a1-5d431adaac4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:52.615420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d9a80e5-8544-419f-91a1-5d431adaac4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:52.644999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0d9a80e5-8544-419f-91a1-5d431adaac4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 Sep 14 19:48:52.645462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 636/1259] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:52 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:53.066207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-41bd5839-ab01-49c1-977c-50d32c31f0c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:53.066758 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-41bd5839-ab01-49c1-977c-50d32c31f0c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:53.072606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41bd5839-ab01-49c1-977c-50d32c31f0c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:53.073083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41bd5839-ab01-49c1-977c-50d32c31f0c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:53.073875 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41bd5839-ab01-49c1-977c-50d32c31f0c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:53.074303 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41bd5839-ab01-49c1-977c-50d32c31f0c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:53.134041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e91d70a0-5cd6-4756-ad41-ea8fcb711843 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:53.135252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e91d70a0-5cd6-4756-ad41-ea8fcb711843 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:53.141112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e91d70a0-5cd6-4756-ad41-ea8fcb711843 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:53.141590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e91d70a0-5cd6-4756-ad41-ea8fcb711843 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:53.142377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e91d70a0-5cd6-4756-ad41-ea8fcb711843 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:53.142847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e91d70a0-5cd6-4756-ad41-ea8fcb711843 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:53.173174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e91d70a0-5cd6-4756-ad41-ea8fcb711843 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042259 Sep 14 19:48:53.173764 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 637/1260] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:53 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:48:53.196937 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-41bd5839-ab01-49c1-977c-50d32c31f0c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:53.204492 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-41bd5839-ab01-49c1-977c-50d32c31f0c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142700 Sep 14 19:48:53.205055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 624/1261] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:53 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:53.383905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0a3c2cdb-875f-4cbc-83eb-80c8690cd145 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:53.384813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0a3c2cdb-875f-4cbc-83eb-80c8690cd145 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:53.390759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a3c2cdb-875f-4cbc-83eb-80c8690cd145 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:53.391207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a3c2cdb-875f-4cbc-83eb-80c8690cd145 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:53.391970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a3c2cdb-875f-4cbc-83eb-80c8690cd145 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:53.392408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a3c2cdb-875f-4cbc-83eb-80c8690cd145 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:53.421220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0a3c2cdb-875f-4cbc-83eb-80c8690cd145 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041083 Sep 14 19:48:53.421791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 638/1262] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:53 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:53.655672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b9dc2f63-eede-4d6b-9853-311555cc7b1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:53.656497 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b9dc2f63-eede-4d6b-9853-311555cc7b1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:53.662985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b9dc2f63-eede-4d6b-9853-311555cc7b1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:53.663434 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b9dc2f63-eede-4d6b-9853-311555cc7b1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:53.664202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b9dc2f63-eede-4d6b-9853-311555cc7b1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:53.664636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b9dc2f63-eede-4d6b-9853-311555cc7b1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:53.694255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b9dc2f63-eede-4d6b-9853-311555cc7b1f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042366 Sep 14 19:48:53.694815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 625/1263] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:53 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:54.184781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c8a617a6-ebef-47a2-bbfb-0cc77727ddd4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:54.185721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c8a617a6-ebef-47a2-bbfb-0cc77727ddd4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:54.192083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8a617a6-ebef-47a2-bbfb-0cc77727ddd4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:54.192536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8a617a6-ebef-47a2-bbfb-0cc77727ddd4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:54.193307 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8a617a6-ebef-47a2-bbfb-0cc77727ddd4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:54.193766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8a617a6-ebef-47a2-bbfb-0cc77727ddd4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:54.221120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d58d5160-3ebf-40ee-98dc-f670f3a6383a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:54.221753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d58d5160-3ebf-40ee-98dc-f670f3a6383a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:54.222380 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c8a617a6-ebef-47a2-bbfb-0cc77727ddd4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041435 Sep 14 19:48:54.222946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 639/1264] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:54.227609 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d58d5160-3ebf-40ee-98dc-f670f3a6383a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:54.228049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d58d5160-3ebf-40ee-98dc-f670f3a6383a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:54.228821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d58d5160-3ebf-40ee-98dc-f670f3a6383a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:54.229249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d58d5160-3ebf-40ee-98dc-f670f3a6383a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:54.347150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d58d5160-3ebf-40ee-98dc-f670f3a6383a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:54.354416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d58d5160-3ebf-40ee-98dc-f670f3a6383a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.137099 Sep 14 19:48:54.354982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 626/1265] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:54 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:48:54.432971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5bacee9b-b5c7-41b2-b596-570cf85e3cca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:54.433908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5bacee9b-b5c7-41b2-b596-570cf85e3cca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:54.440424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5bacee9b-b5c7-41b2-b596-570cf85e3cca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:54.440820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5bacee9b-b5c7-41b2-b596-570cf85e3cca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:54.441625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5bacee9b-b5c7-41b2-b596-570cf85e3cca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:54.442065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5bacee9b-b5c7-41b2-b596-570cf85e3cca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:54.470542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5bacee9b-b5c7-41b2-b596-570cf85e3cca tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 Sep 14 19:48:54.478628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 640/1266] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:54 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:54.705642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0731d1d8-b4ba-4699-9063-53fe6a71eb32 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:54.706473 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0731d1d8-b4ba-4699-9063-53fe6a71eb32 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:54.712412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0731d1d8-b4ba-4699-9063-53fe6a71eb32 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:54.712860 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0731d1d8-b4ba-4699-9063-53fe6a71eb32 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:54.713689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0731d1d8-b4ba-4699-9063-53fe6a71eb32 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:54.714125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0731d1d8-b4ba-4699-9063-53fe6a71eb32 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:54.743389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0731d1d8-b4ba-4699-9063-53fe6a71eb32 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041777 Sep 14 19:48:54.743943 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 627/1267] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:54 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:55.233316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f37bf454-f570-491c-aef6-19ce9a0f83f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:55.234251 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f37bf454-f570-491c-aef6-19ce9a0f83f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:55.240492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f37bf454-f570-491c-aef6-19ce9a0f83f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:55.240948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f37bf454-f570-491c-aef6-19ce9a0f83f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:55.241760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f37bf454-f570-491c-aef6-19ce9a0f83f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:55.242230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f37bf454-f570-491c-aef6-19ce9a0f83f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:55.271297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f37bf454-f570-491c-aef6-19ce9a0f83f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041704 Sep 14 19:48:55.271865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 641/1268] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:55 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:55.371771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2a19f2ae-2448-432c-bbb5-b1c95226e57b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:55.372370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2a19f2ae-2448-432c-bbb5-b1c95226e57b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:55.378826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2a19f2ae-2448-432c-bbb5-b1c95226e57b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:55.379265 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2a19f2ae-2448-432c-bbb5-b1c95226e57b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:55.380015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2a19f2ae-2448-432c-bbb5-b1c95226e57b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:55.380439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2a19f2ae-2448-432c-bbb5-b1c95226e57b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:55.488130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f9340a19-22e4-4f4d-9025-4bb681370ac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:55.488958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f9340a19-22e4-4f4d-9025-4bb681370ac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:55.494639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9340a19-22e4-4f4d-9025-4bb681370ac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:55.495086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9340a19-22e4-4f4d-9025-4bb681370ac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:55.495888 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9340a19-22e4-4f4d-9025-4bb681370ac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:55.496286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9340a19-22e4-4f4d-9025-4bb681370ac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:55.498788 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2a19f2ae-2448-432c-bbb5-b1c95226e57b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:55.507171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2a19f2ae-2448-432c-bbb5-b1c95226e57b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138921 Sep 14 19:48:55.507964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 628/1269] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:55 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:55.526045 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f9340a19-22e4-4f4d-9025-4bb681370ac1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041757 Sep 14 19:48:55.526625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 642/1270] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:55 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:55.755629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-229b083c-1dd3-4422-87eb-f981f4e88c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:55.756451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-229b083c-1dd3-4422-87eb-f981f4e88c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:55.762545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-229b083c-1dd3-4422-87eb-f981f4e88c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:55.762993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-229b083c-1dd3-4422-87eb-f981f4e88c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:55.763772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-229b083c-1dd3-4422-87eb-f981f4e88c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:55.764225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-229b083c-1dd3-4422-87eb-f981f4e88c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:55.793200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-229b083c-1dd3-4422-87eb-f981f4e88c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 Sep 14 19:48:55.795113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 629/1271] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:55 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:56.283514 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-76b62a21-a423-4bb9-bee9-8d1988b8cbc9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:56.284410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-76b62a21-a423-4bb9-bee9-8d1988b8cbc9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:56.290402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76b62a21-a423-4bb9-bee9-8d1988b8cbc9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:56.290850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76b62a21-a423-4bb9-bee9-8d1988b8cbc9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:56.291615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76b62a21-a423-4bb9-bee9-8d1988b8cbc9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:56.292048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76b62a21-a423-4bb9-bee9-8d1988b8cbc9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:56.322076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-76b62a21-a423-4bb9-bee9-8d1988b8cbc9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042631 Sep 14 19:48:56.322558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 643/1272] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:56 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:48:56.524340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d428cbec-75b6-4fd1-97f6-5d21466bbe0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:56.526448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d428cbec-75b6-4fd1-97f6-5d21466bbe0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:56.534266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d428cbec-75b6-4fd1-97f6-5d21466bbe0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:56.534708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d428cbec-75b6-4fd1-97f6-5d21466bbe0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:56.535541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d428cbec-75b6-4fd1-97f6-5d21466bbe0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:56.535985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d428cbec-75b6-4fd1-97f6-5d21466bbe0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:56.538182 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-07130325-4108-466b-8079-bdbaac44eee6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:56.539102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-07130325-4108-466b-8079-bdbaac44eee6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:56.545487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-07130325-4108-466b-8079-bdbaac44eee6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:56.546078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-07130325-4108-466b-8079-bdbaac44eee6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:56.546854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-07130325-4108-466b-8079-bdbaac44eee6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:56.547320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-07130325-4108-466b-8079-bdbaac44eee6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:56.580526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-07130325-4108-466b-8079-bdbaac44eee6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Sep 14 19:48:56.581173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 644/1273] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:56 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:56.661191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d428cbec-75b6-4fd1-97f6-5d21466bbe0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:56.668694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d428cbec-75b6-4fd1-97f6-5d21466bbe0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.148181 Sep 14 19:48:56.669254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 630/1274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:56 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:56.808848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6aaa705b-23a7-455d-bebc-1937fb65c3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:56.809804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6aaa705b-23a7-455d-bebc-1937fb65c3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:56.816093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6aaa705b-23a7-455d-bebc-1937fb65c3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:56.816543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6aaa705b-23a7-455d-bebc-1937fb65c3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:56.817314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6aaa705b-23a7-455d-bebc-1937fb65c3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:56.817794 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6aaa705b-23a7-455d-bebc-1937fb65c3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:56.857105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6aaa705b-23a7-455d-bebc-1937fb65c3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051928 Sep 14 19:48:56.857811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 645/1275] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:56 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:57.334029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b6528c5e-5c3c-4004-8d14-aa05b66ddf7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:57.335638 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b6528c5e-5c3c-4004-8d14-aa05b66ddf7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:57.341869 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6528c5e-5c3c-4004-8d14-aa05b66ddf7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:57.342308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6528c5e-5c3c-4004-8d14-aa05b66ddf7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:57.343069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6528c5e-5c3c-4004-8d14-aa05b66ddf7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:57.343493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b6528c5e-5c3c-4004-8d14-aa05b66ddf7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:57.371766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b6528c5e-5c3c-4004-8d14-aa05b66ddf7c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041464 Sep 14 19:48:57.372312 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 631/1276] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:57 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:57.593459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-04c71317-7f5f-4e9c-b0a2-926a36d185fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:57.594908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-04c71317-7f5f-4e9c-b0a2-926a36d185fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:57.601079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04c71317-7f5f-4e9c-b0a2-926a36d185fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:57.601641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04c71317-7f5f-4e9c-b0a2-926a36d185fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:57.602454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04c71317-7f5f-4e9c-b0a2-926a36d185fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:57.602892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04c71317-7f5f-4e9c-b0a2-926a36d185fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:57.631919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-04c71317-7f5f-4e9c-b0a2-926a36d185fd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043239 Sep 14 19:48:57.632471 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 646/1277] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:57 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:57.685915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3fd4bfd5-8c78-4531-81f6-ab2224c37690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:57.686528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3fd4bfd5-8c78-4531-81f6-ab2224c37690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:57.692799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3fd4bfd5-8c78-4531-81f6-ab2224c37690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:57.693242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3fd4bfd5-8c78-4531-81f6-ab2224c37690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:57.694053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3fd4bfd5-8c78-4531-81f6-ab2224c37690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:57.694476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3fd4bfd5-8c78-4531-81f6-ab2224c37690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:57.810643 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3fd4bfd5-8c78-4531-81f6-ab2224c37690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:57.818442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3fd4bfd5-8c78-4531-81f6-ab2224c37690 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.136381 Sep 14 19:48:57.819004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 632/1278] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:57 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:57.869632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-99a46ba5-fe8d-4918-b423-0c5d1159fdcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:57.870541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-99a46ba5-fe8d-4918-b423-0c5d1159fdcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:57.877071 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-99a46ba5-fe8d-4918-b423-0c5d1159fdcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:57.877549 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-99a46ba5-fe8d-4918-b423-0c5d1159fdcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:57.878328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-99a46ba5-fe8d-4918-b423-0c5d1159fdcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:57.878763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-99a46ba5-fe8d-4918-b423-0c5d1159fdcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:57.908118 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-99a46ba5-fe8d-4918-b423-0c5d1159fdcc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042182 Sep 14 19:48:57.908678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 647/1279] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:57 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:58.383259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-34b40556-9663-43a8-9190-42c56a69d971 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:58.384160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-34b40556-9663-43a8-9190-42c56a69d971 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:58.389946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-34b40556-9663-43a8-9190-42c56a69d971 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:58.390405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-34b40556-9663-43a8-9190-42c56a69d971 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:58.391171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-34b40556-9663-43a8-9190-42c56a69d971 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:58.391597 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-34b40556-9663-43a8-9190-42c56a69d971 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:58.420017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-34b40556-9663-43a8-9190-42c56a69d971 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040634 Sep 14 19:48:58.420570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 633/1280] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:58 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:58.643192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5d487072-000e-4c99-a288-22913b372937 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:58.644094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5d487072-000e-4c99-a288-22913b372937 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:58.650063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d487072-000e-4c99-a288-22913b372937 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:58.650548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d487072-000e-4c99-a288-22913b372937 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:58.651321 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d487072-000e-4c99-a288-22913b372937 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:58.651756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d487072-000e-4c99-a288-22913b372937 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:58.681243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5d487072-000e-4c99-a288-22913b372937 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041829 Sep 14 19:48:58.681835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 648/1281] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:58 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:58.835034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-22d17422-aa49-4804-840f-20c4532f5da1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:58.835644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-22d17422-aa49-4804-840f-20c4532f5da1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:58.841847 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22d17422-aa49-4804-840f-20c4532f5da1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:58.842347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22d17422-aa49-4804-840f-20c4532f5da1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:58.843106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22d17422-aa49-4804-840f-20c4532f5da1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:58.843566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22d17422-aa49-4804-840f-20c4532f5da1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:58.919603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-47405d7e-d16f-4724-8dce-2fb6d9767f43 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:58.920408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-47405d7e-d16f-4724-8dce-2fb6d9767f43 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:58.926580 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47405d7e-d16f-4724-8dce-2fb6d9767f43 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:58.927030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47405d7e-d16f-4724-8dce-2fb6d9767f43 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:58.927806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47405d7e-d16f-4724-8dce-2fb6d9767f43 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:58.928246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47405d7e-d16f-4724-8dce-2fb6d9767f43 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:58.957981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-47405d7e-d16f-4724-8dce-2fb6d9767f43 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Sep 14 19:48:58.958583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 649/1282] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:58 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:48:58.961920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-22d17422-aa49-4804-840f-20c4532f5da1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:48:58.970148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-22d17422-aa49-4804-840f-20c4532f5da1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.137903 Sep 14 19:48:58.970489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 634/1283] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:58 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:48:59.432498 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6cd0dc49-67e7-4491-a63b-a304f85aff0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:59.433398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6cd0dc49-67e7-4491-a63b-a304f85aff0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:59.439808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd0dc49-67e7-4491-a63b-a304f85aff0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:59.440254 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd0dc49-67e7-4491-a63b-a304f85aff0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:59.441015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd0dc49-67e7-4491-a63b-a304f85aff0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:59.441446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd0dc49-67e7-4491-a63b-a304f85aff0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:59.469960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6cd0dc49-67e7-4491-a63b-a304f85aff0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041157 Sep 14 19:48:59.470463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 650/1284] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:48:59 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:48:59.692906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c5c5bc87-e213-4094-86d3-a388f815594c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:59.693768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c5c5bc87-e213-4094-86d3-a388f815594c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:59.699568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5c5bc87-e213-4094-86d3-a388f815594c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:59.700016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5c5bc87-e213-4094-86d3-a388f815594c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:59.700783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5c5bc87-e213-4094-86d3-a388f815594c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:59.701218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5c5bc87-e213-4094-86d3-a388f815594c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:59.730756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c5c5bc87-e213-4094-86d3-a388f815594c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041692 Sep 14 19:48:59.731321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 635/1285] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:59 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:59.970205 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-583900e9-37dd-496a-aeb4-0be144432509 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:59.971126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-583900e9-37dd-496a-aeb4-0be144432509 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:59.976910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-583900e9-37dd-496a-aeb4-0be144432509 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:59.977348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-583900e9-37dd-496a-aeb4-0be144432509 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:59.978147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-583900e9-37dd-496a-aeb4-0be144432509 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:59.978573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-583900e9-37dd-496a-aeb4-0be144432509 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:59.987454 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-992228f0-0844-4aba-ab7a-4e678b20942f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:59.988178 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-992228f0-0844-4aba-ab7a-4e678b20942f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:48:59.993956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-992228f0-0844-4aba-ab7a-4e678b20942f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:59.994400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-992228f0-0844-4aba-ab7a-4e678b20942f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:48:59.995177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-992228f0-0844-4aba-ab7a-4e678b20942f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:48:59.995636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-992228f0-0844-4aba-ab7a-4e678b20942f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:00.007959 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-583900e9-37dd-496a-aeb4-0be144432509 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042142 Sep 14 19:49:00.008531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 651/1286] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:48:59 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:00.119039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-992228f0-0844-4aba-ab7a-4e678b20942f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:00.126259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-992228f0-0844-4aba-ab7a-4e678b20942f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.143382 Sep 14 19:49:00.126816 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 636/1287] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:48:59 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:49:00.481723 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-07da5ea1-2819-498d-b0f7-bda2b3494b15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:00.482620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-07da5ea1-2819-498d-b0f7-bda2b3494b15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:00.488516 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-07da5ea1-2819-498d-b0f7-bda2b3494b15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:00.488953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-07da5ea1-2819-498d-b0f7-bda2b3494b15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:00.489743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-07da5ea1-2819-498d-b0f7-bda2b3494b15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:00.490175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-07da5ea1-2819-498d-b0f7-bda2b3494b15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:00.518349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-07da5ea1-2819-498d-b0f7-bda2b3494b15 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040555 Sep 14 19:49:00.520030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 652/1288] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:00 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:49:00.742479 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cec423db-1af8-447f-ba22-eec36139e372 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:00.743388 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cec423db-1af8-447f-ba22-eec36139e372 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:00.749207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cec423db-1af8-447f-ba22-eec36139e372 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:00.749693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cec423db-1af8-447f-ba22-eec36139e372 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:00.750966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cec423db-1af8-447f-ba22-eec36139e372 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:00.751402 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cec423db-1af8-447f-ba22-eec36139e372 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:00.780007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cec423db-1af8-447f-ba22-eec36139e372 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041454 Sep 14 19:49:00.780555 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 637/1289] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:00 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:01.019536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-54802f26-b267-41ac-896a-04cb1f176254 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:01.020360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-54802f26-b267-41ac-896a-04cb1f176254 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:01.026244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54802f26-b267-41ac-896a-04cb1f176254 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:01.026685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54802f26-b267-41ac-896a-04cb1f176254 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:01.027438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54802f26-b267-41ac-896a-04cb1f176254 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:01.027867 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54802f26-b267-41ac-896a-04cb1f176254 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:01.056957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-54802f26-b267-41ac-896a-04cb1f176254 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041708 Sep 14 19:49:01.057528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 653/1290] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:01 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:01.143598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7d56cdef-64fa-4793-81f2-1b031b3cf47a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:01.144247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7d56cdef-64fa-4793-81f2-1b031b3cf47a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:01.150147 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d56cdef-64fa-4793-81f2-1b031b3cf47a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:01.150707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d56cdef-64fa-4793-81f2-1b031b3cf47a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:01.151471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d56cdef-64fa-4793-81f2-1b031b3cf47a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:01.151907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d56cdef-64fa-4793-81f2-1b031b3cf47a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:01.271962 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7d56cdef-64fa-4793-81f2-1b031b3cf47a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:01.279275 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7d56cdef-64fa-4793-81f2-1b031b3cf47a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.139866 Sep 14 19:49:01.279848 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 638/1291] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:01 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:01.530019 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8daba6d8-fc47-4e06-bc60-c41bbf82b0f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:01.530876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8daba6d8-fc47-4e06-bc60-c41bbf82b0f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:01.536685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8daba6d8-fc47-4e06-bc60-c41bbf82b0f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:01.537134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8daba6d8-fc47-4e06-bc60-c41bbf82b0f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:01.537947 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8daba6d8-fc47-4e06-bc60-c41bbf82b0f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:01.538391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8daba6d8-fc47-4e06-bc60-c41bbf82b0f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:01.567093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8daba6d8-fc47-4e06-bc60-c41bbf82b0f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040929 Sep 14 19:49:01.567646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 654/1292] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:01 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:01.792445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6e86188c-7f15-4dde-85f2-87a01ea15c3d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:01.793950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6e86188c-7f15-4dde-85f2-87a01ea15c3d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:01.800623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6e86188c-7f15-4dde-85f2-87a01ea15c3d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:01.801093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6e86188c-7f15-4dde-85f2-87a01ea15c3d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:01.801886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6e86188c-7f15-4dde-85f2-87a01ea15c3d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:01.802314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6e86188c-7f15-4dde-85f2-87a01ea15c3d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:01.830793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6e86188c-7f15-4dde-85f2-87a01ea15c3d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Sep 14 19:49:01.831345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 639/1293] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:01 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:02.069061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7fa50ffa-0d77-4fa2-80e1-e7996a874a74 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:02.069918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7fa50ffa-0d77-4fa2-80e1-e7996a874a74 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:02.075746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7fa50ffa-0d77-4fa2-80e1-e7996a874a74 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:02.076192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7fa50ffa-0d77-4fa2-80e1-e7996a874a74 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:02.076965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7fa50ffa-0d77-4fa2-80e1-e7996a874a74 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:02.077394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7fa50ffa-0d77-4fa2-80e1-e7996a874a74 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:02.105526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7fa50ffa-0d77-4fa2-80e1-e7996a874a74 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040232 Sep 14 19:49:02.106077 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 655/1294] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:02 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:02.296654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-149d6cc1-aa99-4b2e-a488-a003d0084954 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:02.298186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-149d6cc1-aa99-4b2e-a488-a003d0084954 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:02.304068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-149d6cc1-aa99-4b2e-a488-a003d0084954 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:02.304517 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-149d6cc1-aa99-4b2e-a488-a003d0084954 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:02.305282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-149d6cc1-aa99-4b2e-a488-a003d0084954 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:02.305802 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-149d6cc1-aa99-4b2e-a488-a003d0084954 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:02.429798 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-149d6cc1-aa99-4b2e-a488-a003d0084954 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:02.436998 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-149d6cc1-aa99-4b2e-a488-a003d0084954 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.144013 Sep 14 19:49:02.437589 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 640/1295] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:02 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:02.579343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c92f9446-79d2-439a-ac1d-e5e0081b6119 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:02.580298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c92f9446-79d2-439a-ac1d-e5e0081b6119 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:02.586159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c92f9446-79d2-439a-ac1d-e5e0081b6119 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:02.586605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c92f9446-79d2-439a-ac1d-e5e0081b6119 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:02.587367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c92f9446-79d2-439a-ac1d-e5e0081b6119 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:02.587799 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c92f9446-79d2-439a-ac1d-e5e0081b6119 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:02.616839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c92f9446-79d2-439a-ac1d-e5e0081b6119 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041791 Sep 14 19:49:02.617386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 656/1296] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:02 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:02.841820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eaff40e1-4dc0-4cf6-9561-949692024977 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:02.842739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eaff40e1-4dc0-4cf6-9561-949692024977 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:02.849201 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eaff40e1-4dc0-4cf6-9561-949692024977 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:02.849732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eaff40e1-4dc0-4cf6-9561-949692024977 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:02.850501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eaff40e1-4dc0-4cf6-9561-949692024977 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:02.850937 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eaff40e1-4dc0-4cf6-9561-949692024977 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:02.879261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eaff40e1-4dc0-4cf6-9561-949692024977 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041129 Sep 14 19:49:02.879759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 641/1297] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:02 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:03.116723 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7dc20e47-c461-46a7-a885-153743d89b49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:03.117666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7dc20e47-c461-46a7-a885-153743d89b49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:03.123989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7dc20e47-c461-46a7-a885-153743d89b49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:03.124441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7dc20e47-c461-46a7-a885-153743d89b49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:03.125796 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7dc20e47-c461-46a7-a885-153743d89b49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:03.126223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7dc20e47-c461-46a7-a885-153743d89b49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:03.155680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7dc20e47-c461-46a7-a885-153743d89b49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042706 Sep 14 19:49:03.156151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 657/1298] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:03 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:03.454361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1c20d715-2688-4afe-9564-8ee6d3f717ae tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:03.454881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1c20d715-2688-4afe-9564-8ee6d3f717ae tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:03.460658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c20d715-2688-4afe-9564-8ee6d3f717ae tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:03.461096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c20d715-2688-4afe-9564-8ee6d3f717ae tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:03.461892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c20d715-2688-4afe-9564-8ee6d3f717ae tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:03.462306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c20d715-2688-4afe-9564-8ee6d3f717ae tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:03.590235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1c20d715-2688-4afe-9564-8ee6d3f717ae tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:03.598470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1c20d715-2688-4afe-9564-8ee6d3f717ae tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.148298 Sep 14 19:49:03.599094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 642/1299] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:03 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:03.628587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-95cf45df-ad99-4054-99eb-0929534e612f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:03.629517 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-95cf45df-ad99-4054-99eb-0929534e612f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:03.635282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-95cf45df-ad99-4054-99eb-0929534e612f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:03.635731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-95cf45df-ad99-4054-99eb-0929534e612f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:03.636501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-95cf45df-ad99-4054-99eb-0929534e612f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:03.636939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-95cf45df-ad99-4054-99eb-0929534e612f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:03.665491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-95cf45df-ad99-4054-99eb-0929534e612f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041182 Sep 14 19:49:03.666051 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 658/1300] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:03.890570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a5c372c5-ad7d-487b-9c6c-ae6e7bc6dc2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:03.892071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a5c372c5-ad7d-487b-9c6c-ae6e7bc6dc2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:03.897909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5c372c5-ad7d-487b-9c6c-ae6e7bc6dc2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:03.898360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5c372c5-ad7d-487b-9c6c-ae6e7bc6dc2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:03.899128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5c372c5-ad7d-487b-9c6c-ae6e7bc6dc2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:03.899561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5c372c5-ad7d-487b-9c6c-ae6e7bc6dc2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:03.927686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a5c372c5-ad7d-487b-9c6c-ae6e7bc6dc2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040941 Sep 14 19:49:03.928239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 643/1301] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:03 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:04.167157 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7e795ab1-5932-4499-a21b-cc486d93ac67 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:04.168099 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7e795ab1-5932-4499-a21b-cc486d93ac67 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:04.174793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e795ab1-5932-4499-a21b-cc486d93ac67 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:04.175327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e795ab1-5932-4499-a21b-cc486d93ac67 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:04.176098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e795ab1-5932-4499-a21b-cc486d93ac67 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:04.176537 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e795ab1-5932-4499-a21b-cc486d93ac67 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:04.205740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7e795ab1-5932-4499-a21b-cc486d93ac67 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042318 Sep 14 19:49:04.206288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 659/1302] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:04 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:04.616004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eb4b7a66-3b7a-4a2d-820f-0604a04a8082 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:04.616602 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eb4b7a66-3b7a-4a2d-820f-0604a04a8082 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:04.622389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb4b7a66-3b7a-4a2d-820f-0604a04a8082 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:04.622827 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb4b7a66-3b7a-4a2d-820f-0604a04a8082 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:04.623581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb4b7a66-3b7a-4a2d-820f-0604a04a8082 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:04.624002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb4b7a66-3b7a-4a2d-820f-0604a04a8082 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:04.677707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5989fc85-94c5-4175-9ee0-00d683cc1ea5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:04.678614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5989fc85-94c5-4175-9ee0-00d683cc1ea5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:04.684382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5989fc85-94c5-4175-9ee0-00d683cc1ea5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:04.684826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5989fc85-94c5-4175-9ee0-00d683cc1ea5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:04.685629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5989fc85-94c5-4175-9ee0-00d683cc1ea5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:04.686155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5989fc85-94c5-4175-9ee0-00d683cc1ea5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:04.714997 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5989fc85-94c5-4175-9ee0-00d683cc1ea5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041014 Sep 14 19:49:04.715560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 660/1303] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:04 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:49:04.743314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eb4b7a66-3b7a-4a2d-820f-0604a04a8082 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:04.750666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eb4b7a66-3b7a-4a2d-820f-0604a04a8082 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.138320 Sep 14 19:49:04.751227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 644/1304] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:04 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:04.939759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e80a185f-4441-4ceb-a2a5-314d82147f71 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:04.940597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e80a185f-4441-4ceb-a2a5-314d82147f71 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:04.946406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e80a185f-4441-4ceb-a2a5-314d82147f71 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:04.946842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e80a185f-4441-4ceb-a2a5-314d82147f71 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:04.947607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e80a185f-4441-4ceb-a2a5-314d82147f71 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:04.948043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e80a185f-4441-4ceb-a2a5-314d82147f71 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:04.976810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e80a185f-4441-4ceb-a2a5-314d82147f71 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 Sep 14 19:49:04.977355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 661/1305] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:04 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:05.217094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ad7191b9-c32a-4f8e-b730-ebcb333513b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:05.217965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ad7191b9-c32a-4f8e-b730-ebcb333513b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:05.223825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad7191b9-c32a-4f8e-b730-ebcb333513b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:05.224276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad7191b9-c32a-4f8e-b730-ebcb333513b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:05.225042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad7191b9-c32a-4f8e-b730-ebcb333513b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:05.225488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad7191b9-c32a-4f8e-b730-ebcb333513b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:05.254067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ad7191b9-c32a-4f8e-b730-ebcb333513b1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040819 Sep 14 19:49:05.254655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 645/1306] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:05 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:05.727041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f3927243-2256-4354-88dd-0d75da6c7552 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:05.727943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f3927243-2256-4354-88dd-0d75da6c7552 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:05.733769 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3927243-2256-4354-88dd-0d75da6c7552 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:05.734213 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3927243-2256-4354-88dd-0d75da6c7552 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:05.735483 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3927243-2256-4354-88dd-0d75da6c7552 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:05.735913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3927243-2256-4354-88dd-0d75da6c7552 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:05.764651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f3927243-2256-4354-88dd-0d75da6c7552 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041318 Sep 14 19:49:05.765192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 662/1307] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:05 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:05.767675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-36e5d7c1-a12e-4e4e-a0ec-651a7b3531ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:05.768376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-36e5d7c1-a12e-4e4e-a0ec-651a7b3531ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:05.774091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36e5d7c1-a12e-4e4e-a0ec-651a7b3531ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:05.774535 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36e5d7c1-a12e-4e4e-a0ec-651a7b3531ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:05.775301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36e5d7c1-a12e-4e4e-a0ec-651a7b3531ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:05.775730 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36e5d7c1-a12e-4e4e-a0ec-651a7b3531ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:05.897661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-36e5d7c1-a12e-4e4e-a0ec-651a7b3531ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:05.904889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-36e5d7c1-a12e-4e4e-a0ec-651a7b3531ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.141123 Sep 14 19:49:05.905454 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 646/1308] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:05 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:49:05.988923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-368c66ce-3112-4bb1-bcfa-6bf84ae18440 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:05.989859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-368c66ce-3112-4bb1-bcfa-6bf84ae18440 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:05.995747 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-368c66ce-3112-4bb1-bcfa-6bf84ae18440 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:05.996200 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-368c66ce-3112-4bb1-bcfa-6bf84ae18440 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:05.996993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-368c66ce-3112-4bb1-bcfa-6bf84ae18440 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:05.997436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-368c66ce-3112-4bb1-bcfa-6bf84ae18440 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:06.028437 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-368c66ce-3112-4bb1-bcfa-6bf84ae18440 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Sep 14 19:49:06.028988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 663/1309] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:05 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:06.267619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-99a1186b-5637-407e-a136-10a431423d6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:06.268486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-99a1186b-5637-407e-a136-10a431423d6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:06.274429 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99a1186b-5637-407e-a136-10a431423d6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:06.274880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99a1186b-5637-407e-a136-10a431423d6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:06.275643 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99a1186b-5637-407e-a136-10a431423d6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:06.276077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99a1186b-5637-407e-a136-10a431423d6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:06.305661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-99a1186b-5637-407e-a136-10a431423d6a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042419 Sep 14 19:49:06.306224 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 647/1310] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:06 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:06.776098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e5b72235-b6ea-4ab0-8209-3c403e2c1667 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:06.776998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e5b72235-b6ea-4ab0-8209-3c403e2c1667 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:06.783505 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e5b72235-b6ea-4ab0-8209-3c403e2c1667 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:06.783951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e5b72235-b6ea-4ab0-8209-3c403e2c1667 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:06.784712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e5b72235-b6ea-4ab0-8209-3c403e2c1667 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:06.785145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e5b72235-b6ea-4ab0-8209-3c403e2c1667 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:06.815249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e5b72235-b6ea-4ab0-8209-3c403e2c1667 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042946 Sep 14 19:49:06.815818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 664/1311] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:06 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:06.922477 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-19a722f5-53df-4c70-88d1-f7b485ae64ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:06.923953 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-19a722f5-53df-4c70-88d1-f7b485ae64ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:06.929835 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19a722f5-53df-4c70-88d1-f7b485ae64ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:06.930269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19a722f5-53df-4c70-88d1-f7b485ae64ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:06.931030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19a722f5-53df-4c70-88d1-f7b485ae64ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:06.931452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19a722f5-53df-4c70-88d1-f7b485ae64ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:07.046513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c3254cd8-445c-4aa2-b13b-9f213960bb32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:07.048406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c3254cd8-445c-4aa2-b13b-9f213960bb32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:07.058817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c3254cd8-445c-4aa2-b13b-9f213960bb32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:07.059620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c3254cd8-445c-4aa2-b13b-9f213960bb32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:07.061005 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c3254cd8-445c-4aa2-b13b-9f213960bb32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:07.061798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c3254cd8-445c-4aa2-b13b-9f213960bb32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:07.064195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-19a722f5-53df-4c70-88d1-f7b485ae64ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:07.071621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-19a722f5-53df-4c70-88d1-f7b485ae64ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.152845 Sep 14 19:49:07.072205 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 648/1312] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:06 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:07.091148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c3254cd8-445c-4aa2-b13b-9f213960bb32 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053055 Sep 14 19:49:07.091708 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 665/1313] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:07 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:07.317314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7ccffa73-3e01-4e4a-8ff5-42482cad1d22 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:07.318160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7ccffa73-3e01-4e4a-8ff5-42482cad1d22 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:07.323970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ccffa73-3e01-4e4a-8ff5-42482cad1d22 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:07.324417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ccffa73-3e01-4e4a-8ff5-42482cad1d22 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:07.325178 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ccffa73-3e01-4e4a-8ff5-42482cad1d22 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:07.325642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ccffa73-3e01-4e4a-8ff5-42482cad1d22 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:07.355720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7ccffa73-3e01-4e4a-8ff5-42482cad1d22 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042271 Sep 14 19:49:07.356280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 649/1314] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:07 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:07.827629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-757eccb4-188a-4a82-9824-804058666fb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:07.828567 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-757eccb4-188a-4a82-9824-804058666fb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:07.834594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-757eccb4-188a-4a82-9824-804058666fb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:07.835040 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-757eccb4-188a-4a82-9824-804058666fb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:07.835818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-757eccb4-188a-4a82-9824-804058666fb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:07.836249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-757eccb4-188a-4a82-9824-804058666fb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:07.866369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-757eccb4-188a-4a82-9824-804058666fb4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042477 Sep 14 19:49:07.866923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 666/1315] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:07 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:08.088645 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dbe9cd83-dd6c-4f2b-933a-022cb51fe9e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:08.089163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dbe9cd83-dd6c-4f2b-933a-022cb51fe9e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:08.094808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbe9cd83-dd6c-4f2b-933a-022cb51fe9e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:08.095776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbe9cd83-dd6c-4f2b-933a-022cb51fe9e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:08.096531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbe9cd83-dd6c-4f2b-933a-022cb51fe9e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:08.096958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dbe9cd83-dd6c-4f2b-933a-022cb51fe9e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:08.102438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ee8c1bd9-8c8c-4f0c-8653-b7265f9abada tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:08.103374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ee8c1bd9-8c8c-4f0c-8653-b7265f9abada tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:08.109038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8c1bd9-8c8c-4f0c-8653-b7265f9abada tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:08.109489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8c1bd9-8c8c-4f0c-8653-b7265f9abada tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:08.110326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8c1bd9-8c8c-4f0c-8653-b7265f9abada tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:08.110766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8c1bd9-8c8c-4f0c-8653-b7265f9abada tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:08.140663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ee8c1bd9-8c8c-4f0c-8653-b7265f9abada tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041954 Sep 14 19:49:08.141259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 667/1316] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:08 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:08.219624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dbe9cd83-dd6c-4f2b-933a-022cb51fe9e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:08.227401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dbe9cd83-dd6c-4f2b-933a-022cb51fe9e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.142477 Sep 14 19:49:08.231475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 650/1317] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:08 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:08.366894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-90b19ecf-8710-483b-bf62-75bd44d38815 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:08.367804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-90b19ecf-8710-483b-bf62-75bd44d38815 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:08.373772 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-90b19ecf-8710-483b-bf62-75bd44d38815 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:08.374255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-90b19ecf-8710-483b-bf62-75bd44d38815 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:08.375023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-90b19ecf-8710-483b-bf62-75bd44d38815 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:08.375459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-90b19ecf-8710-483b-bf62-75bd44d38815 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:08.403522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-90b19ecf-8710-483b-bf62-75bd44d38815 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040371 Sep 14 19:49:08.404077 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 668/1318] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:08 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:08.878504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-94845c5c-29e2-4776-a989-8f7068697014 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:08.879557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-94845c5c-29e2-4776-a989-8f7068697014 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:08.885354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-94845c5c-29e2-4776-a989-8f7068697014 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:08.885807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-94845c5c-29e2-4776-a989-8f7068697014 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:08.886603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-94845c5c-29e2-4776-a989-8f7068697014 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:08.887031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-94845c5c-29e2-4776-a989-8f7068697014 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:08.915203 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-94845c5c-29e2-4776-a989-8f7068697014 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041054 Sep 14 19:49:08.915749 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 651/1319] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:08 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:09.152351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0e06d9bf-6462-4251-b41a-09056a7e6439 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:09.153276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0e06d9bf-6462-4251-b41a-09056a7e6439 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:09.159133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e06d9bf-6462-4251-b41a-09056a7e6439 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:09.159584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e06d9bf-6462-4251-b41a-09056a7e6439 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:09.160348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e06d9bf-6462-4251-b41a-09056a7e6439 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:09.160783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e06d9bf-6462-4251-b41a-09056a7e6439 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:09.190471 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0e06d9bf-6462-4251-b41a-09056a7e6439 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Sep 14 19:49:09.191022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 669/1320] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:09 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:09.244734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9cd56a01-2e91-4c2b-b0fe-8e655e7f8506 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:09.245396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9cd56a01-2e91-4c2b-b0fe-8e655e7f8506 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:09.251275 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cd56a01-2e91-4c2b-b0fe-8e655e7f8506 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:09.252347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cd56a01-2e91-4c2b-b0fe-8e655e7f8506 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:09.253141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cd56a01-2e91-4c2b-b0fe-8e655e7f8506 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:09.253603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cd56a01-2e91-4c2b-b0fe-8e655e7f8506 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:09.373824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9cd56a01-2e91-4c2b-b0fe-8e655e7f8506 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:09.381807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9cd56a01-2e91-4c2b-b0fe-8e655e7f8506 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.140723 Sep 14 19:49:09.382379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 652/1321] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:09 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:09.414843 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5065d272-6481-403e-9ddf-716c9b7e284b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:09.415683 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5065d272-6481-403e-9ddf-716c9b7e284b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:09.421341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5065d272-6481-403e-9ddf-716c9b7e284b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:09.421839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5065d272-6481-403e-9ddf-716c9b7e284b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:09.422596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5065d272-6481-403e-9ddf-716c9b7e284b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:09.423789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5065d272-6481-403e-9ddf-716c9b7e284b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:09.451967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5065d272-6481-403e-9ddf-716c9b7e284b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Sep 14 19:49:09.452514 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 670/1322] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:09 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:09.928071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f9e84fe8-c8ab-4fe7-84fb-d1f695c4f480 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:09.928968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f9e84fe8-c8ab-4fe7-84fb-d1f695c4f480 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:09.934808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f9e84fe8-c8ab-4fe7-84fb-d1f695c4f480 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:09.935255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f9e84fe8-c8ab-4fe7-84fb-d1f695c4f480 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:09.936016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f9e84fe8-c8ab-4fe7-84fb-d1f695c4f480 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:09.936450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f9e84fe8-c8ab-4fe7-84fb-d1f695c4f480 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:09.964839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f9e84fe8-c8ab-4fe7-84fb-d1f695c4f480 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042265 Sep 14 19:49:09.965398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 653/1323] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:10.201922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0bf7dd6e-0a6a-4937-b569-da6bc2134314 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:10.202826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0bf7dd6e-0a6a-4937-b569-da6bc2134314 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:10.209084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bf7dd6e-0a6a-4937-b569-da6bc2134314 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:10.209565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bf7dd6e-0a6a-4937-b569-da6bc2134314 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:10.210382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bf7dd6e-0a6a-4937-b569-da6bc2134314 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:10.210816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0bf7dd6e-0a6a-4937-b569-da6bc2134314 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:10.241693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0bf7dd6e-0a6a-4937-b569-da6bc2134314 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Sep 14 19:49:10.242256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 671/1324] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:10 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:10.398792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-edc8edd2-7fad-48b5-af63-d93ac38c7f9f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:10.399430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-edc8edd2-7fad-48b5-af63-d93ac38c7f9f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:10.405525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-edc8edd2-7fad-48b5-af63-d93ac38c7f9f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:10.406001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-edc8edd2-7fad-48b5-af63-d93ac38c7f9f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:10.406758 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-edc8edd2-7fad-48b5-af63-d93ac38c7f9f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:10.407185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-edc8edd2-7fad-48b5-af63-d93ac38c7f9f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:10.463308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6694b7de-a591-4ae0-a0cf-1272d431b975 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:10.464256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6694b7de-a591-4ae0-a0cf-1272d431b975 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:10.470229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6694b7de-a591-4ae0-a0cf-1272d431b975 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:10.477189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6694b7de-a591-4ae0-a0cf-1272d431b975 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:10.477189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6694b7de-a591-4ae0-a0cf-1272d431b975 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:10.477189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6694b7de-a591-4ae0-a0cf-1272d431b975 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:10.501223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6694b7de-a591-4ae0-a0cf-1272d431b975 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Sep 14 19:49:10.502371 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 672/1325] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:10 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:10.528903 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-edc8edd2-7fad-48b5-af63-d93ac38c7f9f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:10.536431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-edc8edd2-7fad-48b5-af63-d93ac38c7f9f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.141302 Sep 14 19:49:10.537011 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 654/1326] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:10 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:10.977011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fb642c76-432e-4775-a1f0-ff9baddd9e6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:10.978010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fb642c76-432e-4775-a1f0-ff9baddd9e6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:10.983939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb642c76-432e-4775-a1f0-ff9baddd9e6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:10.984389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb642c76-432e-4775-a1f0-ff9baddd9e6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:10.985159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb642c76-432e-4775-a1f0-ff9baddd9e6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:10.985624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb642c76-432e-4775-a1f0-ff9baddd9e6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:11.014982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fb642c76-432e-4775-a1f0-ff9baddd9e6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041754 Sep 14 19:49:11.015533 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 673/1327] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:49:11.252149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-49715d63-0afb-414e-81b2-5957dd804028 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:11.253063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-49715d63-0afb-414e-81b2-5957dd804028 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:11.259026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49715d63-0afb-414e-81b2-5957dd804028 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:11.259481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49715d63-0afb-414e-81b2-5957dd804028 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:11.260268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49715d63-0afb-414e-81b2-5957dd804028 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:11.260711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49715d63-0afb-414e-81b2-5957dd804028 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:11.291113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-49715d63-0afb-414e-81b2-5957dd804028 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Sep 14 19:49:11.291694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 655/1328] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:11.513348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2261e243-8e71-4e73-bf6d-907702d8b1ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:11.514337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2261e243-8e71-4e73-bf6d-907702d8b1ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:11.520808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2261e243-8e71-4e73-bf6d-907702d8b1ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:11.521262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2261e243-8e71-4e73-bf6d-907702d8b1ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:11.522069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2261e243-8e71-4e73-bf6d-907702d8b1ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:11.522561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2261e243-8e71-4e73-bf6d-907702d8b1ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:11.553106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2261e243-8e71-4e73-bf6d-907702d8b1ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043557 Sep 14 19:49:11.553734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 674/1329] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:11 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:11.558853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-48a86f78-be96-4568-a18d-37712d62a3d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:11.559459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-48a86f78-be96-4568-a18d-37712d62a3d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:11.565327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48a86f78-be96-4568-a18d-37712d62a3d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:11.565807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48a86f78-be96-4568-a18d-37712d62a3d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:11.566561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48a86f78-be96-4568-a18d-37712d62a3d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:11.566990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48a86f78-be96-4568-a18d-37712d62a3d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:11.685532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-48a86f78-be96-4568-a18d-37712d62a3d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:11.692866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-48a86f78-be96-4568-a18d-37712d62a3d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142699 Sep 14 19:49:11.693435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 656/1330] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:11 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:49:12.026053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6879b5ef-3b60-4299-85a6-98c064d8d314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:12.026896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6879b5ef-3b60-4299-85a6-98c064d8d314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:12.032868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6879b5ef-3b60-4299-85a6-98c064d8d314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:12.033317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6879b5ef-3b60-4299-85a6-98c064d8d314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:12.034112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6879b5ef-3b60-4299-85a6-98c064d8d314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:12.034553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6879b5ef-3b60-4299-85a6-98c064d8d314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:12.063112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6879b5ef-3b60-4299-85a6-98c064d8d314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040852 Sep 14 19:49:12.063661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 675/1331] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:12 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:12.308309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5572811f-8520-4ae0-8a6f-e1f313d17e24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:12.309127 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5572811f-8520-4ae0-8a6f-e1f313d17e24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:12.315928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5572811f-8520-4ae0-8a6f-e1f313d17e24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:12.316370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5572811f-8520-4ae0-8a6f-e1f313d17e24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:12.317131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5572811f-8520-4ae0-8a6f-e1f313d17e24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:12.317587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5572811f-8520-4ae0-8a6f-e1f313d17e24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:12.345665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5572811f-8520-4ae0-8a6f-e1f313d17e24 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041206 Sep 14 19:49:12.346455 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 657/1332] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:12 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:12.564697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8ad02870-2081-4452-ba7d-17fa53476923 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:12.565549 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8ad02870-2081-4452-ba7d-17fa53476923 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:12.571410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ad02870-2081-4452-ba7d-17fa53476923 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:12.571850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ad02870-2081-4452-ba7d-17fa53476923 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:12.572608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ad02870-2081-4452-ba7d-17fa53476923 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:12.573035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ad02870-2081-4452-ba7d-17fa53476923 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:12.600974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8ad02870-2081-4452-ba7d-17fa53476923 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040791 Sep 14 19:49:12.601522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 676/1333] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:12 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:12.709642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4d9700a8-3fb1-4e85-b661-e5ebc9450994 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:12.710307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4d9700a8-3fb1-4e85-b661-e5ebc9450994 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:12.716130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4d9700a8-3fb1-4e85-b661-e5ebc9450994 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:12.716575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4d9700a8-3fb1-4e85-b661-e5ebc9450994 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:12.717340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4d9700a8-3fb1-4e85-b661-e5ebc9450994 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:12.717801 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4d9700a8-3fb1-4e85-b661-e5ebc9450994 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:12.834751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4d9700a8-3fb1-4e85-b661-e5ebc9450994 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:12.842328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4d9700a8-3fb1-4e85-b661-e5ebc9450994 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.136286 Sep 14 19:49:12.843242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 658/1334] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:12 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:13.075095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-45226642-cd37-46cd-8f86-e5f9a6af1ae5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:13.076013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-45226642-cd37-46cd-8f86-e5f9a6af1ae5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:13.082317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45226642-cd37-46cd-8f86-e5f9a6af1ae5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:13.082704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45226642-cd37-46cd-8f86-e5f9a6af1ae5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:13.083469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45226642-cd37-46cd-8f86-e5f9a6af1ae5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:13.083904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45226642-cd37-46cd-8f86-e5f9a6af1ae5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:13.112224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-45226642-cd37-46cd-8f86-e5f9a6af1ae5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040944 Sep 14 19:49:13.112770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 677/1335] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:13.356890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a34b1e2e-c481-4012-9526-8fcf6e00c361 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:13.357765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a34b1e2e-c481-4012-9526-8fcf6e00c361 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:13.363639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a34b1e2e-c481-4012-9526-8fcf6e00c361 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:13.364084 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a34b1e2e-c481-4012-9526-8fcf6e00c361 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:13.364897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a34b1e2e-c481-4012-9526-8fcf6e00c361 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:13.365322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a34b1e2e-c481-4012-9526-8fcf6e00c361 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:13.394423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a34b1e2e-c481-4012-9526-8fcf6e00c361 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041408 Sep 14 19:49:13.394974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 659/1336] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:13 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:13.611992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f6bbe928-e11c-4784-ac91-93e86f1cce6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:13.612903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f6bbe928-e11c-4784-ac91-93e86f1cce6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:13.618850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6bbe928-e11c-4784-ac91-93e86f1cce6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:13.619301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6bbe928-e11c-4784-ac91-93e86f1cce6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:13.620072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6bbe928-e11c-4784-ac91-93e86f1cce6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:13.620512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6bbe928-e11c-4784-ac91-93e86f1cce6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:13.649857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f6bbe928-e11c-4784-ac91-93e86f1cce6d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041615 Sep 14 19:49:13.650406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 678/1337] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:13 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:13.859918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-58c9848c-35da-4d43-895f-977ecb3691f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:13.860540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-58c9848c-35da-4d43-895f-977ecb3691f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:13.867117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58c9848c-35da-4d43-895f-977ecb3691f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:13.867482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58c9848c-35da-4d43-895f-977ecb3691f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:13.868248 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58c9848c-35da-4d43-895f-977ecb3691f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:13.868675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58c9848c-35da-4d43-895f-977ecb3691f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:13.990153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-58c9848c-35da-4d43-895f-977ecb3691f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:13.997340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-58c9848c-35da-4d43-895f-977ecb3691f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141123 Sep 14 19:49:13.997947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 660/1338] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:13 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:14.123744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9a74f6ad-1360-4358-b2aa-01319fe640c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:14.124578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9a74f6ad-1360-4358-b2aa-01319fe640c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:14.130472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a74f6ad-1360-4358-b2aa-01319fe640c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:14.130921 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a74f6ad-1360-4358-b2aa-01319fe640c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:14.131688 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a74f6ad-1360-4358-b2aa-01319fe640c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:14.132127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a74f6ad-1360-4358-b2aa-01319fe640c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:14.160568 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9a74f6ad-1360-4358-b2aa-01319fe640c0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040735 Sep 14 19:49:14.161113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 679/1339] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:14 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:14.405202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fc2edf7b-089d-49cb-a146-b5ecd0f0685f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:14.406086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fc2edf7b-089d-49cb-a146-b5ecd0f0685f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:14.412419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc2edf7b-089d-49cb-a146-b5ecd0f0685f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:14.412867 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc2edf7b-089d-49cb-a146-b5ecd0f0685f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:14.413666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc2edf7b-089d-49cb-a146-b5ecd0f0685f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:14.414103 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc2edf7b-089d-49cb-a146-b5ecd0f0685f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:14.442737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fc2edf7b-089d-49cb-a146-b5ecd0f0685f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041317 Sep 14 19:49:14.443298 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 661/1340] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:14 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:14.660602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-23dede11-5c62-431f-b114-1ad31ff3af4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:14.661473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-23dede11-5c62-431f-b114-1ad31ff3af4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:14.667311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-23dede11-5c62-431f-b114-1ad31ff3af4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:14.667761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-23dede11-5c62-431f-b114-1ad31ff3af4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:14.668534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-23dede11-5c62-431f-b114-1ad31ff3af4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:14.668970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-23dede11-5c62-431f-b114-1ad31ff3af4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:14.698144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-23dede11-5c62-431f-b114-1ad31ff3af4b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041741 Sep 14 19:49:14.698695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 680/1341] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:14 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:15.014874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-73a74598-fd79-4e2b-ad97-72a666a83d0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:15.015401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-73a74598-fd79-4e2b-ad97-72a666a83d0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:15.022036 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-73a74598-fd79-4e2b-ad97-72a666a83d0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:15.022489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-73a74598-fd79-4e2b-ad97-72a666a83d0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:15.023255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-73a74598-fd79-4e2b-ad97-72a666a83d0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:15.023690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-73a74598-fd79-4e2b-ad97-72a666a83d0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:15.142519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-73a74598-fd79-4e2b-ad97-72a666a83d0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:15.150342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-73a74598-fd79-4e2b-ad97-72a666a83d0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139183 Sep 14 19:49:15.150943 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 662/1342] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:15 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:15.171865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0ee2af9c-7612-4309-b825-88a852f39c41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:15.172762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0ee2af9c-7612-4309-b825-88a852f39c41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:15.178720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ee2af9c-7612-4309-b825-88a852f39c41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:15.179167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ee2af9c-7612-4309-b825-88a852f39c41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:15.179935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ee2af9c-7612-4309-b825-88a852f39c41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:15.180366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0ee2af9c-7612-4309-b825-88a852f39c41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:15.209270 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0ee2af9c-7612-4309-b825-88a852f39c41 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041157 Sep 14 19:49:15.209846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 681/1343] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:15 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:15.454069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3cd4e119-bf6d-4a94-a8a4-a2ce149bc668 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:15.454983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3cd4e119-bf6d-4a94-a8a4-a2ce149bc668 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:15.460748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cd4e119-bf6d-4a94-a8a4-a2ce149bc668 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:15.461219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cd4e119-bf6d-4a94-a8a4-a2ce149bc668 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:15.462022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cd4e119-bf6d-4a94-a8a4-a2ce149bc668 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:15.462462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cd4e119-bf6d-4a94-a8a4-a2ce149bc668 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:15.491354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3cd4e119-bf6d-4a94-a8a4-a2ce149bc668 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041019 Sep 14 19:49:15.491909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 663/1344] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:15 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:15.709174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9b1dbc74-caad-40ee-92bd-cce55f43c5d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:15.710034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9b1dbc74-caad-40ee-92bd-cce55f43c5d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:15.715866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b1dbc74-caad-40ee-92bd-cce55f43c5d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:15.716307 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b1dbc74-caad-40ee-92bd-cce55f43c5d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:15.717063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b1dbc74-caad-40ee-92bd-cce55f43c5d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:15.717489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b1dbc74-caad-40ee-92bd-cce55f43c5d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:15.746206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9b1dbc74-caad-40ee-92bd-cce55f43c5d8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040719 Sep 14 19:49:15.746746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 682/1345] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:15 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:16.167017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a9ae6a64-77cc-4cbe-a13e-130af66716f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:16.167627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a9ae6a64-77cc-4cbe-a13e-130af66716f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:16.173796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a9ae6a64-77cc-4cbe-a13e-130af66716f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:16.174246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a9ae6a64-77cc-4cbe-a13e-130af66716f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:16.175008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a9ae6a64-77cc-4cbe-a13e-130af66716f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:16.175441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a9ae6a64-77cc-4cbe-a13e-130af66716f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:16.220937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-af8f2d98-6322-44ec-8e0b-1ded74077ef6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:16.221902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-af8f2d98-6322-44ec-8e0b-1ded74077ef6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:16.227827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-af8f2d98-6322-44ec-8e0b-1ded74077ef6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:16.228274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-af8f2d98-6322-44ec-8e0b-1ded74077ef6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:16.229058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-af8f2d98-6322-44ec-8e0b-1ded74077ef6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:16.229488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-af8f2d98-6322-44ec-8e0b-1ded74077ef6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:16.270355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-af8f2d98-6322-44ec-8e0b-1ded74077ef6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053327 Sep 14 19:49:16.271583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 683/1346] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:16 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:49:16.295426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a9ae6a64-77cc-4cbe-a13e-130af66716f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:16.303089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a9ae6a64-77cc-4cbe-a13e-130af66716f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139693 Sep 14 19:49:16.303648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 664/1347] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:16 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:16.503391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-eb59b54b-3eea-44e4-acd5-0586de78ab4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:16.504241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-eb59b54b-3eea-44e4-acd5-0586de78ab4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:16.510074 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb59b54b-3eea-44e4-acd5-0586de78ab4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:16.515492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb59b54b-3eea-44e4-acd5-0586de78ab4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:16.515492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb59b54b-3eea-44e4-acd5-0586de78ab4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:16.515492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb59b54b-3eea-44e4-acd5-0586de78ab4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:16.540736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-eb59b54b-3eea-44e4-acd5-0586de78ab4c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Sep 14 19:49:16.541287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 684/1348] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:16 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:16.757278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bfa683ba-969c-428e-8624-996c7b20bc04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:16.758161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bfa683ba-969c-428e-8624-996c7b20bc04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:16.763938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bfa683ba-969c-428e-8624-996c7b20bc04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:16.764385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bfa683ba-969c-428e-8624-996c7b20bc04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:16.765151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bfa683ba-969c-428e-8624-996c7b20bc04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:16.765631 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bfa683ba-969c-428e-8624-996c7b20bc04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:16.793616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bfa683ba-969c-428e-8624-996c7b20bc04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040026 Sep 14 19:49:16.794181 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 665/1349] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:16 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:17.283226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f37e17b5-eee6-4f1b-b43d-1d5f0dd18611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:17.284149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f37e17b5-eee6-4f1b-b43d-1d5f0dd18611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:17.290118 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f37e17b5-eee6-4f1b-b43d-1d5f0dd18611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:17.290574 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f37e17b5-eee6-4f1b-b43d-1d5f0dd18611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:17.291379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f37e17b5-eee6-4f1b-b43d-1d5f0dd18611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:17.291788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f37e17b5-eee6-4f1b-b43d-1d5f0dd18611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:17.318882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c9f1f155-4f82-4fb1-a605-d0fd9dd2bff6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:17.319498 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c9f1f155-4f82-4fb1-a605-d0fd9dd2bff6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:17.325194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f37e17b5-eee6-4f1b-b43d-1d5f0dd18611 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045956 Sep 14 19:49:17.325525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9f1f155-4f82-4fb1-a605-d0fd9dd2bff6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:17.325833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 685/1350] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:17 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:17.325981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9f1f155-4f82-4fb1-a605-d0fd9dd2bff6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:17.326905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9f1f155-4f82-4fb1-a605-d0fd9dd2bff6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:17.327353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9f1f155-4f82-4fb1-a605-d0fd9dd2bff6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:17.449259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c9f1f155-4f82-4fb1-a605-d0fd9dd2bff6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:17.457101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c9f1f155-4f82-4fb1-a605-d0fd9dd2bff6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141874 Sep 14 19:49:17.457701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 666/1351] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:17 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:49:17.552430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-aa8ca455-338a-46e5-87f7-cc4b8868fb99 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:17.553258 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-aa8ca455-338a-46e5-87f7-cc4b8868fb99 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:17.559371 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa8ca455-338a-46e5-87f7-cc4b8868fb99 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:17.559821 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa8ca455-338a-46e5-87f7-cc4b8868fb99 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:17.560597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa8ca455-338a-46e5-87f7-cc4b8868fb99 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:17.561032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa8ca455-338a-46e5-87f7-cc4b8868fb99 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:17.590495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-aa8ca455-338a-46e5-87f7-cc4b8868fb99 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042159 Sep 14 19:49:17.591050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 686/1352] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:17 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:17.804627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f8dd39b5-935d-4481-a96d-531e621de69d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:17.805456 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f8dd39b5-935d-4481-a96d-531e621de69d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:17.811189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8dd39b5-935d-4481-a96d-531e621de69d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:17.811632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8dd39b5-935d-4481-a96d-531e621de69d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:17.812393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8dd39b5-935d-4481-a96d-531e621de69d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:17.812825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8dd39b5-935d-4481-a96d-531e621de69d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:17.842355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f8dd39b5-935d-4481-a96d-531e621de69d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041569 Sep 14 19:49:17.842929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 667/1353] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:17 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:18.336270 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bc8ba912-1a22-4399-9c9b-441d4175cb1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:18.337168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bc8ba912-1a22-4399-9c9b-441d4175cb1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:18.343988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc8ba912-1a22-4399-9c9b-441d4175cb1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:18.344486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc8ba912-1a22-4399-9c9b-441d4175cb1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:18.345261 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc8ba912-1a22-4399-9c9b-441d4175cb1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:18.345736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc8ba912-1a22-4399-9c9b-441d4175cb1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:18.374554 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bc8ba912-1a22-4399-9c9b-441d4175cb1d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042117 Sep 14 19:49:18.375104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 687/1354] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:18 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:18.473308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b7cf1ded-c024-42e5-b3cd-abd21f0a4cd2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:18.473940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b7cf1ded-c024-42e5-b3cd-abd21f0a4cd2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:18.479841 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7cf1ded-c024-42e5-b3cd-abd21f0a4cd2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:18.480283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7cf1ded-c024-42e5-b3cd-abd21f0a4cd2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:18.488495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7cf1ded-c024-42e5-b3cd-abd21f0a4cd2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:18.488495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7cf1ded-c024-42e5-b3cd-abd21f0a4cd2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:18.600623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b7cf1ded-c024-42e5-b3cd-abd21f0a4cd2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:18.602084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bc2e6361-d0a8-4f27-a0c4-9a4989889e50 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:18.603072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bc2e6361-d0a8-4f27-a0c4-9a4989889e50 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:18.608507 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b7cf1ded-c024-42e5-b3cd-abd21f0a4cd2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.138865 Sep 14 19:49:18.608801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc2e6361-d0a8-4f27-a0c4-9a4989889e50 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:18.609237 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 668/1355] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:18 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:18.609612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc2e6361-d0a8-4f27-a0c4-9a4989889e50 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:18.611430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc2e6361-d0a8-4f27-a0c4-9a4989889e50 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:18.612118 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bc2e6361-d0a8-4f27-a0c4-9a4989889e50 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:18.643441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bc2e6361-d0a8-4f27-a0c4-9a4989889e50 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Sep 14 19:49:18.644014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 688/1356] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:18 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:18.854342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5fdfa1e6-96f3-41e0-8b2b-e56ec9525db9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:18.855176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5fdfa1e6-96f3-41e0-8b2b-e56ec9525db9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:18.861710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5fdfa1e6-96f3-41e0-8b2b-e56ec9525db9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:18.862154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5fdfa1e6-96f3-41e0-8b2b-e56ec9525db9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:18.862913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5fdfa1e6-96f3-41e0-8b2b-e56ec9525db9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:18.863345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5fdfa1e6-96f3-41e0-8b2b-e56ec9525db9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:18.891657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5fdfa1e6-96f3-41e0-8b2b-e56ec9525db9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041105 Sep 14 19:49:18.892221 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 669/1357] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:18 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:19.386306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8f9cb6e6-ecd1-4021-8c66-259a2f873fdb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:19.387232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8f9cb6e6-ecd1-4021-8c66-259a2f873fdb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:19.393091 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f9cb6e6-ecd1-4021-8c66-259a2f873fdb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:19.393566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f9cb6e6-ecd1-4021-8c66-259a2f873fdb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:19.394340 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f9cb6e6-ecd1-4021-8c66-259a2f873fdb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:19.394794 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f9cb6e6-ecd1-4021-8c66-259a2f873fdb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:19.424208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8f9cb6e6-ecd1-4021-8c66-259a2f873fdb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041106 Sep 14 19:49:19.424756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 689/1358] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:19.626194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7e3fe14e-7669-495b-9519-87882e4e19e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:19.626829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7e3fe14e-7669-495b-9519-87882e4e19e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:19.632591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e3fe14e-7669-495b-9519-87882e4e19e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:19.633035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e3fe14e-7669-495b-9519-87882e4e19e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:19.633816 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e3fe14e-7669-495b-9519-87882e4e19e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:19.634249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e3fe14e-7669-495b-9519-87882e4e19e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:19.655248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-68a6a811-c5ff-4c0c-ade7-a2c77486c2d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:19.656158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-68a6a811-c5ff-4c0c-ade7-a2c77486c2d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:19.662441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68a6a811-c5ff-4c0c-ade7-a2c77486c2d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:19.662893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68a6a811-c5ff-4c0c-ade7-a2c77486c2d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:19.663665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68a6a811-c5ff-4c0c-ade7-a2c77486c2d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:19.664101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68a6a811-c5ff-4c0c-ade7-a2c77486c2d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:19.693807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-68a6a811-c5ff-4c0c-ade7-a2c77486c2d9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042351 Sep 14 19:49:19.694665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 690/1359] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:19.752415 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7e3fe14e-7669-495b-9519-87882e4e19e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:19.759807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7e3fe14e-7669-495b-9519-87882e4e19e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137305 Sep 14 19:49:19.760371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 670/1360] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:19 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:19.902955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b89ec45b-b35c-4d6b-9fc0-d8e35c4ae7e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:19.903860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b89ec45b-b35c-4d6b-9fc0-d8e35c4ae7e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:19.910434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b89ec45b-b35c-4d6b-9fc0-d8e35c4ae7e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:19.910834 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b89ec45b-b35c-4d6b-9fc0-d8e35c4ae7e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:19.911610 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b89ec45b-b35c-4d6b-9fc0-d8e35c4ae7e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:19.912046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b89ec45b-b35c-4d6b-9fc0-d8e35c4ae7e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:19.940458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b89ec45b-b35c-4d6b-9fc0-d8e35c4ae7e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041398 Sep 14 19:49:19.941000 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 691/1361] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:19 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:20.435604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cce0f053-59ca-42e8-8384-bccc3d8b4784 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:20.436490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cce0f053-59ca-42e8-8384-bccc3d8b4784 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:20.443032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cce0f053-59ca-42e8-8384-bccc3d8b4784 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:20.443482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cce0f053-59ca-42e8-8384-bccc3d8b4784 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:20.444275 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cce0f053-59ca-42e8-8384-bccc3d8b4784 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:20.444729 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cce0f053-59ca-42e8-8384-bccc3d8b4784 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:20.474727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cce0f053-59ca-42e8-8384-bccc3d8b4784 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042839 Sep 14 19:49:20.478232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 671/1362] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:20.705119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-34d095cb-e78f-4e20-a15d-52bb4e9eddcb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:20.706074 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-34d095cb-e78f-4e20-a15d-52bb4e9eddcb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:20.711898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-34d095cb-e78f-4e20-a15d-52bb4e9eddcb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:20.712345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-34d095cb-e78f-4e20-a15d-52bb4e9eddcb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:20.713108 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-34d095cb-e78f-4e20-a15d-52bb4e9eddcb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:20.713576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-34d095cb-e78f-4e20-a15d-52bb4e9eddcb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:20.741981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-34d095cb-e78f-4e20-a15d-52bb4e9eddcb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040529 Sep 14 19:49:20.742527 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 692/1363] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:20 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:20.776908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8458050f-f296-428e-819f-6eebd1c65f43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:20.777529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8458050f-f296-428e-819f-6eebd1c65f43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:20.783592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8458050f-f296-428e-819f-6eebd1c65f43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:20.784041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8458050f-f296-428e-819f-6eebd1c65f43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:20.784806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8458050f-f296-428e-819f-6eebd1c65f43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:20.785242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8458050f-f296-428e-819f-6eebd1c65f43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:20.909103 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8458050f-f296-428e-819f-6eebd1c65f43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:20.916976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8458050f-f296-428e-819f-6eebd1c65f43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143501 Sep 14 19:49:20.917574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 672/1364] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:20 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:20.952001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-766597ed-2369-4584-a7c7-51225e441e38 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:20.952902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-766597ed-2369-4584-a7c7-51225e441e38 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:20.958699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-766597ed-2369-4584-a7c7-51225e441e38 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:20.959078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-766597ed-2369-4584-a7c7-51225e441e38 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:20.959837 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-766597ed-2369-4584-a7c7-51225e441e38 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:20.960258 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-766597ed-2369-4584-a7c7-51225e441e38 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:20.989008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-766597ed-2369-4584-a7c7-51225e441e38 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040755 Sep 14 19:49:20.989556 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 693/1365] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:20 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:21.487305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5aab4940-e7cd-4490-ac1d-f47363b21630 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:21.488238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5aab4940-e7cd-4490-ac1d-f47363b21630 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:21.494192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5aab4940-e7cd-4490-ac1d-f47363b21630 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:21.494640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5aab4940-e7cd-4490-ac1d-f47363b21630 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:21.495437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5aab4940-e7cd-4490-ac1d-f47363b21630 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:21.495872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5aab4940-e7cd-4490-ac1d-f47363b21630 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:21.524916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5aab4940-e7cd-4490-ac1d-f47363b21630 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042112 Sep 14 19:49:21.525464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 673/1366] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:21 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:49:21.753291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9a72d431-632d-40bc-ac8b-b54e9912251e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:21.754137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9a72d431-632d-40bc-ac8b-b54e9912251e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:21.760027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a72d431-632d-40bc-ac8b-b54e9912251e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:21.760479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a72d431-632d-40bc-ac8b-b54e9912251e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:21.761253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a72d431-632d-40bc-ac8b-b54e9912251e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:21.761725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a72d431-632d-40bc-ac8b-b54e9912251e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:21.791129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9a72d431-632d-40bc-ac8b-b54e9912251e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041694 Sep 14 19:49:21.791763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 694/1367] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:21 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:21.935039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-71032aed-e517-4f3b-831d-5d68b9cb7fd9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:21.935210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-71032aed-e517-4f3b-831d-5d68b9cb7fd9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:21.940720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71032aed-e517-4f3b-831d-5d68b9cb7fd9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:21.941166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71032aed-e517-4f3b-831d-5d68b9cb7fd9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:21.941958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71032aed-e517-4f3b-831d-5d68b9cb7fd9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:21.942391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71032aed-e517-4f3b-831d-5d68b9cb7fd9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:22.000287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e12e6ed1-635b-4ff7-8671-bd94329ecd1c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:22.001303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e12e6ed1-635b-4ff7-8671-bd94329ecd1c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:22.007665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e12e6ed1-635b-4ff7-8671-bd94329ecd1c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:22.008033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e12e6ed1-635b-4ff7-8671-bd94329ecd1c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:22.008826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e12e6ed1-635b-4ff7-8671-bd94329ecd1c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:22.009258 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e12e6ed1-635b-4ff7-8671-bd94329ecd1c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:22.040840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e12e6ed1-635b-4ff7-8671-bd94329ecd1c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Sep 14 19:49:22.041622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 695/1368] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:21 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:22.068806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-71032aed-e517-4f3b-831d-5d68b9cb7fd9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:22.076034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-71032aed-e517-4f3b-831d-5d68b9cb7fd9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.145278 Sep 14 19:49:22.076689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 674/1369] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:21 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:22.536228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-88c39e39-53dd-4794-861a-33d2b784e78f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:22.537131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-88c39e39-53dd-4794-861a-33d2b784e78f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:22.543001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88c39e39-53dd-4794-861a-33d2b784e78f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:22.543448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88c39e39-53dd-4794-861a-33d2b784e78f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:22.544214 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88c39e39-53dd-4794-861a-33d2b784e78f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:22.544658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88c39e39-53dd-4794-861a-33d2b784e78f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:22.573480 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-88c39e39-53dd-4794-861a-33d2b784e78f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041057 Sep 14 19:49:22.574055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 696/1370] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:22 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:22.803031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d44f73a5-a595-4008-adc7-2c2da6e2a849 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:22.808633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d44f73a5-a595-4008-adc7-2c2da6e2a849 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:22.809761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d44f73a5-a595-4008-adc7-2c2da6e2a849 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:22.810214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d44f73a5-a595-4008-adc7-2c2da6e2a849 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:22.810989 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d44f73a5-a595-4008-adc7-2c2da6e2a849 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:22.811428 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d44f73a5-a595-4008-adc7-2c2da6e2a849 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:22.840574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d44f73a5-a595-4008-adc7-2c2da6e2a849 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 Sep 14 19:49:22.841142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 675/1371] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:22 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:23.053577 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-03a83975-3486-477e-a05c-47efeca2c49c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:23.054400 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-03a83975-3486-477e-a05c-47efeca2c49c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:23.060258 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03a83975-3486-477e-a05c-47efeca2c49c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:23.060734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03a83975-3486-477e-a05c-47efeca2c49c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:23.061523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03a83975-3486-477e-a05c-47efeca2c49c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:23.061974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03a83975-3486-477e-a05c-47efeca2c49c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:23.091944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-03a83975-3486-477e-a05c-47efeca2c49c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042177 Sep 14 19:49:23.092516 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 697/1372] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:23 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:23.093549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4cd44aed-7858-43f8-992c-c4019271ba3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:23.094213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4cd44aed-7858-43f8-992c-c4019271ba3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:23.100452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4cd44aed-7858-43f8-992c-c4019271ba3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:23.100889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4cd44aed-7858-43f8-992c-c4019271ba3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:23.101707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4cd44aed-7858-43f8-992c-c4019271ba3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:23.102138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4cd44aed-7858-43f8-992c-c4019271ba3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:23.220674 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4cd44aed-7858-43f8-992c-c4019271ba3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:23.227884 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4cd44aed-7858-43f8-992c-c4019271ba3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.138012 Sep 14 19:49:23.228459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 676/1373] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:23 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:49:23.585736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-aceebde2-b714-4df1-82ae-066a62fce16b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:23.586653 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-aceebde2-b714-4df1-82ae-066a62fce16b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:23.592497 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aceebde2-b714-4df1-82ae-066a62fce16b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:23.592932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aceebde2-b714-4df1-82ae-066a62fce16b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:23.593719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aceebde2-b714-4df1-82ae-066a62fce16b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:23.594149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aceebde2-b714-4df1-82ae-066a62fce16b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:23.624418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-aceebde2-b714-4df1-82ae-066a62fce16b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042706 Sep 14 19:49:23.624975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 698/1374] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:23.852002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-26a7359f-860c-4c77-86c5-0791db112fac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:23.852920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-26a7359f-860c-4c77-86c5-0791db112fac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:23.858713 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26a7359f-860c-4c77-86c5-0791db112fac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:23.859161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26a7359f-860c-4c77-86c5-0791db112fac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:23.859920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26a7359f-860c-4c77-86c5-0791db112fac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:23.860354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26a7359f-860c-4c77-86c5-0791db112fac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:23.888718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-26a7359f-860c-4c77-86c5-0791db112fac tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040524 Sep 14 19:49:23.889264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 677/1375] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:23 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:24.103125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b75392a7-912c-41d2-9239-7f82a4d69384 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:24.103947 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b75392a7-912c-41d2-9239-7f82a4d69384 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:24.109827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b75392a7-912c-41d2-9239-7f82a4d69384 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:24.110283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b75392a7-912c-41d2-9239-7f82a4d69384 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:24.111051 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b75392a7-912c-41d2-9239-7f82a4d69384 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:24.111488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b75392a7-912c-41d2-9239-7f82a4d69384 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:24.140157 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b75392a7-912c-41d2-9239-7f82a4d69384 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040822 Sep 14 19:49:24.140716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 699/1376] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:24 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:24.244725 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7bd6b109-b8f8-4b3b-acfb-4809ffbb4f17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:24.245331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7bd6b109-b8f8-4b3b-acfb-4809ffbb4f17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:24.251813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7bd6b109-b8f8-4b3b-acfb-4809ffbb4f17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:24.252254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7bd6b109-b8f8-4b3b-acfb-4809ffbb4f17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:24.253054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7bd6b109-b8f8-4b3b-acfb-4809ffbb4f17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:24.253489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7bd6b109-b8f8-4b3b-acfb-4809ffbb4f17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:24.376649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7bd6b109-b8f8-4b3b-acfb-4809ffbb4f17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:24.383941 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7bd6b109-b8f8-4b3b-acfb-4809ffbb4f17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142913 Sep 14 19:49:24.384488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 678/1377] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:24 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:24.635891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6536231f-7fe2-46e4-a8c4-4e60098a26c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:24.636859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6536231f-7fe2-46e4-a8c4-4e60098a26c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:24.642781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6536231f-7fe2-46e4-a8c4-4e60098a26c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:24.643229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6536231f-7fe2-46e4-a8c4-4e60098a26c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:24.644143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6536231f-7fe2-46e4-a8c4-4e60098a26c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:24.644581 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6536231f-7fe2-46e4-a8c4-4e60098a26c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:24.679553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6536231f-7fe2-46e4-a8c4-4e60098a26c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047424 Sep 14 19:49:24.680109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 700/1378] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:24.900888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8fcae1b9-ceea-440a-87fd-f1cdd5bd02df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:24.901744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8fcae1b9-ceea-440a-87fd-f1cdd5bd02df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:24.907526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8fcae1b9-ceea-440a-87fd-f1cdd5bd02df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:24.907964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8fcae1b9-ceea-440a-87fd-f1cdd5bd02df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:24.908751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8fcae1b9-ceea-440a-87fd-f1cdd5bd02df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:24.909865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8fcae1b9-ceea-440a-87fd-f1cdd5bd02df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:24.938762 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8fcae1b9-ceea-440a-87fd-f1cdd5bd02df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041633 Sep 14 19:49:24.939316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 679/1379] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:24 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:25.152315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ad7bdaea-2408-4901-9f78-90aba7d118d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:25.153204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ad7bdaea-2408-4901-9f78-90aba7d118d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:25.159047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ad7bdaea-2408-4901-9f78-90aba7d118d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:25.159982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ad7bdaea-2408-4901-9f78-90aba7d118d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:25.160737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ad7bdaea-2408-4901-9f78-90aba7d118d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:25.161165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ad7bdaea-2408-4901-9f78-90aba7d118d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:25.189066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ad7bdaea-2408-4901-9f78-90aba7d118d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040839 Sep 14 19:49:25.189600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 701/1380] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:25 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:25.402110 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ecf73816-6aec-4dd7-8a15-6e878ee897dd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:25.402766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ecf73816-6aec-4dd7-8a15-6e878ee897dd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:25.408590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecf73816-6aec-4dd7-8a15-6e878ee897dd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:25.409037 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecf73816-6aec-4dd7-8a15-6e878ee897dd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:25.409879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecf73816-6aec-4dd7-8a15-6e878ee897dd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:25.410329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecf73816-6aec-4dd7-8a15-6e878ee897dd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:25.529141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ecf73816-6aec-4dd7-8a15-6e878ee897dd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:25.536370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ecf73816-6aec-4dd7-8a15-6e878ee897dd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137938 Sep 14 19:49:25.536925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 680/1381] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:25 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:25.692204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f14fe82b-715e-4661-a677-0fdb192d0614 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:25.693031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f14fe82b-715e-4661-a677-0fdb192d0614 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:25.699052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f14fe82b-715e-4661-a677-0fdb192d0614 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:25.699502 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f14fe82b-715e-4661-a677-0fdb192d0614 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:25.700284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f14fe82b-715e-4661-a677-0fdb192d0614 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:25.700720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f14fe82b-715e-4661-a677-0fdb192d0614 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:25.729102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f14fe82b-715e-4661-a677-0fdb192d0614 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041519 Sep 14 19:49:25.729692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 702/1382] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:25.950348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-33c5d0ac-cb2a-4b7a-b57a-1ae8b903a216 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:25.951179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-33c5d0ac-cb2a-4b7a-b57a-1ae8b903a216 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:25.957067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33c5d0ac-cb2a-4b7a-b57a-1ae8b903a216 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:25.957538 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33c5d0ac-cb2a-4b7a-b57a-1ae8b903a216 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:25.958395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33c5d0ac-cb2a-4b7a-b57a-1ae8b903a216 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:25.958781 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33c5d0ac-cb2a-4b7a-b57a-1ae8b903a216 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:25.987556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-33c5d0ac-cb2a-4b7a-b57a-1ae8b903a216 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040654 Sep 14 19:49:25.988138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 681/1383] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:25 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:26.199956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-463ccfce-8558-49ae-b9b7-2111a715cc63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:26.200901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-463ccfce-8558-49ae-b9b7-2111a715cc63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:26.206642 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-463ccfce-8558-49ae-b9b7-2111a715cc63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:26.207082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-463ccfce-8558-49ae-b9b7-2111a715cc63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:26.207837 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-463ccfce-8558-49ae-b9b7-2111a715cc63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:26.208262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-463ccfce-8558-49ae-b9b7-2111a715cc63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:26.236401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-463ccfce-8558-49ae-b9b7-2111a715cc63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040161 Sep 14 19:49:26.236943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 703/1384] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:26 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:26.554037 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1e46a63e-9817-4827-9e33-69615bc35f26 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:26.554585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1e46a63e-9817-4827-9e33-69615bc35f26 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:26.560374 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e46a63e-9817-4827-9e33-69615bc35f26 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:26.560808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e46a63e-9817-4827-9e33-69615bc35f26 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:26.561582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e46a63e-9817-4827-9e33-69615bc35f26 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:26.562011 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e46a63e-9817-4827-9e33-69615bc35f26 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:26.678483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1e46a63e-9817-4827-9e33-69615bc35f26 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:26.686295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1e46a63e-9817-4827-9e33-69615bc35f26 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.136084 Sep 14 19:49:26.686435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 682/1385] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:26 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:26.740787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-65cfebe2-63d9-46f5-9059-c1ece9f078c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:26.741714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-65cfebe2-63d9-46f5-9059-c1ece9f078c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:26.747586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65cfebe2-63d9-46f5-9059-c1ece9f078c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:26.748028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65cfebe2-63d9-46f5-9059-c1ece9f078c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:26.748798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65cfebe2-63d9-46f5-9059-c1ece9f078c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:26.749232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65cfebe2-63d9-46f5-9059-c1ece9f078c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:26.777745 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-65cfebe2-63d9-46f5-9059-c1ece9f078c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040842 Sep 14 19:49:26.778287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 704/1386] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:26.999081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c35c647a-80bf-433e-a647-be2cf9ac79d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:26.999974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c35c647a-80bf-433e-a647-be2cf9ac79d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:27.006735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c35c647a-80bf-433e-a647-be2cf9ac79d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:27.007177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c35c647a-80bf-433e-a647-be2cf9ac79d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:27.007935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c35c647a-80bf-433e-a647-be2cf9ac79d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:27.008360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c35c647a-80bf-433e-a647-be2cf9ac79d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:27.038308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c35c647a-80bf-433e-a647-be2cf9ac79d4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042988 Sep 14 19:49:27.038878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 683/1387] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:26 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:27.247798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c9a9f5d3-ee3a-45b4-a9b4-604dd5669fc3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:27.248694 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c9a9f5d3-ee3a-45b4-a9b4-604dd5669fc3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:27.255144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c9a9f5d3-ee3a-45b4-a9b4-604dd5669fc3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:27.255692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c9a9f5d3-ee3a-45b4-a9b4-604dd5669fc3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:27.256430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c9a9f5d3-ee3a-45b4-a9b4-604dd5669fc3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:27.256770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c9a9f5d3-ee3a-45b4-a9b4-604dd5669fc3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:27.284960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c9a9f5d3-ee3a-45b4-a9b4-604dd5669fc3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 Sep 14 19:49:27.285525 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 705/1388] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:27 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:27.702704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b5437e0c-3859-4532-9f67-8613c594f7cf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:27.703307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b5437e0c-3859-4532-9f67-8613c594f7cf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:27.709209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b5437e0c-3859-4532-9f67-8613c594f7cf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:27.709688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b5437e0c-3859-4532-9f67-8613c594f7cf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:27.710448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b5437e0c-3859-4532-9f67-8613c594f7cf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:27.711268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b5437e0c-3859-4532-9f67-8613c594f7cf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:27.789106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8b609e6f-1884-4619-80cf-cf93472295bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:27.790066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8b609e6f-1884-4619-80cf-cf93472295bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:27.796361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b609e6f-1884-4619-80cf-cf93472295bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:27.796812 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b609e6f-1884-4619-80cf-cf93472295bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:27.797622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b609e6f-1884-4619-80cf-cf93472295bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:27.798318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b609e6f-1884-4619-80cf-cf93472295bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:27.827882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8b609e6f-1884-4619-80cf-cf93472295bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042735 Sep 14 19:49:27.828453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 706/1389] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:27 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:27.832322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b5437e0c-3859-4532-9f67-8613c594f7cf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:27.839813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b5437e0c-3859-4532-9f67-8613c594f7cf tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140767 Sep 14 19:49:27.840373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 684/1390] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:27 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:28.050313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-37405f0e-89f2-49af-b82e-43ca842f5a61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:28.051146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-37405f0e-89f2-49af-b82e-43ca842f5a61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:28.056906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37405f0e-89f2-49af-b82e-43ca842f5a61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:28.059153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37405f0e-89f2-49af-b82e-43ca842f5a61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:28.059153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37405f0e-89f2-49af-b82e-43ca842f5a61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:28.059153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37405f0e-89f2-49af-b82e-43ca842f5a61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:28.087935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-37405f0e-89f2-49af-b82e-43ca842f5a61 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041784 Sep 14 19:49:28.088500 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 707/1391] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:28 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:28.296107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eadba19c-531f-49cc-b991-5eb69681e78f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:28.297010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eadba19c-531f-49cc-b991-5eb69681e78f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:28.303363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eadba19c-531f-49cc-b991-5eb69681e78f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:28.303746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eadba19c-531f-49cc-b991-5eb69681e78f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:28.304567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eadba19c-531f-49cc-b991-5eb69681e78f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:28.305031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eadba19c-531f-49cc-b991-5eb69681e78f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:28.334585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eadba19c-531f-49cc-b991-5eb69681e78f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042252 Sep 14 19:49:28.335182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 685/1392] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:28 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:28.839625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1a28d043-5d8d-43c5-a5f5-85381c299e62 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:28.840539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1a28d043-5d8d-43c5-a5f5-85381c299e62 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:28.846442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a28d043-5d8d-43c5-a5f5-85381c299e62 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:28.846945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a28d043-5d8d-43c5-a5f5-85381c299e62 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:28.847727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a28d043-5d8d-43c5-a5f5-85381c299e62 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:28.848158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a28d043-5d8d-43c5-a5f5-85381c299e62 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:28.855843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e6437173-36d2-4b24-be66-cbeddb2cb617 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:28.856452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e6437173-36d2-4b24-be66-cbeddb2cb617 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:28.862313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e6437173-36d2-4b24-be66-cbeddb2cb617 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:28.862764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e6437173-36d2-4b24-be66-cbeddb2cb617 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:28.864094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e6437173-36d2-4b24-be66-cbeddb2cb617 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:28.864559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e6437173-36d2-4b24-be66-cbeddb2cb617 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:28.877311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1a28d043-5d8d-43c5-a5f5-85381c299e62 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041455 Sep 14 19:49:28.877914 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 708/1393] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:28 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:28.989978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e6437173-36d2-4b24-be66-cbeddb2cb617 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:28.997241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e6437173-36d2-4b24-be66-cbeddb2cb617 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.145052 Sep 14 19:49:28.997835 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 686/1394] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:28 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:49:29.099953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-29484f69-0c2e-4f23-8f7c-d6ba0c4eaf84 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:29.100785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-29484f69-0c2e-4f23-8f7c-d6ba0c4eaf84 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:29.106609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29484f69-0c2e-4f23-8f7c-d6ba0c4eaf84 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:29.107058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29484f69-0c2e-4f23-8f7c-d6ba0c4eaf84 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:29.107821 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29484f69-0c2e-4f23-8f7c-d6ba0c4eaf84 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:29.108256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29484f69-0c2e-4f23-8f7c-d6ba0c4eaf84 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:29.137312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-29484f69-0c2e-4f23-8f7c-d6ba0c4eaf84 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041712 Sep 14 19:49:29.137922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 709/1395] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:29 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:29.345915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b39cc197-4630-463d-ae26-9e994bd3f1a5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:29.346858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b39cc197-4630-463d-ae26-9e994bd3f1a5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:29.353122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b39cc197-4630-463d-ae26-9e994bd3f1a5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:29.353521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b39cc197-4630-463d-ae26-9e994bd3f1a5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:29.354282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b39cc197-4630-463d-ae26-9e994bd3f1a5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:29.354707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b39cc197-4630-463d-ae26-9e994bd3f1a5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:29.382901 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b39cc197-4630-463d-ae26-9e994bd3f1a5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040720 Sep 14 19:49:29.383449 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 687/1396] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:29 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:29.890467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-74655de0-41ae-4b0b-88b4-3d29c2b8f7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:29.891404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-74655de0-41ae-4b0b-88b4-3d29c2b8f7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:29.897586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-74655de0-41ae-4b0b-88b4-3d29c2b8f7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:29.898078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-74655de0-41ae-4b0b-88b4-3d29c2b8f7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:29.898923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-74655de0-41ae-4b0b-88b4-3d29c2b8f7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:29.899450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-74655de0-41ae-4b0b-88b4-3d29c2b8f7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:29.929055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-74655de0-41ae-4b0b-88b4-3d29c2b8f7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042711 Sep 14 19:49:29.929708 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 710/1397] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:29 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:30.014526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9cc98b49-5497-4020-89f6-a3e144573426 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:30.015124 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9cc98b49-5497-4020-89f6-a3e144573426 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:30.021057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cc98b49-5497-4020-89f6-a3e144573426 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:30.021562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cc98b49-5497-4020-89f6-a3e144573426 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:30.022326 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cc98b49-5497-4020-89f6-a3e144573426 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:30.022755 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cc98b49-5497-4020-89f6-a3e144573426 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:30.142765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9cc98b49-5497-4020-89f6-a3e144573426 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:30.148626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e0fee25e-1e64-4f24-b251-8cfc44bd5f18 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:30.149558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e0fee25e-1e64-4f24-b251-8cfc44bd5f18 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:30.150714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9cc98b49-5497-4020-89f6-a3e144573426 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139817 Sep 14 19:49:30.151293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 688/1398] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:30 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:30.155385 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0fee25e-1e64-4f24-b251-8cfc44bd5f18 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:30.155834 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0fee25e-1e64-4f24-b251-8cfc44bd5f18 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:30.156609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0fee25e-1e64-4f24-b251-8cfc44bd5f18 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:30.157047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0fee25e-1e64-4f24-b251-8cfc44bd5f18 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:30.186951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e0fee25e-1e64-4f24-b251-8cfc44bd5f18 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042556 Sep 14 19:49:30.187698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 711/1399] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:30 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:30.393896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c2957ba8-3ada-472d-820b-05a807a31e4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:30.394806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c2957ba8-3ada-472d-820b-05a807a31e4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:30.401294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2957ba8-3ada-472d-820b-05a807a31e4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:30.401781 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2957ba8-3ada-472d-820b-05a807a31e4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:30.402580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2957ba8-3ada-472d-820b-05a807a31e4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:30.403010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c2957ba8-3ada-472d-820b-05a807a31e4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:30.431883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c2957ba8-3ada-472d-820b-05a807a31e4a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 Sep 14 19:49:30.432435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 689/1400] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:30 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:30.940754 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7d6b1ced-7829-45d8-be99-6be4145f1de3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:30.941684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7d6b1ced-7829-45d8-be99-6be4145f1de3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:30.948122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d6b1ced-7829-45d8-be99-6be4145f1de3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:30.948565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d6b1ced-7829-45d8-be99-6be4145f1de3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:30.949330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d6b1ced-7829-45d8-be99-6be4145f1de3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:30.949791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d6b1ced-7829-45d8-be99-6be4145f1de3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:30.977323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7d6b1ced-7829-45d8-be99-6be4145f1de3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040366 Sep 14 19:49:30.977909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 712/1401] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:30 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:31.166559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-30c01026-3df5-4522-b676-c824eb4690b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:31.167165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-30c01026-3df5-4522-b676-c824eb4690b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:31.173450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30c01026-3df5-4522-b676-c824eb4690b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:31.173927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30c01026-3df5-4522-b676-c824eb4690b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:31.174703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30c01026-3df5-4522-b676-c824eb4690b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:31.175135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30c01026-3df5-4522-b676-c824eb4690b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:31.198898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ee8fdf83-da2e-46f6-9024-c55cfa34d319 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:31.199855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ee8fdf83-da2e-46f6-9024-c55cfa34d319 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:31.205918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8fdf83-da2e-46f6-9024-c55cfa34d319 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:31.206368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8fdf83-da2e-46f6-9024-c55cfa34d319 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:31.207191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8fdf83-da2e-46f6-9024-c55cfa34d319 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:31.207629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee8fdf83-da2e-46f6-9024-c55cfa34d319 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:31.237924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ee8fdf83-da2e-46f6-9024-c55cfa34d319 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042649 Sep 14 19:49:31.238485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 713/1402] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:31 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:31.305360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-30c01026-3df5-4522-b676-c824eb4690b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:31.312776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-30c01026-3df5-4522-b676-c824eb4690b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.149854 Sep 14 19:49:31.313335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 690/1403] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:31 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:31.443827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7affe021-5aa8-4215-b443-b37ea5388bd6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:31.444749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7affe021-5aa8-4215-b443-b37ea5388bd6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:31.450572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7affe021-5aa8-4215-b443-b37ea5388bd6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:31.451018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7affe021-5aa8-4215-b443-b37ea5388bd6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:31.451788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7affe021-5aa8-4215-b443-b37ea5388bd6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:31.452227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7affe021-5aa8-4215-b443-b37ea5388bd6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:31.482265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7affe021-5aa8-4215-b443-b37ea5388bd6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042816 Sep 14 19:49:31.482851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 714/1404] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:31 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:31.989043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c3f08e75-79f7-47ba-a2cf-1ee45680d97c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:31.990540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c3f08e75-79f7-47ba-a2cf-1ee45680d97c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:31.996344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3f08e75-79f7-47ba-a2cf-1ee45680d97c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:31.996791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3f08e75-79f7-47ba-a2cf-1ee45680d97c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:31.997571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3f08e75-79f7-47ba-a2cf-1ee45680d97c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:31.998002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3f08e75-79f7-47ba-a2cf-1ee45680d97c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:32.025642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c3f08e75-79f7-47ba-a2cf-1ee45680d97c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040351 Sep 14 19:49:32.026180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 691/1405] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:31 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:32.249833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-30f31cde-48ae-4791-8212-1eac51f0eb2e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:32.250740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-30f31cde-48ae-4791-8212-1eac51f0eb2e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:32.256667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-30f31cde-48ae-4791-8212-1eac51f0eb2e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:32.257121 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-30f31cde-48ae-4791-8212-1eac51f0eb2e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:32.258141 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-30f31cde-48ae-4791-8212-1eac51f0eb2e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:32.258652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-30f31cde-48ae-4791-8212-1eac51f0eb2e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:32.288311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-30f31cde-48ae-4791-8212-1eac51f0eb2e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 Sep 14 19:49:32.288871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 715/1406] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:32 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:32.329506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5d0c0cd0-5a5b-4424-95bd-223e898d56e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:32.330245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5d0c0cd0-5a5b-4424-95bd-223e898d56e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:32.336233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d0c0cd0-5a5b-4424-95bd-223e898d56e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:32.336676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d0c0cd0-5a5b-4424-95bd-223e898d56e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:32.337435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d0c0cd0-5a5b-4424-95bd-223e898d56e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:32.337892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d0c0cd0-5a5b-4424-95bd-223e898d56e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:32.456628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5d0c0cd0-5a5b-4424-95bd-223e898d56e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:32.464659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5d0c0cd0-5a5b-4424-95bd-223e898d56e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.138769 Sep 14 19:49:32.465253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 692/1407] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:32 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:32.493711 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-14511760-54a3-4cd6-992f-1ba58bad1394 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:32.494619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-14511760-54a3-4cd6-992f-1ba58bad1394 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:32.500383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14511760-54a3-4cd6-992f-1ba58bad1394 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:32.500792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14511760-54a3-4cd6-992f-1ba58bad1394 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:32.501558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14511760-54a3-4cd6-992f-1ba58bad1394 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:32.501996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14511760-54a3-4cd6-992f-1ba58bad1394 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:32.530079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-14511760-54a3-4cd6-992f-1ba58bad1394 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040154 Sep 14 19:49:32.530629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 716/1408] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:32 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:33.037555 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5e115d68-d95d-4279-a8eb-0f851e671956 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:33.038488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5e115d68-d95d-4279-a8eb-0f851e671956 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:33.044290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e115d68-d95d-4279-a8eb-0f851e671956 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:33.048320 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e115d68-d95d-4279-a8eb-0f851e671956 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:33.048320 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e115d68-d95d-4279-a8eb-0f851e671956 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:33.048320 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e115d68-d95d-4279-a8eb-0f851e671956 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:33.075181 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5e115d68-d95d-4279-a8eb-0f851e671956 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041474 Sep 14 19:49:33.075732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 693/1409] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:33 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:33.299123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e999256c-b68d-4216-986a-ea2dd6e913d0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:33.300115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e999256c-b68d-4216-986a-ea2dd6e913d0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:33.306721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e999256c-b68d-4216-986a-ea2dd6e913d0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:33.307164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e999256c-b68d-4216-986a-ea2dd6e913d0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:33.307936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e999256c-b68d-4216-986a-ea2dd6e913d0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:33.308370 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e999256c-b68d-4216-986a-ea2dd6e913d0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:33.337103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e999256c-b68d-4216-986a-ea2dd6e913d0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041947 Sep 14 19:49:33.337681 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 717/1410] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:33 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:33.481863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-078432d2-024f-4605-8187-1e30b0606635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:33.482462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-078432d2-024f-4605-8187-1e30b0606635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:33.488440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-078432d2-024f-4605-8187-1e30b0606635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:33.488886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-078432d2-024f-4605-8187-1e30b0606635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:33.490315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-078432d2-024f-4605-8187-1e30b0606635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:33.490752 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-078432d2-024f-4605-8187-1e30b0606635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:33.542674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-529df5eb-8597-4670-9aec-0531cb8b34e5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:33.543864 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-529df5eb-8597-4670-9aec-0531cb8b34e5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:33.550660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-529df5eb-8597-4670-9aec-0531cb8b34e5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:33.551397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-529df5eb-8597-4670-9aec-0531cb8b34e5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:33.552856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-529df5eb-8597-4670-9aec-0531cb8b34e5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:33.561679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-529df5eb-8597-4670-9aec-0531cb8b34e5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:33.583253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-529df5eb-8597-4670-9aec-0531cb8b34e5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Sep 14 19:49:33.583817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 718/1411] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:33 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:33.617864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-078432d2-024f-4605-8187-1e30b0606635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:33.625224 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-078432d2-024f-4605-8187-1e30b0606635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.146968 Sep 14 19:49:33.625810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 694/1412] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:33 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:34.087216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-358b17fd-a297-4414-9ac6-faafcdffb07f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:34.088181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-358b17fd-a297-4414-9ac6-faafcdffb07f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:34.093985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-358b17fd-a297-4414-9ac6-faafcdffb07f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:34.094432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-358b17fd-a297-4414-9ac6-faafcdffb07f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:34.095196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-358b17fd-a297-4414-9ac6-faafcdffb07f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:34.095629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-358b17fd-a297-4414-9ac6-faafcdffb07f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:34.124451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-358b17fd-a297-4414-9ac6-faafcdffb07f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041482 Sep 14 19:49:34.125002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 719/1413] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:34 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:34.348684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-594d610d-f3e1-4e73-8342-a87143c96a01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:34.349529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-594d610d-f3e1-4e73-8342-a87143c96a01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:34.355310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-594d610d-f3e1-4e73-8342-a87143c96a01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:34.355763 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-594d610d-f3e1-4e73-8342-a87143c96a01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:34.356534 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-594d610d-f3e1-4e73-8342-a87143c96a01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:34.356971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-594d610d-f3e1-4e73-8342-a87143c96a01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:34.385673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-594d610d-f3e1-4e73-8342-a87143c96a01 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040960 Sep 14 19:49:34.386225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 695/1414] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:34 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:34.593638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4496bfbb-b0b0-4275-8e69-1ac9e559541b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:34.594658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4496bfbb-b0b0-4275-8e69-1ac9e559541b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:34.601091 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4496bfbb-b0b0-4275-8e69-1ac9e559541b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:34.601466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4496bfbb-b0b0-4275-8e69-1ac9e559541b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:34.602258 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4496bfbb-b0b0-4275-8e69-1ac9e559541b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:34.602687 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4496bfbb-b0b0-4275-8e69-1ac9e559541b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:34.631336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4496bfbb-b0b0-4275-8e69-1ac9e559541b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041374 Sep 14 19:49:34.631881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 720/1415] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:34 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:34.641767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2ceec8e9-cd96-4dfc-9390-e49f2e2eef50 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:34.642356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2ceec8e9-cd96-4dfc-9390-e49f2e2eef50 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:34.648552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ceec8e9-cd96-4dfc-9390-e49f2e2eef50 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:34.648994 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ceec8e9-cd96-4dfc-9390-e49f2e2eef50 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:34.649805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ceec8e9-cd96-4dfc-9390-e49f2e2eef50 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:34.650234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ceec8e9-cd96-4dfc-9390-e49f2e2eef50 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:34.772289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2ceec8e9-cd96-4dfc-9390-e49f2e2eef50 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:34.779508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2ceec8e9-cd96-4dfc-9390-e49f2e2eef50 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141454 Sep 14 19:49:34.780075 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 696/1416] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:34 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:35.136504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cce17ccb-bec6-4e16-8c73-f21d7a5b5540 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:35.137403 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cce17ccb-bec6-4e16-8c73-f21d7a5b5540 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:35.143296 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cce17ccb-bec6-4e16-8c73-f21d7a5b5540 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:35.143739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cce17ccb-bec6-4e16-8c73-f21d7a5b5540 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:35.144516 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cce17ccb-bec6-4e16-8c73-f21d7a5b5540 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:35.144954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cce17ccb-bec6-4e16-8c73-f21d7a5b5540 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:35.174688 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cce17ccb-bec6-4e16-8c73-f21d7a5b5540 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041916 Sep 14 19:49:35.175238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 721/1417] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:35 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:35.397114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9014737f-48ec-49b1-8298-79f15fe9691e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:35.397960 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9014737f-48ec-49b1-8298-79f15fe9691e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:35.403827 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9014737f-48ec-49b1-8298-79f15fe9691e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:35.404277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9014737f-48ec-49b1-8298-79f15fe9691e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:35.405045 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9014737f-48ec-49b1-8298-79f15fe9691e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:35.405483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9014737f-48ec-49b1-8298-79f15fe9691e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:35.435113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9014737f-48ec-49b1-8298-79f15fe9691e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041807 Sep 14 19:49:35.435679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 697/1418] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:35 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:35.642665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9e43cea3-324d-47a9-8bd1-6782b3bb3711 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:35.643585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9e43cea3-324d-47a9-8bd1-6782b3bb3711 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:35.649360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e43cea3-324d-47a9-8bd1-6782b3bb3711 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:35.649778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e43cea3-324d-47a9-8bd1-6782b3bb3711 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:35.650556 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e43cea3-324d-47a9-8bd1-6782b3bb3711 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:35.651113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e43cea3-324d-47a9-8bd1-6782b3bb3711 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:35.681616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9e43cea3-324d-47a9-8bd1-6782b3bb3711 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 Sep 14 19:49:35.682196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 722/1419] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:35 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:35.795956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-50758092-cd78-464d-ad6e-3ce587e2e49c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:35.796565 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-50758092-cd78-464d-ad6e-3ce587e2e49c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:35.803418 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50758092-cd78-464d-ad6e-3ce587e2e49c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:35.803860 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50758092-cd78-464d-ad6e-3ce587e2e49c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:35.804662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50758092-cd78-464d-ad6e-3ce587e2e49c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:35.805094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50758092-cd78-464d-ad6e-3ce587e2e49c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:35.928239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-50758092-cd78-464d-ad6e-3ce587e2e49c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:35.935369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-50758092-cd78-464d-ad6e-3ce587e2e49c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143033 Sep 14 19:49:35.935951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 698/1420] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:35 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:36.186643 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8751a70a-669b-4207-8b8f-211b7700d48b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:36.187448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8751a70a-669b-4207-8b8f-211b7700d48b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:36.193533 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8751a70a-669b-4207-8b8f-211b7700d48b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:36.194021 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8751a70a-669b-4207-8b8f-211b7700d48b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:36.194778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8751a70a-669b-4207-8b8f-211b7700d48b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:36.195209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8751a70a-669b-4207-8b8f-211b7700d48b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:36.224095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8751a70a-669b-4207-8b8f-211b7700d48b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040655 Sep 14 19:49:36.224659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 723/1421] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:36 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:36.446470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fdee371c-2be0-41f5-b934-55f4c5830ba5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:36.447369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fdee371c-2be0-41f5-b934-55f4c5830ba5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:36.453236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fdee371c-2be0-41f5-b934-55f4c5830ba5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:36.453717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fdee371c-2be0-41f5-b934-55f4c5830ba5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:36.454476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fdee371c-2be0-41f5-b934-55f4c5830ba5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:36.454906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fdee371c-2be0-41f5-b934-55f4c5830ba5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:36.484112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fdee371c-2be0-41f5-b934-55f4c5830ba5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041507 Sep 14 19:49:36.484667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 699/1422] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:36 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:36.693030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b3237b12-2557-4a91-8296-dc4d55ecb732 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:36.694040 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b3237b12-2557-4a91-8296-dc4d55ecb732 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:36.699823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3237b12-2557-4a91-8296-dc4d55ecb732 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:36.700203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3237b12-2557-4a91-8296-dc4d55ecb732 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:36.700956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3237b12-2557-4a91-8296-dc4d55ecb732 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:36.701384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3237b12-2557-4a91-8296-dc4d55ecb732 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:36.730671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b3237b12-2557-4a91-8296-dc4d55ecb732 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041777 Sep 14 19:49:36.731215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 724/1423] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:36 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:36.952546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-414a64e9-d6c6-47de-8c8f-19e9e01b194b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:36.953077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-414a64e9-d6c6-47de-8c8f-19e9e01b194b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:36.959377 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-414a64e9-d6c6-47de-8c8f-19e9e01b194b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:36.959812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-414a64e9-d6c6-47de-8c8f-19e9e01b194b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:36.960559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-414a64e9-d6c6-47de-8c8f-19e9e01b194b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:36.960986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-414a64e9-d6c6-47de-8c8f-19e9e01b194b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:37.076680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-414a64e9-d6c6-47de-8c8f-19e9e01b194b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:37.084495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-414a64e9-d6c6-47de-8c8f-19e9e01b194b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.135652 Sep 14 19:49:37.085063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 700/1424] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:36 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:49:37.235776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a7599119-2ad2-46cd-95ca-731eed66bc7e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:37.236601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a7599119-2ad2-46cd-95ca-731eed66bc7e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:37.242435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7599119-2ad2-46cd-95ca-731eed66bc7e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:37.242883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7599119-2ad2-46cd-95ca-731eed66bc7e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:37.243649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7599119-2ad2-46cd-95ca-731eed66bc7e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:37.244081 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a7599119-2ad2-46cd-95ca-731eed66bc7e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:37.273308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a7599119-2ad2-46cd-95ca-731eed66bc7e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041380 Sep 14 19:49:37.273885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 725/1425] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:37.495596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-077f0c35-057a-42ed-b419-45257a5c3f76 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:37.496437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-077f0c35-057a-42ed-b419-45257a5c3f76 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:37.502278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-077f0c35-057a-42ed-b419-45257a5c3f76 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:37.502721 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-077f0c35-057a-42ed-b419-45257a5c3f76 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:37.503476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-077f0c35-057a-42ed-b419-45257a5c3f76 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:37.503903 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-077f0c35-057a-42ed-b419-45257a5c3f76 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:37.532950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-077f0c35-057a-42ed-b419-45257a5c3f76 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041182 Sep 14 19:49:37.533519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 701/1426] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:37 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:37.741559 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4bb54ce4-148c-4de6-a9c1-b2e68cac04b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:37.742460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4bb54ce4-148c-4de6-a9c1-b2e68cac04b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:37.748434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4bb54ce4-148c-4de6-a9c1-b2e68cac04b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:37.748876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4bb54ce4-148c-4de6-a9c1-b2e68cac04b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:37.749678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4bb54ce4-148c-4de6-a9c1-b2e68cac04b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:37.750246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4bb54ce4-148c-4de6-a9c1-b2e68cac04b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:37.780930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4bb54ce4-148c-4de6-a9c1-b2e68cac04b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043609 Sep 14 19:49:37.781539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 726/1427] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:37 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:38.103510 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9b88104a-3ee9-4fa2-b1fe-33979d1a46d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:38.104061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9b88104a-3ee9-4fa2-b1fe-33979d1a46d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:38.109902 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b88104a-3ee9-4fa2-b1fe-33979d1a46d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:38.110352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b88104a-3ee9-4fa2-b1fe-33979d1a46d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:38.111124 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b88104a-3ee9-4fa2-b1fe-33979d1a46d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:38.111561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b88104a-3ee9-4fa2-b1fe-33979d1a46d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:38.232750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9b88104a-3ee9-4fa2-b1fe-33979d1a46d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:38.240789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9b88104a-3ee9-4fa2-b1fe-33979d1a46d8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143005 Sep 14 19:49:38.241352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 702/1428] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:38 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:38.285068 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-64a920c3-9532-4abb-b0ff-4e3de1bc5109 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:38.286533 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-64a920c3-9532-4abb-b0ff-4e3de1bc5109 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:38.292364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64a920c3-9532-4abb-b0ff-4e3de1bc5109 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:38.292804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64a920c3-9532-4abb-b0ff-4e3de1bc5109 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:38.293632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64a920c3-9532-4abb-b0ff-4e3de1bc5109 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:38.294060 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64a920c3-9532-4abb-b0ff-4e3de1bc5109 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:38.324605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-64a920c3-9532-4abb-b0ff-4e3de1bc5109 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043383 Sep 14 19:49:38.325148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 727/1429] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:38 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:38.544191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8e5ea25f-a660-4a79-878b-1bc09d76ede2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:38.545095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8e5ea25f-a660-4a79-878b-1bc09d76ede2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:38.551145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8e5ea25f-a660-4a79-878b-1bc09d76ede2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:38.551598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8e5ea25f-a660-4a79-878b-1bc09d76ede2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:38.552365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8e5ea25f-a660-4a79-878b-1bc09d76ede2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:38.552801 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8e5ea25f-a660-4a79-878b-1bc09d76ede2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:38.581008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8e5ea25f-a660-4a79-878b-1bc09d76ede2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040526 Sep 14 19:49:38.581591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 703/1430] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:38 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:38.792164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0181e8f5-c7ce-4632-b9cc-6a0b6289d8c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:38.793164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0181e8f5-c7ce-4632-b9cc-6a0b6289d8c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:38.799438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0181e8f5-c7ce-4632-b9cc-6a0b6289d8c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:38.799861 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0181e8f5-c7ce-4632-b9cc-6a0b6289d8c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:38.800627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0181e8f5-c7ce-4632-b9cc-6a0b6289d8c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:38.801059 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0181e8f5-c7ce-4632-b9cc-6a0b6289d8c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:38.830199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0181e8f5-c7ce-4632-b9cc-6a0b6289d8c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041721 Sep 14 19:49:38.830741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 728/1431] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:38 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:39.258617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5890605d-14a3-4f29-8bfd-f8edb40c3e85 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:39.259249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5890605d-14a3-4f29-8bfd-f8edb40c3e85 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:39.271340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5890605d-14a3-4f29-8bfd-f8edb40c3e85 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:39.271815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5890605d-14a3-4f29-8bfd-f8edb40c3e85 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:39.272571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5890605d-14a3-4f29-8bfd-f8edb40c3e85 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:39.273005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5890605d-14a3-4f29-8bfd-f8edb40c3e85 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:39.336091 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-75b239fa-993d-4c57-bbd8-862b5eef14f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:39.337298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-75b239fa-993d-4c57-bbd8-862b5eef14f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:39.343512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-75b239fa-993d-4c57-bbd8-862b5eef14f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:39.344069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-75b239fa-993d-4c57-bbd8-862b5eef14f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:39.344996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-75b239fa-993d-4c57-bbd8-862b5eef14f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:39.345439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-75b239fa-993d-4c57-bbd8-862b5eef14f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:39.375432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-75b239fa-993d-4c57-bbd8-862b5eef14f1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043068 Sep 14 19:49:39.376207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 729/1432] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:39 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:49:39.399780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5890605d-14a3-4f29-8bfd-f8edb40c3e85 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:39.407266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5890605d-14a3-4f29-8bfd-f8edb40c3e85 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.153060 Sep 14 19:49:39.407824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 704/1433] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:39 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:39.592236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-62fd5cc4-5046-4f78-8bac-9e3d5f005301 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:39.593056 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-62fd5cc4-5046-4f78-8bac-9e3d5f005301 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:39.599360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-62fd5cc4-5046-4f78-8bac-9e3d5f005301 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:39.599797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-62fd5cc4-5046-4f78-8bac-9e3d5f005301 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:39.600551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-62fd5cc4-5046-4f78-8bac-9e3d5f005301 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:39.600987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-62fd5cc4-5046-4f78-8bac-9e3d5f005301 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:39.629085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-62fd5cc4-5046-4f78-8bac-9e3d5f005301 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040758 Sep 14 19:49:39.629671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 730/1434] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:39 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:39.841697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6826e6ea-673b-4e12-a14b-4e436df1ffdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:39.842662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6826e6ea-673b-4e12-a14b-4e436df1ffdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:39.849048 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6826e6ea-673b-4e12-a14b-4e436df1ffdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:39.855106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6826e6ea-673b-4e12-a14b-4e436df1ffdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:39.855106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6826e6ea-673b-4e12-a14b-4e436df1ffdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:39.855106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6826e6ea-673b-4e12-a14b-4e436df1ffdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:39.880820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6826e6ea-673b-4e12-a14b-4e436df1ffdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042724 Sep 14 19:49:39.881551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 705/1435] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:39 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:40.388154 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-faf2b5ec-1e8a-43e7-abca-c3c1bf6cadc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:40.389093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-faf2b5ec-1e8a-43e7-abca-c3c1bf6cadc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:40.394923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-faf2b5ec-1e8a-43e7-abca-c3c1bf6cadc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:40.395944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-faf2b5ec-1e8a-43e7-abca-c3c1bf6cadc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:40.396711 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-faf2b5ec-1e8a-43e7-abca-c3c1bf6cadc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:40.397147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-faf2b5ec-1e8a-43e7-abca-c3c1bf6cadc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:40.424328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b71b57cf-8630-456d-b050-f3694516e4f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:40.424963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b71b57cf-8630-456d-b050-f3694516e4f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:40.425677 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-faf2b5ec-1e8a-43e7-abca-c3c1bf6cadc2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041248 Sep 14 19:49:40.426246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 731/1436] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:40.431222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b71b57cf-8630-456d-b050-f3694516e4f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:40.431664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b71b57cf-8630-456d-b050-f3694516e4f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:40.432437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b71b57cf-8630-456d-b050-f3694516e4f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:40.432862 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b71b57cf-8630-456d-b050-f3694516e4f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:40.550851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b71b57cf-8630-456d-b050-f3694516e4f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:40.558131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b71b57cf-8630-456d-b050-f3694516e4f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137774 Sep 14 19:49:40.558687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 706/1437] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:40 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:49:40.640239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-51f9448b-a1ea-401c-92dc-ca9cc9e13155 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:40.641076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-51f9448b-a1ea-401c-92dc-ca9cc9e13155 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:40.647124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51f9448b-a1ea-401c-92dc-ca9cc9e13155 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:40.647573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51f9448b-a1ea-401c-92dc-ca9cc9e13155 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:40.648337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51f9448b-a1ea-401c-92dc-ca9cc9e13155 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:40.648774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51f9448b-a1ea-401c-92dc-ca9cc9e13155 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:40.678408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-51f9448b-a1ea-401c-92dc-ca9cc9e13155 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 Sep 14 19:49:40.678982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 732/1438] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:40 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:40.891962 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-77fd55dc-0c16-42ab-b7ff-1c6df35b1ad3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:40.892752 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-77fd55dc-0c16-42ab-b7ff-1c6df35b1ad3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:40.899245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77fd55dc-0c16-42ab-b7ff-1c6df35b1ad3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:40.899693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77fd55dc-0c16-42ab-b7ff-1c6df35b1ad3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:40.900527 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77fd55dc-0c16-42ab-b7ff-1c6df35b1ad3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:40.900968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-77fd55dc-0c16-42ab-b7ff-1c6df35b1ad3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:40.931181 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-77fd55dc-0c16-42ab-b7ff-1c6df35b1ad3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042926 Sep 14 19:49:40.931799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 707/1439] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:40 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:41.437264 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9ba24d9c-1692-46d1-a818-30af0db29db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:41.438156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9ba24d9c-1692-46d1-a818-30af0db29db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:41.444034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ba24d9c-1692-46d1-a818-30af0db29db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:41.444514 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ba24d9c-1692-46d1-a818-30af0db29db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:41.445283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ba24d9c-1692-46d1-a818-30af0db29db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:41.445751 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ba24d9c-1692-46d1-a818-30af0db29db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:41.474969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9ba24d9c-1692-46d1-a818-30af0db29db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041608 Sep 14 19:49:41.475522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 733/1440] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:41 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:41.575130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e38fb1bf-8efb-4028-8a81-4caea27fd1e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:41.575783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e38fb1bf-8efb-4028-8a81-4caea27fd1e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:41.581753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e38fb1bf-8efb-4028-8a81-4caea27fd1e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:41.582204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e38fb1bf-8efb-4028-8a81-4caea27fd1e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:41.583531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e38fb1bf-8efb-4028-8a81-4caea27fd1e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:41.583982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e38fb1bf-8efb-4028-8a81-4caea27fd1e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:41.690451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ec88f563-3752-4fec-aa09-9f5535a10a29 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:41.691611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ec88f563-3752-4fec-aa09-9f5535a10a29 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:41.697994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec88f563-3752-4fec-aa09-9f5535a10a29 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:41.698449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec88f563-3752-4fec-aa09-9f5535a10a29 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:41.699228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec88f563-3752-4fec-aa09-9f5535a10a29 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:41.699698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ec88f563-3752-4fec-aa09-9f5535a10a29 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:41.705957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e38fb1bf-8efb-4028-8a81-4caea27fd1e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:41.714044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e38fb1bf-8efb-4028-8a81-4caea27fd1e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142491 Sep 14 19:49:41.714863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 708/1441] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:41 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:41.731436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ec88f563-3752-4fec-aa09-9f5535a10a29 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Sep 14 19:49:41.732002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 734/1442] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:41 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:41.943517 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0121b701-1806-41fb-b589-5f95d1bb4aa0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:41.944343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0121b701-1806-41fb-b589-5f95d1bb4aa0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:41.950304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0121b701-1806-41fb-b589-5f95d1bb4aa0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:41.950760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0121b701-1806-41fb-b589-5f95d1bb4aa0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:41.951539 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0121b701-1806-41fb-b589-5f95d1bb4aa0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:41.951973 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0121b701-1806-41fb-b589-5f95d1bb4aa0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:41.982235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0121b701-1806-41fb-b589-5f95d1bb4aa0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043215 Sep 14 19:49:41.982799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 709/1443] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:41 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:42.486757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-436652a4-d8cc-4ee9-bb4a-72c498bf1b73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:42.487736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-436652a4-d8cc-4ee9-bb4a-72c498bf1b73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:42.494294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-436652a4-d8cc-4ee9-bb4a-72c498bf1b73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:42.494738 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-436652a4-d8cc-4ee9-bb4a-72c498bf1b73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:42.495658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-436652a4-d8cc-4ee9-bb4a-72c498bf1b73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:42.496095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-436652a4-d8cc-4ee9-bb4a-72c498bf1b73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:42.525190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-436652a4-d8cc-4ee9-bb4a-72c498bf1b73 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042509 Sep 14 19:49:42.525776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 735/1444] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:42 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:42.732382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-196dd9e6-7f3a-4f33-872e-d13d7125ada0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:42.732986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-196dd9e6-7f3a-4f33-872e-d13d7125ada0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:42.739061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-196dd9e6-7f3a-4f33-872e-d13d7125ada0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:42.739441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-196dd9e6-7f3a-4f33-872e-d13d7125ada0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:42.740207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-196dd9e6-7f3a-4f33-872e-d13d7125ada0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:42.740641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-196dd9e6-7f3a-4f33-872e-d13d7125ada0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:42.749401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7341b46c-918e-4a64-b708-6ec7892cd961 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:42.750351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7341b46c-918e-4a64-b708-6ec7892cd961 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:42.756072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7341b46c-918e-4a64-b708-6ec7892cd961 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:42.756522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7341b46c-918e-4a64-b708-6ec7892cd961 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:42.758020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7341b46c-918e-4a64-b708-6ec7892cd961 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:42.758483 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7341b46c-918e-4a64-b708-6ec7892cd961 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:42.793673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7341b46c-918e-4a64-b708-6ec7892cd961 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054558 Sep 14 19:49:42.794678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 736/1445] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:42 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:42.865554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-196dd9e6-7f3a-4f33-872e-d13d7125ada0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:42.872883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-196dd9e6-7f3a-4f33-872e-d13d7125ada0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.144139 Sep 14 19:49:42.873669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 710/1446] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:42 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:42.995203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-83155416-3044-4741-8017-e742b2103ec7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:42.996171 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-83155416-3044-4741-8017-e742b2103ec7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:43.002402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83155416-3044-4741-8017-e742b2103ec7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:43.016587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83155416-3044-4741-8017-e742b2103ec7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:43.016587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83155416-3044-4741-8017-e742b2103ec7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:43.016587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83155416-3044-4741-8017-e742b2103ec7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:43.036571 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-83155416-3044-4741-8017-e742b2103ec7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045811 Sep 14 19:49:43.037202 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 737/1447] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:42 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:43.536911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f11c111c-f24c-4faf-88b0-1eb52be97f33 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:43.537761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f11c111c-f24c-4faf-88b0-1eb52be97f33 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:43.543658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f11c111c-f24c-4faf-88b0-1eb52be97f33 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:43.544108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f11c111c-f24c-4faf-88b0-1eb52be97f33 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:43.544876 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f11c111c-f24c-4faf-88b0-1eb52be97f33 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:43.545312 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f11c111c-f24c-4faf-88b0-1eb52be97f33 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:43.577409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f11c111c-f24c-4faf-88b0-1eb52be97f33 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044380 Sep 14 19:49:43.577991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 711/1448] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:43.805992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cb47323d-bcd5-4deb-94fe-7f4e4678008d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:43.806824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cb47323d-bcd5-4deb-94fe-7f4e4678008d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:43.812645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb47323d-bcd5-4deb-94fe-7f4e4678008d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:43.813086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb47323d-bcd5-4deb-94fe-7f4e4678008d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:43.813910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb47323d-bcd5-4deb-94fe-7f4e4678008d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:43.814342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb47323d-bcd5-4deb-94fe-7f4e4678008d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:43.843217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cb47323d-bcd5-4deb-94fe-7f4e4678008d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041651 Sep 14 19:49:43.843775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 738/1449] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:43 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:43.889555 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7e28ace5-b1ef-4b39-8e77-34b06c28a160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:43.890166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7e28ace5-b1ef-4b39-8e77-34b06c28a160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:43.895918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e28ace5-b1ef-4b39-8e77-34b06c28a160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:43.896361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e28ace5-b1ef-4b39-8e77-34b06c28a160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:43.897122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e28ace5-b1ef-4b39-8e77-34b06c28a160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:43.897576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e28ace5-b1ef-4b39-8e77-34b06c28a160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:44.014411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7e28ace5-b1ef-4b39-8e77-34b06c28a160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:44.021917 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7e28ace5-b1ef-4b39-8e77-34b06c28a160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.135996 Sep 14 19:49:44.022479 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 712/1450] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:43 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:44.052737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b49851ba-e662-4368-ae82-fb0d6929737e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:44.053670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b49851ba-e662-4368-ae82-fb0d6929737e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:44.059463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b49851ba-e662-4368-ae82-fb0d6929737e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:44.059996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b49851ba-e662-4368-ae82-fb0d6929737e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:44.060582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b49851ba-e662-4368-ae82-fb0d6929737e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:44.061018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b49851ba-e662-4368-ae82-fb0d6929737e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:44.091294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b49851ba-e662-4368-ae82-fb0d6929737e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043052 Sep 14 19:49:44.091826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 739/1451] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:44 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:44.589783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eea59fdf-77fa-4481-b087-21bcee2c56c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:44.590636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eea59fdf-77fa-4481-b087-21bcee2c56c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:44.596565 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eea59fdf-77fa-4481-b087-21bcee2c56c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:44.597012 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eea59fdf-77fa-4481-b087-21bcee2c56c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:44.597807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eea59fdf-77fa-4481-b087-21bcee2c56c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:44.598910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eea59fdf-77fa-4481-b087-21bcee2c56c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:44.627133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eea59fdf-77fa-4481-b087-21bcee2c56c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041408 Sep 14 19:49:44.627678 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 713/1452] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:44.854462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a64fc001-c0c3-4195-8982-26dafde05f06 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:44.855337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a64fc001-c0c3-4195-8982-26dafde05f06 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:44.862475 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a64fc001-c0c3-4195-8982-26dafde05f06 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:44.862930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a64fc001-c0c3-4195-8982-26dafde05f06 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:44.863737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a64fc001-c0c3-4195-8982-26dafde05f06 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:44.864175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a64fc001-c0c3-4195-8982-26dafde05f06 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:44.893085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a64fc001-c0c3-4195-8982-26dafde05f06 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042356 Sep 14 19:49:44.893661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 740/1453] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:44 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:45.038617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2e7eb121-1ea8-41b6-93c3-64739601835d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:45.039225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2e7eb121-1ea8-41b6-93c3-64739601835d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:45.046514 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e7eb121-1ea8-41b6-93c3-64739601835d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:45.047331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e7eb121-1ea8-41b6-93c3-64739601835d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:45.048945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e7eb121-1ea8-41b6-93c3-64739601835d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:45.049728 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e7eb121-1ea8-41b6-93c3-64739601835d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:45.102370 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f51d4af2-b475-4227-bd78-f2c4ec24390c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:45.103293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f51d4af2-b475-4227-bd78-f2c4ec24390c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:45.109400 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f51d4af2-b475-4227-bd78-f2c4ec24390c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:45.109817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f51d4af2-b475-4227-bd78-f2c4ec24390c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:45.110858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f51d4af2-b475-4227-bd78-f2c4ec24390c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:45.111065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f51d4af2-b475-4227-bd78-f2c4ec24390c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:45.142920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f51d4af2-b475-4227-bd78-f2c4ec24390c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044295 Sep 14 19:49:45.143687 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 741/1454] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:45 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:45.190056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2e7eb121-1ea8-41b6-93c3-64739601835d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:45.198042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2e7eb121-1ea8-41b6-93c3-64739601835d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.163111 Sep 14 19:49:45.198636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 714/1455] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:45 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:45.638886 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5c93c07e-6e8b-43ae-9fe9-ae1adc34a124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:45.639719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5c93c07e-6e8b-43ae-9fe9-ae1adc34a124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:45.645632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5c93c07e-6e8b-43ae-9fe9-ae1adc34a124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:45.646082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5c93c07e-6e8b-43ae-9fe9-ae1adc34a124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:45.646853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5c93c07e-6e8b-43ae-9fe9-ae1adc34a124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:45.647292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5c93c07e-6e8b-43ae-9fe9-ae1adc34a124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:45.676937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5c93c07e-6e8b-43ae-9fe9-ae1adc34a124 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041254 Sep 14 19:49:45.677509 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 742/1456] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:45.905164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3d9064f9-e666-4789-9d0d-385ce14f7325 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:45.906023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3d9064f9-e666-4789-9d0d-385ce14f7325 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:45.912323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d9064f9-e666-4789-9d0d-385ce14f7325 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:45.912772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d9064f9-e666-4789-9d0d-385ce14f7325 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:45.913566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d9064f9-e666-4789-9d0d-385ce14f7325 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:45.914005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d9064f9-e666-4789-9d0d-385ce14f7325 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:45.942961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3d9064f9-e666-4789-9d0d-385ce14f7325 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041633 Sep 14 19:49:45.943531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 715/1457] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:45 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:46.153944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d54ef67b-2fdc-4ccd-9c1b-2b3c8877a956 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:46.154852 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d54ef67b-2fdc-4ccd-9c1b-2b3c8877a956 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:46.161513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d54ef67b-2fdc-4ccd-9c1b-2b3c8877a956 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:46.161898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d54ef67b-2fdc-4ccd-9c1b-2b3c8877a956 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:46.162698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d54ef67b-2fdc-4ccd-9c1b-2b3c8877a956 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:46.163111 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d54ef67b-2fdc-4ccd-9c1b-2b3c8877a956 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:46.191801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d54ef67b-2fdc-4ccd-9c1b-2b3c8877a956 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041527 Sep 14 19:49:46.192359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 743/1458] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:46 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:46.214734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c36a67f3-22f2-4bce-88bb-56c821c9b36d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:46.215417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c36a67f3-22f2-4bce-88bb-56c821c9b36d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:46.221298 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c36a67f3-22f2-4bce-88bb-56c821c9b36d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:46.221809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c36a67f3-22f2-4bce-88bb-56c821c9b36d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:46.222577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c36a67f3-22f2-4bce-88bb-56c821c9b36d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:46.223665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c36a67f3-22f2-4bce-88bb-56c821c9b36d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:46.343015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c36a67f3-22f2-4bce-88bb-56c821c9b36d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:46.350347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c36a67f3-22f2-4bce-88bb-56c821c9b36d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139393 Sep 14 19:49:46.350912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 716/1459] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:46 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:46.688561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-df7ca625-5c52-450c-8203-147f9e1017c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:46.689416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-df7ca625-5c52-450c-8203-147f9e1017c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:46.695967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-df7ca625-5c52-450c-8203-147f9e1017c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:46.696417 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-df7ca625-5c52-450c-8203-147f9e1017c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:46.697223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-df7ca625-5c52-450c-8203-147f9e1017c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:46.697698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-df7ca625-5c52-450c-8203-147f9e1017c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:46.726277 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-df7ca625-5c52-450c-8203-147f9e1017c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041559 Sep 14 19:49:46.726830 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 744/1460] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:46.961103 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1bbb1634-e466-4c3f-8781-df3b238247a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:46.961959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1bbb1634-e466-4c3f-8781-df3b238247a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:46.967868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1bbb1634-e466-4c3f-8781-df3b238247a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:46.968323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1bbb1634-e466-4c3f-8781-df3b238247a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:46.969098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1bbb1634-e466-4c3f-8781-df3b238247a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:46.969559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1bbb1634-e466-4c3f-8781-df3b238247a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:46.998783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1bbb1634-e466-4c3f-8781-df3b238247a7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042049 Sep 14 19:49:46.999346 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 717/1461] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:46 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:47.203021 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-274229e8-a52d-45ae-8312-3180b4a40689 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:47.203930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-274229e8-a52d-45ae-8312-3180b4a40689 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:47.210771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-274229e8-a52d-45ae-8312-3180b4a40689 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:47.211265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-274229e8-a52d-45ae-8312-3180b4a40689 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:47.211988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-274229e8-a52d-45ae-8312-3180b4a40689 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:47.212418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-274229e8-a52d-45ae-8312-3180b4a40689 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:47.240954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-274229e8-a52d-45ae-8312-3180b4a40689 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041707 Sep 14 19:49:47.241524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 745/1462] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:47 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:47.366988 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5cf15f88-b790-427e-8efe-6b0776341b22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:47.367696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5cf15f88-b790-427e-8efe-6b0776341b22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:47.373787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cf15f88-b790-427e-8efe-6b0776341b22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:47.374306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cf15f88-b790-427e-8efe-6b0776341b22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:47.375153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cf15f88-b790-427e-8efe-6b0776341b22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:47.375657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cf15f88-b790-427e-8efe-6b0776341b22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:47.494236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5cf15f88-b790-427e-8efe-6b0776341b22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:47.501705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5cf15f88-b790-427e-8efe-6b0776341b22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.138864 Sep 14 19:49:47.502460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 718/1463] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:47 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:47.737869 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0b8c55d8-25c8-4d43-8e51-4424eafdaca6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:47.739313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0b8c55d8-25c8-4d43-8e51-4424eafdaca6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:47.745072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b8c55d8-25c8-4d43-8e51-4424eafdaca6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:47.745590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b8c55d8-25c8-4d43-8e51-4424eafdaca6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:47.746298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b8c55d8-25c8-4d43-8e51-4424eafdaca6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:47.746727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b8c55d8-25c8-4d43-8e51-4424eafdaca6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:47.774474 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0b8c55d8-25c8-4d43-8e51-4424eafdaca6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040626 Sep 14 19:49:47.775024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 746/1464] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:47 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:48.010679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-631a7e8d-c1d2-4e61-a3bc-5d996f5d2ad7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:48.011575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-631a7e8d-c1d2-4e61-a3bc-5d996f5d2ad7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:48.017466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-631a7e8d-c1d2-4e61-a3bc-5d996f5d2ad7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:48.031115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-631a7e8d-c1d2-4e61-a3bc-5d996f5d2ad7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:48.031115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-631a7e8d-c1d2-4e61-a3bc-5d996f5d2ad7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:48.031115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-631a7e8d-c1d2-4e61-a3bc-5d996f5d2ad7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:48.049056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-631a7e8d-c1d2-4e61-a3bc-5d996f5d2ad7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 Sep 14 19:49:48.049632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 719/1465] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:48 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:48.252452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d80bf3e3-e7b0-4552-93c4-aa4b16ab0a8e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:48.253360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d80bf3e3-e7b0-4552-93c4-aa4b16ab0a8e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:48.259402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d80bf3e3-e7b0-4552-93c4-aa4b16ab0a8e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:48.259854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d80bf3e3-e7b0-4552-93c4-aa4b16ab0a8e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:48.260639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d80bf3e3-e7b0-4552-93c4-aa4b16ab0a8e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:48.261134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d80bf3e3-e7b0-4552-93c4-aa4b16ab0a8e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:48.291667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d80bf3e3-e7b0-4552-93c4-aa4b16ab0a8e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042946 Sep 14 19:49:48.292248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 747/1466] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:48 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:48.519372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b4f50158-6700-4ff4-95c2-d46e385ab005 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:48.520644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b4f50158-6700-4ff4-95c2-d46e385ab005 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:48.526360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4f50158-6700-4ff4-95c2-d46e385ab005 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:48.526796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4f50158-6700-4ff4-95c2-d46e385ab005 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:48.527552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4f50158-6700-4ff4-95c2-d46e385ab005 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:48.527978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4f50158-6700-4ff4-95c2-d46e385ab005 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:48.652061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b4f50158-6700-4ff4-95c2-d46e385ab005 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:48.659346 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b4f50158-6700-4ff4-95c2-d46e385ab005 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143638 Sep 14 19:49:48.659903 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 720/1467] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:48 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:48.786184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6d7c2f49-f14c-4580-95d1-97aa2d890e21 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:48.787023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6d7c2f49-f14c-4580-95d1-97aa2d890e21 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:48.792819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d7c2f49-f14c-4580-95d1-97aa2d890e21 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:48.793297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d7c2f49-f14c-4580-95d1-97aa2d890e21 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:48.795409 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d7c2f49-f14c-4580-95d1-97aa2d890e21 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:48.795409 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d7c2f49-f14c-4580-95d1-97aa2d890e21 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:48.825156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6d7c2f49-f14c-4580-95d1-97aa2d890e21 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042870 Sep 14 19:49:48.825793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 748/1468] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:48 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:49.060277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ddb890cc-e2c6-4529-b186-2cee48f28723 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:49.061102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ddb890cc-e2c6-4529-b186-2cee48f28723 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:49.067732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ddb890cc-e2c6-4529-b186-2cee48f28723 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:49.068181 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ddb890cc-e2c6-4529-b186-2cee48f28723 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:49.068948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ddb890cc-e2c6-4529-b186-2cee48f28723 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:49.069385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ddb890cc-e2c6-4529-b186-2cee48f28723 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:49.098517 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ddb890cc-e2c6-4529-b186-2cee48f28723 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042003 Sep 14 19:49:49.099072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 721/1469] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:49 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:49.303840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9bb338a8-28dc-4b8d-a34c-f3ed65de2172 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:49.304742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9bb338a8-28dc-4b8d-a34c-f3ed65de2172 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:49.311136 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9bb338a8-28dc-4b8d-a34c-f3ed65de2172 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:49.311407 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9bb338a8-28dc-4b8d-a34c-f3ed65de2172 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:49.312086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9bb338a8-28dc-4b8d-a34c-f3ed65de2172 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:49.312524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9bb338a8-28dc-4b8d-a34c-f3ed65de2172 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:49.341432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9bb338a8-28dc-4b8d-a34c-f3ed65de2172 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 Sep 14 19:49:49.342022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 749/1470] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:49 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:49.676579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5272aba8-5f4e-4da5-957b-b8930fa98fd5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:49.677192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5272aba8-5f4e-4da5-957b-b8930fa98fd5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:49.682964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5272aba8-5f4e-4da5-957b-b8930fa98fd5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:49.683406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5272aba8-5f4e-4da5-957b-b8930fa98fd5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:49.684167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5272aba8-5f4e-4da5-957b-b8930fa98fd5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:49.684596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5272aba8-5f4e-4da5-957b-b8930fa98fd5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:49.803029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5272aba8-5f4e-4da5-957b-b8930fa98fd5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:49.810436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5272aba8-5f4e-4da5-957b-b8930fa98fd5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137768 Sep 14 19:49:49.811009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 722/1471] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:49 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:49.836660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6871e575-f998-4081-ab03-dbe59df243f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:49.837506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6871e575-f998-4081-ab03-dbe59df243f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:49.843427 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6871e575-f998-4081-ab03-dbe59df243f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:49.843871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6871e575-f998-4081-ab03-dbe59df243f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:49.844636 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6871e575-f998-4081-ab03-dbe59df243f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:49.845071 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6871e575-f998-4081-ab03-dbe59df243f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:49.873571 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6871e575-f998-4081-ab03-dbe59df243f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041292 Sep 14 19:49:49.874123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 750/1472] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:49 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:50.110311 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3060e0ba-4008-45d2-9ff7-3d55a0c912bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:50.111234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3060e0ba-4008-45d2-9ff7-3d55a0c912bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:50.117117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3060e0ba-4008-45d2-9ff7-3d55a0c912bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:50.117606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3060e0ba-4008-45d2-9ff7-3d55a0c912bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:50.118374 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3060e0ba-4008-45d2-9ff7-3d55a0c912bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:50.118815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3060e0ba-4008-45d2-9ff7-3d55a0c912bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:50.148273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3060e0ba-4008-45d2-9ff7-3d55a0c912bb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041917 Sep 14 19:49:50.148819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 723/1473] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:50 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:50.352323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9b762aab-c86c-4fc2-a848-c5f7a92a9905 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:50.353264 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9b762aab-c86c-4fc2-a848-c5f7a92a9905 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:50.359145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b762aab-c86c-4fc2-a848-c5f7a92a9905 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:50.359599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b762aab-c86c-4fc2-a848-c5f7a92a9905 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:50.360429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b762aab-c86c-4fc2-a848-c5f7a92a9905 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:50.360809 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b762aab-c86c-4fc2-a848-c5f7a92a9905 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:50.390984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9b762aab-c86c-4fc2-a848-c5f7a92a9905 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042470 Sep 14 19:49:50.391553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 751/1474] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:50 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:50.827219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0980736a-0518-40d3-ab77-d19683b7cefc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:50.827820 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0980736a-0518-40d3-ab77-d19683b7cefc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:50.833883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0980736a-0518-40d3-ab77-d19683b7cefc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:50.834329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0980736a-0518-40d3-ab77-d19683b7cefc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:50.835104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0980736a-0518-40d3-ab77-d19683b7cefc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:50.835572 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0980736a-0518-40d3-ab77-d19683b7cefc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:50.884193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dc136865-6730-4096-80b9-2a776f935a09 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:50.884995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dc136865-6730-4096-80b9-2a776f935a09 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:50.890777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dc136865-6730-4096-80b9-2a776f935a09 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:50.891224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dc136865-6730-4096-80b9-2a776f935a09 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:50.891990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dc136865-6730-4096-80b9-2a776f935a09 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:50.892421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dc136865-6730-4096-80b9-2a776f935a09 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:50.924127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dc136865-6730-4096-80b9-2a776f935a09 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043714 Sep 14 19:49:50.928586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 752/1475] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:50 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:49:50.955884 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0980736a-0518-40d3-ab77-d19683b7cefc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:50.963589 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0980736a-0518-40d3-ab77-d19683b7cefc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140059 Sep 14 19:49:50.964151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 724/1476] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:50 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:51.159981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e2e1e344-634f-4c0a-b03e-dfde2642322d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:51.160813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e2e1e344-634f-4c0a-b03e-dfde2642322d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:51.166737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e2e1e344-634f-4c0a-b03e-dfde2642322d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:51.167187 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e2e1e344-634f-4c0a-b03e-dfde2642322d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:51.167960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e2e1e344-634f-4c0a-b03e-dfde2642322d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:51.168399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e2e1e344-634f-4c0a-b03e-dfde2642322d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:51.197934 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e2e1e344-634f-4c0a-b03e-dfde2642322d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041814 Sep 14 19:49:51.198488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 753/1477] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:51 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:51.402414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9f290bdc-2474-4b67-9d92-fc1d4cbeab9b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:51.403349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9f290bdc-2474-4b67-9d92-fc1d4cbeab9b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:51.409626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f290bdc-2474-4b67-9d92-fc1d4cbeab9b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:51.410409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f290bdc-2474-4b67-9d92-fc1d4cbeab9b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:51.410978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f290bdc-2474-4b67-9d92-fc1d4cbeab9b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:51.411542 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9f290bdc-2474-4b67-9d92-fc1d4cbeab9b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:51.441083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9f290bdc-2474-4b67-9d92-fc1d4cbeab9b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042378 Sep 14 19:49:51.441686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 725/1478] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:51 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:51.935594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2830a4d6-f1cd-40ac-be5b-f34969f128f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:51.936460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2830a4d6-f1cd-40ac-be5b-f34969f128f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:51.943188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2830a4d6-f1cd-40ac-be5b-f34969f128f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:51.943638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2830a4d6-f1cd-40ac-be5b-f34969f128f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:51.944676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2830a4d6-f1cd-40ac-be5b-f34969f128f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:51.944849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2830a4d6-f1cd-40ac-be5b-f34969f128f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:51.973861 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2830a4d6-f1cd-40ac-be5b-f34969f128f3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042104 Sep 14 19:49:51.974420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 754/1479] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:51 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:51.980027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-df3a0c16-70e7-40e1-b638-87f392753f81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:51.980626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-df3a0c16-70e7-40e1-b638-87f392753f81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:51.986697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df3a0c16-70e7-40e1-b638-87f392753f81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:51.987240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df3a0c16-70e7-40e1-b638-87f392753f81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:51.987991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df3a0c16-70e7-40e1-b638-87f392753f81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:51.988417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df3a0c16-70e7-40e1-b638-87f392753f81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:52.110862 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-df3a0c16-70e7-40e1-b638-87f392753f81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:52.118595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-df3a0c16-70e7-40e1-b638-87f392753f81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142275 Sep 14 19:49:52.119170 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 726/1480] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:51 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:49:52.208884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-87941058-4119-4f16-b651-1156bf1f257e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:52.209823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-87941058-4119-4f16-b651-1156bf1f257e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:52.215690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87941058-4119-4f16-b651-1156bf1f257e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:52.216134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87941058-4119-4f16-b651-1156bf1f257e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:52.216909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87941058-4119-4f16-b651-1156bf1f257e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:52.217375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87941058-4119-4f16-b651-1156bf1f257e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:52.246507 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-87941058-4119-4f16-b651-1156bf1f257e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041392 Sep 14 19:49:52.247059 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 755/1481] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:52 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:52.453373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-954fd1c1-4ffc-43ec-9b95-5ddab97f6109 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:52.454235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-954fd1c1-4ffc-43ec-9b95-5ddab97f6109 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:52.460146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-954fd1c1-4ffc-43ec-9b95-5ddab97f6109 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:52.460593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-954fd1c1-4ffc-43ec-9b95-5ddab97f6109 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:52.461360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-954fd1c1-4ffc-43ec-9b95-5ddab97f6109 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:52.461907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-954fd1c1-4ffc-43ec-9b95-5ddab97f6109 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:52.491844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-954fd1c1-4ffc-43ec-9b95-5ddab97f6109 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042263 Sep 14 19:49:52.492403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 727/1482] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:52 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:52.986285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dde0199b-1a77-40b9-bf7b-13e01873cbbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:52.987327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dde0199b-1a77-40b9-bf7b-13e01873cbbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:52.993368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dde0199b-1a77-40b9-bf7b-13e01873cbbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:52.993851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dde0199b-1a77-40b9-bf7b-13e01873cbbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:52.994628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dde0199b-1a77-40b9-bf7b-13e01873cbbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:52.995066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dde0199b-1a77-40b9-bf7b-13e01873cbbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:53.024810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dde0199b-1a77-40b9-bf7b-13e01873cbbf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043114 Sep 14 19:49:53.025363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 756/1483] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:53.144369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8ef661d4-96c4-4b64-aec9-c9d4b38468d5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:53.144977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8ef661d4-96c4-4b64-aec9-c9d4b38468d5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:53.152596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ef661d4-96c4-4b64-aec9-c9d4b38468d5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:53.153042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ef661d4-96c4-4b64-aec9-c9d4b38468d5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:53.153840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ef661d4-96c4-4b64-aec9-c9d4b38468d5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:53.154273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8ef661d4-96c4-4b64-aec9-c9d4b38468d5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:53.258305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b9ef3b1b-bafc-4813-bce6-b0acded665e2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:53.259299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b9ef3b1b-bafc-4813-bce6-b0acded665e2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:53.265240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9ef3b1b-bafc-4813-bce6-b0acded665e2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:53.265728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9ef3b1b-bafc-4813-bce6-b0acded665e2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:53.266515 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9ef3b1b-bafc-4813-bce6-b0acded665e2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:53.267014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9ef3b1b-bafc-4813-bce6-b0acded665e2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:53.274920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8ef661d4-96c4-4b64-aec9-c9d4b38468d5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:53.282223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8ef661d4-96c4-4b64-aec9-c9d4b38468d5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.150133 Sep 14 19:49:53.283011 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 728/1484] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:53 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:53.298583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b9ef3b1b-bafc-4813-bce6-b0acded665e2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Sep 14 19:49:53.299145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 757/1485] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:53 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:53.503473 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cd5039e5-131f-4bbf-ba3c-251daea398cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:53.504328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cd5039e5-131f-4bbf-ba3c-251daea398cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:53.510929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd5039e5-131f-4bbf-ba3c-251daea398cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:53.511363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd5039e5-131f-4bbf-ba3c-251daea398cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:53.512370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd5039e5-131f-4bbf-ba3c-251daea398cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:53.513014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd5039e5-131f-4bbf-ba3c-251daea398cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:53.544696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cd5039e5-131f-4bbf-ba3c-251daea398cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Sep 14 19:49:53.545270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 729/1486] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:53 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:54.037165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b81b7307-23f8-4ce0-a7da-e407ab58678a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:54.038069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b81b7307-23f8-4ce0-a7da-e407ab58678a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:54.043801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b81b7307-23f8-4ce0-a7da-e407ab58678a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:54.044247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b81b7307-23f8-4ce0-a7da-e407ab58678a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:54.045018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b81b7307-23f8-4ce0-a7da-e407ab58678a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:54.045449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b81b7307-23f8-4ce0-a7da-e407ab58678a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:54.074328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b81b7307-23f8-4ce0-a7da-e407ab58678a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041628 Sep 14 19:49:54.074883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 758/1487] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:54.299641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9b779dec-b544-46f2-9738-b50b5cb039bb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:54.300167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9b779dec-b544-46f2-9738-b50b5cb039bb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:54.306505 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b779dec-b544-46f2-9738-b50b5cb039bb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:54.306959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b779dec-b544-46f2-9738-b50b5cb039bb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:54.307742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b779dec-b544-46f2-9738-b50b5cb039bb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:54.308183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b779dec-b544-46f2-9738-b50b5cb039bb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:54.310827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-151d76b7-0825-4071-b7ba-0fa64c17eaa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:54.311822 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-151d76b7-0825-4071-b7ba-0fa64c17eaa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:54.317583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-151d76b7-0825-4071-b7ba-0fa64c17eaa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:54.326220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-151d76b7-0825-4071-b7ba-0fa64c17eaa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:54.326220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-151d76b7-0825-4071-b7ba-0fa64c17eaa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:54.326220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-151d76b7-0825-4071-b7ba-0fa64c17eaa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:54.349356 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-151d76b7-0825-4071-b7ba-0fa64c17eaa9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041918 Sep 14 19:49:54.349993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 759/1488] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:54 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:54.428152 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9b779dec-b544-46f2-9738-b50b5cb039bb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:54.435451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9b779dec-b544-46f2-9738-b50b5cb039bb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139857 Sep 14 19:49:54.436022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 730/1489] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:54 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:54.556547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-21fbf1c9-7ec9-4f8f-a0fa-30ba08f1e77d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:54.557418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-21fbf1c9-7ec9-4f8f-a0fa-30ba08f1e77d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:54.563344 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21fbf1c9-7ec9-4f8f-a0fa-30ba08f1e77d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:54.565317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21fbf1c9-7ec9-4f8f-a0fa-30ba08f1e77d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:54.565317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21fbf1c9-7ec9-4f8f-a0fa-30ba08f1e77d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:54.565317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21fbf1c9-7ec9-4f8f-a0fa-30ba08f1e77d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:54.596755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-21fbf1c9-7ec9-4f8f-a0fa-30ba08f1e77d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044048 Sep 14 19:49:54.597304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 760/1490] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:54 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:55.087002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8a158ddb-3df0-4419-8cf7-60cafb8e65f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:55.087554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8a158ddb-3df0-4419-8cf7-60cafb8e65f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:55.093304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a158ddb-3df0-4419-8cf7-60cafb8e65f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:55.093784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a158ddb-3df0-4419-8cf7-60cafb8e65f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:55.094542 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a158ddb-3df0-4419-8cf7-60cafb8e65f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:55.094971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a158ddb-3df0-4419-8cf7-60cafb8e65f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:55.123225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8a158ddb-3df0-4419-8cf7-60cafb8e65f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040667 Sep 14 19:49:55.123769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 731/1491] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:55 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:55.360798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8b29a4d3-3a09-4130-bccb-dea70453800f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:55.361643 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8b29a4d3-3a09-4130-bccb-dea70453800f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:55.368013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b29a4d3-3a09-4130-bccb-dea70453800f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:55.368462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b29a4d3-3a09-4130-bccb-dea70453800f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:55.369227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b29a4d3-3a09-4130-bccb-dea70453800f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:55.369693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b29a4d3-3a09-4130-bccb-dea70453800f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:55.398057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8b29a4d3-3a09-4130-bccb-dea70453800f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041042 Sep 14 19:49:55.398625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 761/1492] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:55 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:55.452623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2afee33c-c086-42fc-8e22-9a922c318049 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:55.453252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2afee33c-c086-42fc-8e22-9a922c318049 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:55.459089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2afee33c-c086-42fc-8e22-9a922c318049 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:55.459528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2afee33c-c086-42fc-8e22-9a922c318049 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:55.460281 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2afee33c-c086-42fc-8e22-9a922c318049 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:55.460707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2afee33c-c086-42fc-8e22-9a922c318049 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:55.584879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2afee33c-c086-42fc-8e22-9a922c318049 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:55.592125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2afee33c-c086-42fc-8e22-9a922c318049 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143160 Sep 14 19:49:55.592890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 732/1493] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:55 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:55.608275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5e82b530-4362-4b3b-a63c-d470d97d7e3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:55.609189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5e82b530-4362-4b3b-a63c-d470d97d7e3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:55.614985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e82b530-4362-4b3b-a63c-d470d97d7e3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:55.615448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e82b530-4362-4b3b-a63c-d470d97d7e3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:55.616198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e82b530-4362-4b3b-a63c-d470d97d7e3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:55.616636 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e82b530-4362-4b3b-a63c-d470d97d7e3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:55.647100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5e82b530-4362-4b3b-a63c-d470d97d7e3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042172 Sep 14 19:49:55.647673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 762/1494] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:55 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:56.134405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ca84ad1e-c122-4dc1-9529-81c703849a35 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:56.135216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ca84ad1e-c122-4dc1-9529-81c703849a35 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:56.141141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca84ad1e-c122-4dc1-9529-81c703849a35 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:56.141619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca84ad1e-c122-4dc1-9529-81c703849a35 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:56.142384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca84ad1e-c122-4dc1-9529-81c703849a35 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:56.142814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca84ad1e-c122-4dc1-9529-81c703849a35 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:56.172051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ca84ad1e-c122-4dc1-9529-81c703849a35 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041495 Sep 14 19:49:56.172596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 733/1495] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:56 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:56.409430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-79f93a8f-4379-4142-8dbb-b947e2403d89 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:56.410294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-79f93a8f-4379-4142-8dbb-b947e2403d89 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:56.416318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79f93a8f-4379-4142-8dbb-b947e2403d89 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:56.416771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79f93a8f-4379-4142-8dbb-b947e2403d89 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:56.417647 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79f93a8f-4379-4142-8dbb-b947e2403d89 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:56.418101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79f93a8f-4379-4142-8dbb-b947e2403d89 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:56.448705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-79f93a8f-4379-4142-8dbb-b947e2403d89 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 Sep 14 19:49:56.449278 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 763/1496] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:56 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:56.609386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2cb3f901-6e08-4094-90c3-6662561fc1e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:56.610048 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2cb3f901-6e08-4094-90c3-6662561fc1e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:56.616471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2cb3f901-6e08-4094-90c3-6662561fc1e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:56.616932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2cb3f901-6e08-4094-90c3-6662561fc1e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:56.617730 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2cb3f901-6e08-4094-90c3-6662561fc1e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:56.618167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2cb3f901-6e08-4094-90c3-6662561fc1e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:56.658464 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2580d373-efcd-4b5a-8e0f-9eda70be0b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:56.659594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2580d373-efcd-4b5a-8e0f-9eda70be0b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:56.666084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2580d373-efcd-4b5a-8e0f-9eda70be0b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:56.666084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2580d373-efcd-4b5a-8e0f-9eda70be0b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:56.666730 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2580d373-efcd-4b5a-8e0f-9eda70be0b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:56.667164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2580d373-efcd-4b5a-8e0f-9eda70be0b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:56.706966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2580d373-efcd-4b5a-8e0f-9eda70be0b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052265 Sep 14 19:49:56.707564 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 764/1497] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:56 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:49:56.745975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2cb3f901-6e08-4094-90c3-6662561fc1e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:56.754616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2cb3f901-6e08-4094-90c3-6662561fc1e3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.148841 Sep 14 19:49:56.755192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 734/1498] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:56 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:57.183891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-92bb9892-c316-4599-a62f-124ab4c9737f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:57.184720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-92bb9892-c316-4599-a62f-124ab4c9737f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:57.190594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-92bb9892-c316-4599-a62f-124ab4c9737f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:57.191046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-92bb9892-c316-4599-a62f-124ab4c9737f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:57.191849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-92bb9892-c316-4599-a62f-124ab4c9737f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:57.192317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-92bb9892-c316-4599-a62f-124ab4c9737f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:57.220813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-92bb9892-c316-4599-a62f-124ab4c9737f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040855 Sep 14 19:49:57.221372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 765/1499] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:57 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:57.460959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bd44b6b5-3010-4765-b75a-5db38c61de2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:57.461817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bd44b6b5-3010-4765-b75a-5db38c61de2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:57.467898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd44b6b5-3010-4765-b75a-5db38c61de2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:57.468348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd44b6b5-3010-4765-b75a-5db38c61de2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:57.469123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd44b6b5-3010-4765-b75a-5db38c61de2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:57.469586 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd44b6b5-3010-4765-b75a-5db38c61de2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:57.498927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bd44b6b5-3010-4765-b75a-5db38c61de2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042389 Sep 14 19:49:57.499484 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 735/1500] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:57 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:57.718177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-35ec77dd-f376-4533-8a04-ea43bcb3dcdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:57.719024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-35ec77dd-f376-4533-8a04-ea43bcb3dcdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:57.724850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-35ec77dd-f376-4533-8a04-ea43bcb3dcdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:57.725299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-35ec77dd-f376-4533-8a04-ea43bcb3dcdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:57.726107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-35ec77dd-f376-4533-8a04-ea43bcb3dcdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:57.726548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-35ec77dd-f376-4533-8a04-ea43bcb3dcdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:57.755542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-35ec77dd-f376-4533-8a04-ea43bcb3dcdd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041124 Sep 14 19:49:57.756109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 766/1501] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:57 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:57.771917 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9cb3126b-ae5c-423a-919b-4a2672a48efc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:57.772615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9cb3126b-ae5c-423a-919b-4a2672a48efc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:57.778262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cb3126b-ae5c-423a-919b-4a2672a48efc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:57.778697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cb3126b-ae5c-423a-919b-4a2672a48efc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:57.779451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cb3126b-ae5c-423a-919b-4a2672a48efc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:57.779874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9cb3126b-ae5c-423a-919b-4a2672a48efc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:57.896784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9cb3126b-ae5c-423a-919b-4a2672a48efc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:57.904060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9cb3126b-ae5c-423a-919b-4a2672a48efc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.136366 Sep 14 19:49:57.904609 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 736/1502] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:57 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:58.233116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-043ba1db-a333-425a-92e6-8914a944beb9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:58.233976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-043ba1db-a333-425a-92e6-8914a944beb9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:58.240392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-043ba1db-a333-425a-92e6-8914a944beb9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:58.240839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-043ba1db-a333-425a-92e6-8914a944beb9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:58.241702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-043ba1db-a333-425a-92e6-8914a944beb9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:58.242141 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-043ba1db-a333-425a-92e6-8914a944beb9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:58.270977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-043ba1db-a333-425a-92e6-8914a944beb9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041730 Sep 14 19:49:58.271513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 767/1503] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:58 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:49:58.510771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9380b052-7c3b-4c25-a21a-168625a28c6e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:58.511618 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9380b052-7c3b-4c25-a21a-168625a28c6e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:58.517822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9380b052-7c3b-4c25-a21a-168625a28c6e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:58.518271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9380b052-7c3b-4c25-a21a-168625a28c6e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:58.519040 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9380b052-7c3b-4c25-a21a-168625a28c6e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:58.519472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9380b052-7c3b-4c25-a21a-168625a28c6e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:58.548339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9380b052-7c3b-4c25-a21a-168625a28c6e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041199 Sep 14 19:49:58.548878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 737/1504] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:58 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:58.766494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1f18663c-72e5-48c8-9684-590b95d5d325 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:58.767327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1f18663c-72e5-48c8-9684-590b95d5d325 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:58.773764 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f18663c-72e5-48c8-9684-590b95d5d325 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:58.774223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f18663c-72e5-48c8-9684-590b95d5d325 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:58.774995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f18663c-72e5-48c8-9684-590b95d5d325 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:58.775434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f18663c-72e5-48c8-9684-590b95d5d325 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:58.805882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1f18663c-72e5-48c8-9684-590b95d5d325 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043139 Sep 14 19:49:58.806456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 768/1505] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:58 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:58.920100 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5de77fab-fd30-4345-94ec-452f3401071c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:58.920702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5de77fab-fd30-4345-94ec-452f3401071c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:58.926807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5de77fab-fd30-4345-94ec-452f3401071c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:58.927247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5de77fab-fd30-4345-94ec-452f3401071c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:58.928003 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5de77fab-fd30-4345-94ec-452f3401071c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:58.928435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5de77fab-fd30-4345-94ec-452f3401071c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:59.052357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5de77fab-fd30-4345-94ec-452f3401071c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:49:59.059869 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5de77fab-fd30-4345-94ec-452f3401071c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143363 Sep 14 19:49:59.060429 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 738/1506] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:49:58 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:59.283184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-071fe093-6fd2-4d64-adea-32cb9fc3313a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:59.284026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-071fe093-6fd2-4d64-adea-32cb9fc3313a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:59.290007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-071fe093-6fd2-4d64-adea-32cb9fc3313a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:59.290451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-071fe093-6fd2-4d64-adea-32cb9fc3313a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:59.291222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-071fe093-6fd2-4d64-adea-32cb9fc3313a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:59.291664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-071fe093-6fd2-4d64-adea-32cb9fc3313a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:59.322595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-071fe093-6fd2-4d64-adea-32cb9fc3313a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043579 Sep 14 19:49:59.323193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 769/1507] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:49:59 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:49:59.560616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4c5d6834-a342-4dd1-8071-2becf89deb0b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:59.561447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4c5d6834-a342-4dd1-8071-2becf89deb0b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:59.567316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c5d6834-a342-4dd1-8071-2becf89deb0b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:59.567772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c5d6834-a342-4dd1-8071-2becf89deb0b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:59.569215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c5d6834-a342-4dd1-8071-2becf89deb0b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:59.569698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c5d6834-a342-4dd1-8071-2becf89deb0b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:59.599999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4c5d6834-a342-4dd1-8071-2becf89deb0b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043354 Sep 14 19:49:59.600556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 739/1508] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:59 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:59.817412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f325f1f8-d15b-4b17-a3df-fa9c121766d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:59.818260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f325f1f8-d15b-4b17-a3df-fa9c121766d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:49:59.824158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f325f1f8-d15b-4b17-a3df-fa9c121766d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:59.824595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f325f1f8-d15b-4b17-a3df-fa9c121766d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:59.825349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f325f1f8-d15b-4b17-a3df-fa9c121766d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:49:59.825814 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f325f1f8-d15b-4b17-a3df-fa9c121766d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:49:59.854822 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f325f1f8-d15b-4b17-a3df-fa9c121766d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041217 Sep 14 19:49:59.855376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 770/1509] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:49:59 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:00.077490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-421f9064-6fdc-4146-a988-d0edc1398587 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:00.078155 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-421f9064-6fdc-4146-a988-d0edc1398587 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:00.084626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-421f9064-6fdc-4146-a988-d0edc1398587 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:00.086117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-421f9064-6fdc-4146-a988-d0edc1398587 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:00.086898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-421f9064-6fdc-4146-a988-d0edc1398587 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:00.087326 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-421f9064-6fdc-4146-a988-d0edc1398587 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:00.211958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-421f9064-6fdc-4146-a988-d0edc1398587 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:00.219982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-421f9064-6fdc-4146-a988-d0edc1398587 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.146009 Sep 14 19:50:00.220634 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 740/1510] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:00 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:00.333983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9955db81-7d24-42c3-a2f2-8e9dabe05a80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:00.335405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9955db81-7d24-42c3-a2f2-8e9dabe05a80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:00.341125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9955db81-7d24-42c3-a2f2-8e9dabe05a80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:00.341594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9955db81-7d24-42c3-a2f2-8e9dabe05a80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:00.342433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9955db81-7d24-42c3-a2f2-8e9dabe05a80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:00.342862 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9955db81-7d24-42c3-a2f2-8e9dabe05a80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:00.371275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9955db81-7d24-42c3-a2f2-8e9dabe05a80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041081 Sep 14 19:50:00.371819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 771/1511] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:00 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:00.611387 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b50cee5b-8bfe-43f9-a901-03fcc8b1d4a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:00.612291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b50cee5b-8bfe-43f9-a901-03fcc8b1d4a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:00.618068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b50cee5b-8bfe-43f9-a901-03fcc8b1d4a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:00.618473 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b50cee5b-8bfe-43f9-a901-03fcc8b1d4a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:00.619229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b50cee5b-8bfe-43f9-a901-03fcc8b1d4a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:00.619659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b50cee5b-8bfe-43f9-a901-03fcc8b1d4a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:00.648349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b50cee5b-8bfe-43f9-a901-03fcc8b1d4a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040691 Sep 14 19:50:00.648919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 741/1512] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:00 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:00.866792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bedf9405-6ba9-4e6d-91f1-a42f0fe2f99f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:00.867644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bedf9405-6ba9-4e6d-91f1-a42f0fe2f99f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:00.873455 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bedf9405-6ba9-4e6d-91f1-a42f0fe2f99f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:00.873935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bedf9405-6ba9-4e6d-91f1-a42f0fe2f99f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:00.874701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bedf9405-6ba9-4e6d-91f1-a42f0fe2f99f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:00.875133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bedf9405-6ba9-4e6d-91f1-a42f0fe2f99f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:00.905006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bedf9405-6ba9-4e6d-91f1-a42f0fe2f99f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042566 Sep 14 19:50:00.905759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 772/1513] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:00 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:01.237814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e84a8791-5473-4cc1-b258-d8d31f6945e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:01.238620 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e84a8791-5473-4cc1-b258-d8d31f6945e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:01.245192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e84a8791-5473-4cc1-b258-d8d31f6945e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:01.245677 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e84a8791-5473-4cc1-b258-d8d31f6945e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:01.246450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e84a8791-5473-4cc1-b258-d8d31f6945e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:01.246888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e84a8791-5473-4cc1-b258-d8d31f6945e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:01.364983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e84a8791-5473-4cc1-b258-d8d31f6945e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:01.374162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e84a8791-5473-4cc1-b258-d8d31f6945e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140044 Sep 14 19:50:01.374737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 742/1514] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:01 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:01.383974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d03a238d-7c5c-4c9c-8d52-186ebdb0e034 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:01.384949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d03a238d-7c5c-4c9c-8d52-186ebdb0e034 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:01.391657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d03a238d-7c5c-4c9c-8d52-186ebdb0e034 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:01.392098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d03a238d-7c5c-4c9c-8d52-186ebdb0e034 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:01.392889 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d03a238d-7c5c-4c9c-8d52-186ebdb0e034 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:01.393320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d03a238d-7c5c-4c9c-8d52-186ebdb0e034 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:01.421943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d03a238d-7c5c-4c9c-8d52-186ebdb0e034 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042714 Sep 14 19:50:01.422490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 773/1515] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:01 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:01.659887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dab0063d-082d-4d6b-be3a-d3d85abaa9b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:01.660723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dab0063d-082d-4d6b-be3a-d3d85abaa9b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:01.667353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dab0063d-082d-4d6b-be3a-d3d85abaa9b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:01.667797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dab0063d-082d-4d6b-be3a-d3d85abaa9b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:01.668568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dab0063d-082d-4d6b-be3a-d3d85abaa9b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:01.669000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dab0063d-082d-4d6b-be3a-d3d85abaa9b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:01.697380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dab0063d-082d-4d6b-be3a-d3d85abaa9b8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041455 Sep 14 19:50:01.697977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 743/1516] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:01 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:01.916139 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-22c4a61d-f0e3-4a6f-ab33-0384ddd460fe tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:01.916955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-22c4a61d-f0e3-4a6f-ab33-0384ddd460fe tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:01.922808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22c4a61d-f0e3-4a6f-ab33-0384ddd460fe tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:01.923503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22c4a61d-f0e3-4a6f-ab33-0384ddd460fe tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:01.924256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22c4a61d-f0e3-4a6f-ab33-0384ddd460fe tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:01.924679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22c4a61d-f0e3-4a6f-ab33-0384ddd460fe tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:01.952794 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-22c4a61d-f0e3-4a6f-ab33-0384ddd460fe tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041101 Sep 14 19:50:01.953404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 774/1517] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:01 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:02.391213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4e675000-d6e9-47b3-b3f3-fd6e63fcb021 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:02.391826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4e675000-d6e9-47b3-b3f3-fd6e63fcb021 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:02.397706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e675000-d6e9-47b3-b3f3-fd6e63fcb021 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:02.398156 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e675000-d6e9-47b3-b3f3-fd6e63fcb021 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:02.398925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e675000-d6e9-47b3-b3f3-fd6e63fcb021 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:02.399361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e675000-d6e9-47b3-b3f3-fd6e63fcb021 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:02.433804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-498706ed-4d23-4713-b922-715b3f6a1799 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:02.434629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-498706ed-4d23-4713-b922-715b3f6a1799 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:02.440884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-498706ed-4d23-4713-b922-715b3f6a1799 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:02.441334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-498706ed-4d23-4713-b922-715b3f6a1799 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:02.442172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-498706ed-4d23-4713-b922-715b3f6a1799 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:02.442615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-498706ed-4d23-4713-b922-715b3f6a1799 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:02.472779 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-498706ed-4d23-4713-b922-715b3f6a1799 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042860 Sep 14 19:50:02.473352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 775/1518] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:02 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:50:02.520971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4e675000-d6e9-47b3-b3f3-fd6e63fcb021 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:02.528229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4e675000-d6e9-47b3-b3f3-fd6e63fcb021 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140655 Sep 14 19:50:02.532319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 744/1519] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:02 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:50:02.600327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:50:02.600517 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 19:50:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:50:02.708909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e93f9b10-7281-4a3a-ab20-672af1f6c687 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:02.709818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e93f9b10-7281-4a3a-ab20-672af1f6c687 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:02.715905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e93f9b10-7281-4a3a-ab20-672af1f6c687 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:02.716357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e93f9b10-7281-4a3a-ab20-672af1f6c687 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:02.717245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e93f9b10-7281-4a3a-ab20-672af1f6c687 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:02.717729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e93f9b10-7281-4a3a-ab20-672af1f6c687 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:02.747179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e93f9b10-7281-4a3a-ab20-672af1f6c687 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042176 Sep 14 19:50:02.747739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 776/1520] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:02 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:02.964743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-63a9571f-279a-49a1-a6d7-dd37beddc63a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:02.965627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-63a9571f-279a-49a1-a6d7-dd37beddc63a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:02.971545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-63a9571f-279a-49a1-a6d7-dd37beddc63a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:02.971990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-63a9571f-279a-49a1-a6d7-dd37beddc63a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:02.972783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-63a9571f-279a-49a1-a6d7-dd37beddc63a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:02.973220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-63a9571f-279a-49a1-a6d7-dd37beddc63a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:03.002726 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-63a9571f-279a-49a1-a6d7-dd37beddc63a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042274 Sep 14 19:50:03.003272 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 745/1521] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:02 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:03.364375 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:50:03.364599 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 19:50:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:50:03.491889 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ca14de09-e9ac-44a7-9e6f-cb1225b76b92 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:03.492720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ca14de09-e9ac-44a7-9e6f-cb1225b76b92 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:03.498678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca14de09-e9ac-44a7-9e6f-cb1225b76b92 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:03.499131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca14de09-e9ac-44a7-9e6f-cb1225b76b92 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:03.499899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca14de09-e9ac-44a7-9e6f-cb1225b76b92 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:03.500336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca14de09-e9ac-44a7-9e6f-cb1225b76b92 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:03.528499 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ca14de09-e9ac-44a7-9e6f-cb1225b76b92 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041167 Sep 14 19:50:03.529049 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 777/1522] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:03.547176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a7a99a1c-6b57-46b6-a2f0-fce6d893bbed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:03.547785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a7a99a1c-6b57-46b6-a2f0-fce6d893bbed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:03.554665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7a99a1c-6b57-46b6-a2f0-fce6d893bbed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:03.555099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7a99a1c-6b57-46b6-a2f0-fce6d893bbed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:03.555855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7a99a1c-6b57-46b6-a2f0-fce6d893bbed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:03.557044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7a99a1c-6b57-46b6-a2f0-fce6d893bbed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:03.675030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a7a99a1c-6b57-46b6-a2f0-fce6d893bbed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:03.683108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a7a99a1c-6b57-46b6-a2f0-fce6d893bbed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139740 Sep 14 19:50:03.683669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 746/1523] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:03 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:03.758579 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f0828dd2-2018-481b-889c-b8d8c128c23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:03.759490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f0828dd2-2018-481b-889c-b8d8c128c23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:03.765709 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0828dd2-2018-481b-889c-b8d8c128c23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:03.766159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0828dd2-2018-481b-889c-b8d8c128c23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:03.766922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0828dd2-2018-481b-889c-b8d8c128c23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:03.767354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0828dd2-2018-481b-889c-b8d8c128c23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:03.795856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f0828dd2-2018-481b-889c-b8d8c128c23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041029 Sep 14 19:50:03.796422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 778/1524] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:03 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:04.014330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-be9bfc56-fd68-42fc-bad2-d048236ebac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:04.015178 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-be9bfc56-fd68-42fc-bad2-d048236ebac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:04.020889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be9bfc56-fd68-42fc-bad2-d048236ebac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:04.021332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be9bfc56-fd68-42fc-bad2-d048236ebac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:04.022140 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be9bfc56-fd68-42fc-bad2-d048236ebac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:04.022575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be9bfc56-fd68-42fc-bad2-d048236ebac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:04.051026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-be9bfc56-fd68-42fc-bad2-d048236ebac6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040515 Sep 14 19:50:04.051564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 747/1525] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:04 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:04.540854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5e3d39a9-1775-4d28-a381-a6eaf0e4de54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:04.541822 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5e3d39a9-1775-4d28-a381-a6eaf0e4de54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:04.547512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e3d39a9-1775-4d28-a381-a6eaf0e4de54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:04.547955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e3d39a9-1775-4d28-a381-a6eaf0e4de54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:04.549004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e3d39a9-1775-4d28-a381-a6eaf0e4de54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:04.549431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e3d39a9-1775-4d28-a381-a6eaf0e4de54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:04.578502 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5e3d39a9-1775-4d28-a381-a6eaf0e4de54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042136 Sep 14 19:50:04.579069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 779/1526] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:04 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:04.608710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:50:04.608905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 19:50:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:50:04.700150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b92548e7-428c-4158-95ff-f350a85f2fa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:04.700766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b92548e7-428c-4158-95ff-f350a85f2fa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:04.706744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b92548e7-428c-4158-95ff-f350a85f2fa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:04.707196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b92548e7-428c-4158-95ff-f350a85f2fa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:04.707954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b92548e7-428c-4158-95ff-f350a85f2fa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:04.708385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b92548e7-428c-4158-95ff-f350a85f2fa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:04.807615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d02d6c0c-788a-4480-b672-9d19ce20d559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:04.808442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d02d6c0c-788a-4480-b672-9d19ce20d559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:04.814150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d02d6c0c-788a-4480-b672-9d19ce20d559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:04.814607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d02d6c0c-788a-4480-b672-9d19ce20d559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:04.815407 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d02d6c0c-788a-4480-b672-9d19ce20d559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:04.815839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d02d6c0c-788a-4480-b672-9d19ce20d559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:04.827128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b92548e7-428c-4158-95ff-f350a85f2fa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:04.835268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b92548e7-428c-4158-95ff-f350a85f2fa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137914 Sep 14 19:50:04.836036 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 748/1527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:04 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:04.845890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d02d6c0c-788a-4480-b672-9d19ce20d559 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Sep 14 19:50:04.846447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 780/1528] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:04 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:05.062896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-80138b33-6d37-4231-bf15-219544ffcf55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:05.063761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-80138b33-6d37-4231-bf15-219544ffcf55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:05.070340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-80138b33-6d37-4231-bf15-219544ffcf55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:05.070780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-80138b33-6d37-4231-bf15-219544ffcf55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:05.071540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-80138b33-6d37-4231-bf15-219544ffcf55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:05.071970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-80138b33-6d37-4231-bf15-219544ffcf55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:05.100575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-80138b33-6d37-4231-bf15-219544ffcf55 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 Sep 14 19:50:05.101127 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 749/1529] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:05 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:05.590164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bd7ed6e0-59a9-4999-bf1e-977f71b5abe0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:05.590983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bd7ed6e0-59a9-4999-bf1e-977f71b5abe0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:05.596750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bd7ed6e0-59a9-4999-bf1e-977f71b5abe0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:05.597195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bd7ed6e0-59a9-4999-bf1e-977f71b5abe0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:05.597991 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bd7ed6e0-59a9-4999-bf1e-977f71b5abe0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:05.598423 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bd7ed6e0-59a9-4999-bf1e-977f71b5abe0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:05.627513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bd7ed6e0-59a9-4999-bf1e-977f71b5abe0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041240 Sep 14 19:50:05.628055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 781/1530] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:05 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:05.852711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-784ed4cb-69ae-4be1-a455-2178cf8fc1fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:05.853257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-784ed4cb-69ae-4be1-a455-2178cf8fc1fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:05.857333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4b87be24-26db-4d30-a86a-a615cbe17b0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:05.858661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4b87be24-26db-4d30-a86a-a615cbe17b0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:05.859108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-784ed4cb-69ae-4be1-a455-2178cf8fc1fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:05.859554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-784ed4cb-69ae-4be1-a455-2178cf8fc1fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:05.860319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-784ed4cb-69ae-4be1-a455-2178cf8fc1fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:05.860747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-784ed4cb-69ae-4be1-a455-2178cf8fc1fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:05.864291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b87be24-26db-4d30-a86a-a615cbe17b0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:05.864740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b87be24-26db-4d30-a86a-a615cbe17b0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:05.865599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b87be24-26db-4d30-a86a-a615cbe17b0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:05.866061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4b87be24-26db-4d30-a86a-a615cbe17b0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:05.895551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4b87be24-26db-4d30-a86a-a615cbe17b0f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041892 Sep 14 19:50:05.897155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 782/1531] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:05 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:05.984665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-784ed4cb-69ae-4be1-a455-2178cf8fc1fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:05.992054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-784ed4cb-69ae-4be1-a455-2178cf8fc1fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143805 Sep 14 19:50:05.992608 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 750/1532] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:05 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:06.111842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-98f7fec3-a303-4fda-b170-b52b1bbf8c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:06.112751 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-98f7fec3-a303-4fda-b170-b52b1bbf8c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:06.118631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98f7fec3-a303-4fda-b170-b52b1bbf8c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:06.119077 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98f7fec3-a303-4fda-b170-b52b1bbf8c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:06.119846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98f7fec3-a303-4fda-b170-b52b1bbf8c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:06.120280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98f7fec3-a303-4fda-b170-b52b1bbf8c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:06.149579 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-98f7fec3-a303-4fda-b170-b52b1bbf8c84 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 Sep 14 19:50:06.150140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 783/1533] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:06 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:06.639160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ba455f29-41c3-49d4-88c0-63250c21a1ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:06.639968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ba455f29-41c3-49d4-88c0-63250c21a1ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:06.645759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba455f29-41c3-49d4-88c0-63250c21a1ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:06.646207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba455f29-41c3-49d4-88c0-63250c21a1ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:06.646964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba455f29-41c3-49d4-88c0-63250c21a1ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:06.647396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba455f29-41c3-49d4-88c0-63250c21a1ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:06.675299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ba455f29-41c3-49d4-88c0-63250c21a1ae tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040103 Sep 14 19:50:06.675843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 751/1534] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:06 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:06.908174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b6a65ae1-0669-4e2e-a9b5-165d77d6e4b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:06.909026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b6a65ae1-0669-4e2e-a9b5-165d77d6e4b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:06.915723 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6a65ae1-0669-4e2e-a9b5-165d77d6e4b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:06.916172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6a65ae1-0669-4e2e-a9b5-165d77d6e4b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:06.916992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6a65ae1-0669-4e2e-a9b5-165d77d6e4b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:06.917468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6a65ae1-0669-4e2e-a9b5-165d77d6e4b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:06.946777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b6a65ae1-0669-4e2e-a9b5-165d77d6e4b2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 Sep 14 19:50:06.947338 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 784/1535] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:06 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:07.008859 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dc4b660f-c8bc-4421-8440-85e9d291dad2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:07.009533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dc4b660f-c8bc-4421-8440-85e9d291dad2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:07.015414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc4b660f-c8bc-4421-8440-85e9d291dad2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:07.015877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc4b660f-c8bc-4421-8440-85e9d291dad2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:07.016670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc4b660f-c8bc-4421-8440-85e9d291dad2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:07.017107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc4b660f-c8bc-4421-8440-85e9d291dad2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:07.137596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dc4b660f-c8bc-4421-8440-85e9d291dad2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:07.144777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dc4b660f-c8bc-4421-8440-85e9d291dad2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139656 Sep 14 19:50:07.145339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 752/1536] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:07 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:07.160055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0d2f1fca-20ff-4c63-9ee1-e4f3bdf4f7cd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:07.160882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0d2f1fca-20ff-4c63-9ee1-e4f3bdf4f7cd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:07.167128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d2f1fca-20ff-4c63-9ee1-e4f3bdf4f7cd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:07.167570 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d2f1fca-20ff-4c63-9ee1-e4f3bdf4f7cd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:07.168320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d2f1fca-20ff-4c63-9ee1-e4f3bdf4f7cd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:07.168747 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d2f1fca-20ff-4c63-9ee1-e4f3bdf4f7cd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:07.197116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0d2f1fca-20ff-4c63-9ee1-e4f3bdf4f7cd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040815 Sep 14 19:50:07.197676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 785/1537] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:07 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:07.687253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ea619f35-3937-4187-958c-6ed87566a78e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:07.688076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ea619f35-3937-4187-958c-6ed87566a78e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:07.694365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea619f35-3937-4187-958c-6ed87566a78e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:07.694804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea619f35-3937-4187-958c-6ed87566a78e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:07.695561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea619f35-3937-4187-958c-6ed87566a78e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:07.695988 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea619f35-3937-4187-958c-6ed87566a78e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:07.724180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ea619f35-3937-4187-958c-6ed87566a78e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040781 Sep 14 19:50:07.724734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 753/1538] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:07 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:07.957769 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c424a6d5-04a0-46e4-a826-da291bb7a652 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:07.958644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c424a6d5-04a0-46e4-a826-da291bb7a652 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:07.965107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c424a6d5-04a0-46e4-a826-da291bb7a652 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:07.965582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c424a6d5-04a0-46e4-a826-da291bb7a652 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:07.966348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c424a6d5-04a0-46e4-a826-da291bb7a652 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:07.966783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c424a6d5-04a0-46e4-a826-da291bb7a652 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:07.995057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c424a6d5-04a0-46e4-a826-da291bb7a652 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041134 Sep 14 19:50:07.995601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 786/1539] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:07 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:08.160915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-444559bd-ec09-48ad-bec3-073820b444a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:08.161529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-444559bd-ec09-48ad-bec3-073820b444a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:08.167328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-444559bd-ec09-48ad-bec3-073820b444a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:08.167768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-444559bd-ec09-48ad-bec3-073820b444a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:08.168523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-444559bd-ec09-48ad-bec3-073820b444a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:08.168958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-444559bd-ec09-48ad-bec3-073820b444a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:08.208762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0114a676-5a45-44b9-8e92-115a934fac82 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:08.209649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0114a676-5a45-44b9-8e92-115a934fac82 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:08.215630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0114a676-5a45-44b9-8e92-115a934fac82 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:08.216082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0114a676-5a45-44b9-8e92-115a934fac82 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:08.216956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0114a676-5a45-44b9-8e92-115a934fac82 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:08.217392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0114a676-5a45-44b9-8e92-115a934fac82 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:08.247546 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0114a676-5a45-44b9-8e92-115a934fac82 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042764 Sep 14 19:50:08.248119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 787/1540] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:08 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:08.291854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-444559bd-ec09-48ad-bec3-073820b444a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:08.299717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-444559bd-ec09-48ad-bec3-073820b444a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142432 Sep 14 19:50:08.300380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 754/1541] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:08 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:08.735673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0449500a-a1d3-4143-9a57-f5f02370e6cf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:08.736582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0449500a-a1d3-4143-9a57-f5f02370e6cf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:08.744229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0449500a-a1d3-4143-9a57-f5f02370e6cf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:08.744680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0449500a-a1d3-4143-9a57-f5f02370e6cf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:08.745452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0449500a-a1d3-4143-9a57-f5f02370e6cf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:08.745918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0449500a-a1d3-4143-9a57-f5f02370e6cf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:08.774544 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0449500a-a1d3-4143-9a57-f5f02370e6cf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042633 Sep 14 19:50:08.775106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 788/1542] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:08 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:09.006465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8596b29a-5a16-4109-ad8f-b876520274a0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:09.007388 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8596b29a-5a16-4109-ad8f-b876520274a0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:09.013208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8596b29a-5a16-4109-ad8f-b876520274a0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:09.013684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8596b29a-5a16-4109-ad8f-b876520274a0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:09.014437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8596b29a-5a16-4109-ad8f-b876520274a0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:09.014863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8596b29a-5a16-4109-ad8f-b876520274a0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:09.043746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8596b29a-5a16-4109-ad8f-b876520274a0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041044 Sep 14 19:50:09.044289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 755/1543] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:09 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:09.259772 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fa38df57-6c02-4edc-b4ea-99060e9ee8b6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:09.260680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fa38df57-6c02-4edc-b4ea-99060e9ee8b6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:09.266821 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa38df57-6c02-4edc-b4ea-99060e9ee8b6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:09.267250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa38df57-6c02-4edc-b4ea-99060e9ee8b6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:09.268031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa38df57-6c02-4edc-b4ea-99060e9ee8b6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:09.268469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa38df57-6c02-4edc-b4ea-99060e9ee8b6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:09.299204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fa38df57-6c02-4edc-b4ea-99060e9ee8b6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Sep 14 19:50:09.299785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 789/1544] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:09 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:09.317156 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3f7ff900-e8c3-4fa4-8843-adf6904791e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:09.317945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3f7ff900-e8c3-4fa4-8843-adf6904791e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:09.327480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f7ff900-e8c3-4fa4-8843-adf6904791e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:09.327480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f7ff900-e8c3-4fa4-8843-adf6904791e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:09.327480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f7ff900-e8c3-4fa4-8843-adf6904791e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:09.327480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f7ff900-e8c3-4fa4-8843-adf6904791e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:09.449423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3f7ff900-e8c3-4fa4-8843-adf6904791e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:09.456942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3f7ff900-e8c3-4fa4-8843-adf6904791e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143503 Sep 14 19:50:09.457543 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 756/1545] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:09 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:09.785483 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7db4b9e7-b7fc-4359-9d61-55ec6cfa7439 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:09.786316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7db4b9e7-b7fc-4359-9d61-55ec6cfa7439 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:09.792372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7db4b9e7-b7fc-4359-9d61-55ec6cfa7439 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:09.792820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7db4b9e7-b7fc-4359-9d61-55ec6cfa7439 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:09.793662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7db4b9e7-b7fc-4359-9d61-55ec6cfa7439 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:09.794101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7db4b9e7-b7fc-4359-9d61-55ec6cfa7439 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:09.826489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7db4b9e7-b7fc-4359-9d61-55ec6cfa7439 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044943 Sep 14 19:50:09.827067 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 790/1546] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:10.055807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9d8200ac-2462-40bb-99de-68c389215f8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:10.056626 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9d8200ac-2462-40bb-99de-68c389215f8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:10.062613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9d8200ac-2462-40bb-99de-68c389215f8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:10.063061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9d8200ac-2462-40bb-99de-68c389215f8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:10.063832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9d8200ac-2462-40bb-99de-68c389215f8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:10.064268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9d8200ac-2462-40bb-99de-68c389215f8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:10.092452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9d8200ac-2462-40bb-99de-68c389215f8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041095 Sep 14 19:50:10.093014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 757/1547] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:10 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:10.310797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8a95a615-8cf4-4c2f-912f-512f3652250f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:10.311658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8a95a615-8cf4-4c2f-912f-512f3652250f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:10.317473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a95a615-8cf4-4c2f-912f-512f3652250f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:10.321353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a95a615-8cf4-4c2f-912f-512f3652250f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:10.321353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a95a615-8cf4-4c2f-912f-512f3652250f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:10.321353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8a95a615-8cf4-4c2f-912f-512f3652250f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:10.347689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8a95a615-8cf4-4c2f-912f-512f3652250f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040824 Sep 14 19:50:10.348250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 791/1548] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:10 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:10.474243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-18447db0-3e57-4d89-8516-68299e663605 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:10.481953 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-18447db0-3e57-4d89-8516-68299e663605 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:10.482771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18447db0-3e57-4d89-8516-68299e663605 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:10.483207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18447db0-3e57-4d89-8516-68299e663605 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:10.483970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18447db0-3e57-4d89-8516-68299e663605 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:10.484421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18447db0-3e57-4d89-8516-68299e663605 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:10.603345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-18447db0-3e57-4d89-8516-68299e663605 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:10.610568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-18447db0-3e57-4d89-8516-68299e663605 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139933 Sep 14 19:50:10.611135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 758/1549] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:10 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:50:10.838135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d4c127c7-5834-4752-bb6b-f07bea72cdcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:10.839053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d4c127c7-5834-4752-bb6b-f07bea72cdcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:10.844754 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4c127c7-5834-4752-bb6b-f07bea72cdcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:10.845193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4c127c7-5834-4752-bb6b-f07bea72cdcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:10.846133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4c127c7-5834-4752-bb6b-f07bea72cdcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:10.846399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4c127c7-5834-4752-bb6b-f07bea72cdcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:10.876100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d4c127c7-5834-4752-bb6b-f07bea72cdcf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041780 Sep 14 19:50:10.876638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 792/1550] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:11.104545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-685b9f74-c862-4dce-b90b-2b09be20622f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:11.105365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-685b9f74-c862-4dce-b90b-2b09be20622f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:11.111163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-685b9f74-c862-4dce-b90b-2b09be20622f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:11.111595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-685b9f74-c862-4dce-b90b-2b09be20622f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:11.112719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-685b9f74-c862-4dce-b90b-2b09be20622f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:11.113134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-685b9f74-c862-4dce-b90b-2b09be20622f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:11.140717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-685b9f74-c862-4dce-b90b-2b09be20622f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040077 Sep 14 19:50:11.141267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 759/1551] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:11.360023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9be223b0-3edf-43b2-8e63-fce663ffd0e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:11.360843 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9be223b0-3edf-43b2-8e63-fce663ffd0e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:11.366656 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9be223b0-3edf-43b2-8e63-fce663ffd0e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:11.367138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9be223b0-3edf-43b2-8e63-fce663ffd0e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:11.367906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9be223b0-3edf-43b2-8e63-fce663ffd0e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:11.368342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9be223b0-3edf-43b2-8e63-fce663ffd0e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:11.397308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9be223b0-3edf-43b2-8e63-fce663ffd0e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040645 Sep 14 19:50:11.397878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 793/1552] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:11 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:11.627667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-92ea3d1d-e54d-4d17-b086-5bc8e3bf8ab1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:11.628268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-92ea3d1d-e54d-4d17-b086-5bc8e3bf8ab1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:11.634653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-92ea3d1d-e54d-4d17-b086-5bc8e3bf8ab1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:11.635085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-92ea3d1d-e54d-4d17-b086-5bc8e3bf8ab1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:11.635838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-92ea3d1d-e54d-4d17-b086-5bc8e3bf8ab1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:11.636262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-92ea3d1d-e54d-4d17-b086-5bc8e3bf8ab1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:11.753235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-92ea3d1d-e54d-4d17-b086-5bc8e3bf8ab1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:11.761285 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-92ea3d1d-e54d-4d17-b086-5bc8e3bf8ab1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137449 Sep 14 19:50:11.761885 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 760/1553] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:11 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:11.888032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8f2c5946-830b-46ce-91f1-52697c711364 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:11.888875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8f2c5946-830b-46ce-91f1-52697c711364 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:11.894754 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f2c5946-830b-46ce-91f1-52697c711364 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:11.895207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f2c5946-830b-46ce-91f1-52697c711364 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:11.896106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f2c5946-830b-46ce-91f1-52697c711364 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:11.896470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f2c5946-830b-46ce-91f1-52697c711364 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:11.925079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8f2c5946-830b-46ce-91f1-52697c711364 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040966 Sep 14 19:50:11.925642 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 794/1554] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:11 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:12.152176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0a666933-887a-4a3e-9308-103048d3f791 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:12.153036 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0a666933-887a-4a3e-9308-103048d3f791 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:12.158873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0a666933-887a-4a3e-9308-103048d3f791 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:12.159331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0a666933-887a-4a3e-9308-103048d3f791 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:12.160098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0a666933-887a-4a3e-9308-103048d3f791 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:12.160539 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0a666933-887a-4a3e-9308-103048d3f791 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:12.189779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0a666933-887a-4a3e-9308-103048d3f791 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041507 Sep 14 19:50:12.190318 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 761/1555] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:12 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:12.408304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d10481b3-3d44-4381-bcab-1f19fd07f3ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:12.409146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d10481b3-3d44-4381-bcab-1f19fd07f3ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:12.415842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d10481b3-3d44-4381-bcab-1f19fd07f3ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:12.416279 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d10481b3-3d44-4381-bcab-1f19fd07f3ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:12.417032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d10481b3-3d44-4381-bcab-1f19fd07f3ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:12.417460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d10481b3-3d44-4381-bcab-1f19fd07f3ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:12.446115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d10481b3-3d44-4381-bcab-1f19fd07f3ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041605 Sep 14 19:50:12.446651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 795/1556] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:12 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:12.777804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9d0ebf9e-4fd2-41ed-ae05-a7ff80890acd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:12.778410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9d0ebf9e-4fd2-41ed-ae05-a7ff80890acd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:12.784263 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9d0ebf9e-4fd2-41ed-ae05-a7ff80890acd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:12.788345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9d0ebf9e-4fd2-41ed-ae05-a7ff80890acd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:12.788345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9d0ebf9e-4fd2-41ed-ae05-a7ff80890acd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:12.788345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9d0ebf9e-4fd2-41ed-ae05-a7ff80890acd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:12.908789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9d0ebf9e-4fd2-41ed-ae05-a7ff80890acd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:12.916028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9d0ebf9e-4fd2-41ed-ae05-a7ff80890acd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141826 Sep 14 19:50:12.916586 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 762/1557] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:12 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:12.937302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e1090360-8535-4465-9497-29e7299da645 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:12.938167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e1090360-8535-4465-9497-29e7299da645 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:12.944696 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1090360-8535-4465-9497-29e7299da645 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:12.945152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1090360-8535-4465-9497-29e7299da645 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:12.945973 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1090360-8535-4465-9497-29e7299da645 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:12.946441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e1090360-8535-4465-9497-29e7299da645 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:12.976159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e1090360-8535-4465-9497-29e7299da645 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042511 Sep 14 19:50:12.976785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 796/1558] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:12 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:13.201390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-24759cef-01a3-4768-b777-b7bfede80162 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:13.202241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-24759cef-01a3-4768-b777-b7bfede80162 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:13.208146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-24759cef-01a3-4768-b777-b7bfede80162 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:13.208590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-24759cef-01a3-4768-b777-b7bfede80162 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:13.210056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-24759cef-01a3-4768-b777-b7bfede80162 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:13.210489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-24759cef-01a3-4768-b777-b7bfede80162 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:13.238053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-24759cef-01a3-4768-b777-b7bfede80162 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040472 Sep 14 19:50:13.238592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 763/1559] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:13 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:13.457485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-982f7123-6fda-46cc-b604-6d669e0c6979 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:13.458349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-982f7123-6fda-46cc-b604-6d669e0c6979 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:13.464354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-982f7123-6fda-46cc-b604-6d669e0c6979 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:13.464807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-982f7123-6fda-46cc-b604-6d669e0c6979 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:13.465612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-982f7123-6fda-46cc-b604-6d669e0c6979 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:13.466053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-982f7123-6fda-46cc-b604-6d669e0c6979 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:13.494767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-982f7123-6fda-46cc-b604-6d669e0c6979 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041094 Sep 14 19:50:13.495314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 797/1560] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:13 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:13.934002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9c261713-8b07-4115-92ec-b64c8bf541c3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:13.934613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9c261713-8b07-4115-92ec-b64c8bf541c3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:13.940708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9c261713-8b07-4115-92ec-b64c8bf541c3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:13.941159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9c261713-8b07-4115-92ec-b64c8bf541c3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:13.941942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9c261713-8b07-4115-92ec-b64c8bf541c3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:13.942493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9c261713-8b07-4115-92ec-b64c8bf541c3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:13.987695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d715e7bb-3216-44e5-bc90-f4b9c6cc1e31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:13.988552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d715e7bb-3216-44e5-bc90-f4b9c6cc1e31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:13.994989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d715e7bb-3216-44e5-bc90-f4b9c6cc1e31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:13.995442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d715e7bb-3216-44e5-bc90-f4b9c6cc1e31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:13.996212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d715e7bb-3216-44e5-bc90-f4b9c6cc1e31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:13.996647 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d715e7bb-3216-44e5-bc90-f4b9c6cc1e31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:14.026115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d715e7bb-3216-44e5-bc90-f4b9c6cc1e31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042222 Sep 14 19:50:14.026667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 798/1561] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:50:14.061742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9c261713-8b07-4115-92ec-b64c8bf541c3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:14.069175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9c261713-8b07-4115-92ec-b64c8bf541c3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.138804 Sep 14 19:50:14.069856 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 764/1562] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:13 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:14.250038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-374d49ed-b8f7-4d95-82b2-b48fce6771a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:14.250866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-374d49ed-b8f7-4d95-82b2-b48fce6771a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:14.256602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-374d49ed-b8f7-4d95-82b2-b48fce6771a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:14.257045 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-374d49ed-b8f7-4d95-82b2-b48fce6771a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:14.257843 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-374d49ed-b8f7-4d95-82b2-b48fce6771a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:14.258280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-374d49ed-b8f7-4d95-82b2-b48fce6771a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:14.289525 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-374d49ed-b8f7-4d95-82b2-b48fce6771a5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 Sep 14 19:50:14.290079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 799/1563] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:14 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:14.304578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:50:14.304765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 19:50:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:50:14.506283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9427b2a9-342e-4b0d-88ff-b5972cedecc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:14.507104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9427b2a9-342e-4b0d-88ff-b5972cedecc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:14.512834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9427b2a9-342e-4b0d-88ff-b5972cedecc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:14.513266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9427b2a9-342e-4b0d-88ff-b5972cedecc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:14.514043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9427b2a9-342e-4b0d-88ff-b5972cedecc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:14.514470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9427b2a9-342e-4b0d-88ff-b5972cedecc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:14.542833 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9427b2a9-342e-4b0d-88ff-b5972cedecc8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040869 Sep 14 19:50:14.543385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 765/1564] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:14 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:15.037666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b954432f-4fbd-4ab9-b064-78c0aa77f795 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:15.038490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b954432f-4fbd-4ab9-b064-78c0aa77f795 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:15.044291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b954432f-4fbd-4ab9-b064-78c0aa77f795 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:15.044731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b954432f-4fbd-4ab9-b064-78c0aa77f795 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:15.045483 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b954432f-4fbd-4ab9-b064-78c0aa77f795 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:15.045963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b954432f-4fbd-4ab9-b064-78c0aa77f795 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:15.075177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b954432f-4fbd-4ab9-b064-78c0aa77f795 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041358 Sep 14 19:50:15.075711 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 800/1565] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:15 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:15.086005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8bb42c62-6373-4be4-81bb-4927cb71e6c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:15.086610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8bb42c62-6373-4be4-81bb-4927cb71e6c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:15.092807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8bb42c62-6373-4be4-81bb-4927cb71e6c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:15.093259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8bb42c62-6373-4be4-81bb-4927cb71e6c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:15.094064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8bb42c62-6373-4be4-81bb-4927cb71e6c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:15.094505 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8bb42c62-6373-4be4-81bb-4927cb71e6c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:15.210274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8bb42c62-6373-4be4-81bb-4927cb71e6c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:15.217440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8bb42c62-6373-4be4-81bb-4927cb71e6c1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.135083 Sep 14 19:50:15.218033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 766/1566] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:15 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:15.300534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9e008fd4-f665-4214-9725-d2d4dbda3740 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:15.301367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9e008fd4-f665-4214-9725-d2d4dbda3740 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:15.307839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e008fd4-f665-4214-9725-d2d4dbda3740 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:15.308290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e008fd4-f665-4214-9725-d2d4dbda3740 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:15.309063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e008fd4-f665-4214-9725-d2d4dbda3740 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:15.309519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9e008fd4-f665-4214-9725-d2d4dbda3740 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:15.337777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9e008fd4-f665-4214-9725-d2d4dbda3740 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041325 Sep 14 19:50:15.338326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 801/1567] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:15 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:15.554585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d9411fa0-da98-43a6-bf9b-df5a948243a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:15.555410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d9411fa0-da98-43a6-bf9b-df5a948243a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:15.561261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9411fa0-da98-43a6-bf9b-df5a948243a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:15.561743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9411fa0-da98-43a6-bf9b-df5a948243a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:15.562541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9411fa0-da98-43a6-bf9b-df5a948243a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:15.562978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9411fa0-da98-43a6-bf9b-df5a948243a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:15.591603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d9411fa0-da98-43a6-bf9b-df5a948243a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040883 Sep 14 19:50:15.592148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 767/1568] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:15 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:16.087572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-10fbb24f-ef2c-413f-a514-7eeb467c2e6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:16.088432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-10fbb24f-ef2c-413f-a514-7eeb467c2e6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:16.094366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10fbb24f-ef2c-413f-a514-7eeb467c2e6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:16.094901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10fbb24f-ef2c-413f-a514-7eeb467c2e6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:16.095670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10fbb24f-ef2c-413f-a514-7eeb467c2e6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:16.096149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10fbb24f-ef2c-413f-a514-7eeb467c2e6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:16.125284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-10fbb24f-ef2c-413f-a514-7eeb467c2e6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042155 Sep 14 19:50:16.125867 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 802/1569] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:16 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:16.234831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-26b7bf43-a015-4bc9-ad85-fd73586302f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:16.235424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-26b7bf43-a015-4bc9-ad85-fd73586302f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:16.241739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26b7bf43-a015-4bc9-ad85-fd73586302f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:16.242173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26b7bf43-a015-4bc9-ad85-fd73586302f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:16.242919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26b7bf43-a015-4bc9-ad85-fd73586302f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:16.243345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-26b7bf43-a015-4bc9-ad85-fd73586302f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:16.348075 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-47abde21-156b-4f3c-bca0-f954f06e936b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:16.349100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-47abde21-156b-4f3c-bca0-f954f06e936b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:16.354926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47abde21-156b-4f3c-bca0-f954f06e936b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:16.355442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47abde21-156b-4f3c-bca0-f954f06e936b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:16.356281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47abde21-156b-4f3c-bca0-f954f06e936b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:16.356784 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47abde21-156b-4f3c-bca0-f954f06e936b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:16.366015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-26b7bf43-a015-4bc9-ad85-fd73586302f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:16.373429 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-26b7bf43-a015-4bc9-ad85-fd73586302f9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142262 Sep 14 19:50:16.374025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 768/1570] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:16 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:16.387486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-47abde21-156b-4f3c-bca0-f954f06e936b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043192 Sep 14 19:50:16.388030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 803/1571] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:16 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:16.603557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-32911921-95df-4b3a-9e39-df27395ff3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:16.604381 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-32911921-95df-4b3a-9e39-df27395ff3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:16.610158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32911921-95df-4b3a-9e39-df27395ff3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:16.610593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32911921-95df-4b3a-9e39-df27395ff3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:16.611342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32911921-95df-4b3a-9e39-df27395ff3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:16.611768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32911921-95df-4b3a-9e39-df27395ff3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:16.641205 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-32911921-95df-4b3a-9e39-df27395ff3d6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Sep 14 19:50:16.641789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 769/1572] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:16 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:17.136242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6de57a22-2b39-44a8-ae21-63f2d819726e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:17.137145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6de57a22-2b39-44a8-ae21-63f2d819726e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:17.143096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6de57a22-2b39-44a8-ae21-63f2d819726e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:17.143490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6de57a22-2b39-44a8-ae21-63f2d819726e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:17.144262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6de57a22-2b39-44a8-ae21-63f2d819726e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:17.144707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6de57a22-2b39-44a8-ae21-63f2d819726e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:17.174844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6de57a22-2b39-44a8-ae21-63f2d819726e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042368 Sep 14 19:50:17.175393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 804/1573] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:17 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:17.390982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e632427d-ce20-415b-8b29-54467b7617db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:17.391605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e632427d-ce20-415b-8b29-54467b7617db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:17.398567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e632427d-ce20-415b-8b29-54467b7617db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:17.398938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e632427d-ce20-415b-8b29-54467b7617db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:17.399617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7d3b37ce-5905-4f15-81df-ad2a0a5be1ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:17.399765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e632427d-ce20-415b-8b29-54467b7617db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:17.400110 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e632427d-ce20-415b-8b29-54467b7617db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:17.400539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7d3b37ce-5905-4f15-81df-ad2a0a5be1ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:17.406335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d3b37ce-5905-4f15-81df-ad2a0a5be1ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:17.406787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d3b37ce-5905-4f15-81df-ad2a0a5be1ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:17.407561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d3b37ce-5905-4f15-81df-ad2a0a5be1ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:17.407992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d3b37ce-5905-4f15-81df-ad2a0a5be1ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:17.436823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7d3b37ce-5905-4f15-81df-ad2a0a5be1ef tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Sep 14 19:50:17.437396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 805/1574] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:17 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:17.519961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e632427d-ce20-415b-8b29-54467b7617db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:17.528198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e632427d-ce20-415b-8b29-54467b7617db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140865 Sep 14 19:50:17.528771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 770/1575] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:17 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:17.653195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8618b04d-f0fb-4633-a1d7-72b8fc41eae9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:17.654107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8618b04d-f0fb-4633-a1d7-72b8fc41eae9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:17.660006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8618b04d-f0fb-4633-a1d7-72b8fc41eae9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:17.660455 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8618b04d-f0fb-4633-a1d7-72b8fc41eae9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:17.661307 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8618b04d-f0fb-4633-a1d7-72b8fc41eae9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:17.661699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8618b04d-f0fb-4633-a1d7-72b8fc41eae9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:17.689756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8618b04d-f0fb-4633-a1d7-72b8fc41eae9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040322 Sep 14 19:50:17.690322 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 806/1576] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:17 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:18.186363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-944a2bf7-7f4d-49f6-a01e-7eeffdd62d8a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:18.187275 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-944a2bf7-7f4d-49f6-a01e-7eeffdd62d8a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:18.193019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-944a2bf7-7f4d-49f6-a01e-7eeffdd62d8a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:18.193511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-944a2bf7-7f4d-49f6-a01e-7eeffdd62d8a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:18.194358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-944a2bf7-7f4d-49f6-a01e-7eeffdd62d8a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:18.194720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-944a2bf7-7f4d-49f6-a01e-7eeffdd62d8a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:18.225947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-944a2bf7-7f4d-49f6-a01e-7eeffdd62d8a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043364 Sep 14 19:50:18.226641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 771/1577] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:18 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:18.448145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0034addf-e4ad-4f95-aadf-e77d5d3d6cbe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:18.449010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0034addf-e4ad-4f95-aadf-e77d5d3d6cbe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:18.454940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0034addf-e4ad-4f95-aadf-e77d5d3d6cbe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:18.455390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0034addf-e4ad-4f95-aadf-e77d5d3d6cbe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:18.456157 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0034addf-e4ad-4f95-aadf-e77d5d3d6cbe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:18.456594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0034addf-e4ad-4f95-aadf-e77d5d3d6cbe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:18.487288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0034addf-e4ad-4f95-aadf-e77d5d3d6cbe tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042938 Sep 14 19:50:18.487857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 807/1578] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:18 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:18.545363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c6a99003-0438-415f-af8a-c95511dabecd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:18.546001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c6a99003-0438-415f-af8a-c95511dabecd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:18.552151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6a99003-0438-415f-af8a-c95511dabecd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:18.552596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6a99003-0438-415f-af8a-c95511dabecd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:18.553363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6a99003-0438-415f-af8a-c95511dabecd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:18.553818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6a99003-0438-415f-af8a-c95511dabecd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:18.671988 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c6a99003-0438-415f-af8a-c95511dabecd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:18.679764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c6a99003-0438-415f-af8a-c95511dabecd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.138177 Sep 14 19:50:18.680328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 772/1579] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:18 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:18.701006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fbc7a94a-a972-4b3b-b302-3a2f3544ddc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:18.701882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fbc7a94a-a972-4b3b-b302-3a2f3544ddc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:18.707742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fbc7a94a-a972-4b3b-b302-3a2f3544ddc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:18.708189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fbc7a94a-a972-4b3b-b302-3a2f3544ddc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:18.709458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fbc7a94a-a972-4b3b-b302-3a2f3544ddc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:18.709928 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fbc7a94a-a972-4b3b-b302-3a2f3544ddc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:18.737935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fbc7a94a-a972-4b3b-b302-3a2f3544ddc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040699 Sep 14 19:50:18.738482 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 808/1580] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:18 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:19.237930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b295435b-b53b-462f-8573-0364fb953327 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:19.238833 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b295435b-b53b-462f-8573-0364fb953327 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:19.245274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b295435b-b53b-462f-8573-0364fb953327 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:19.245804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b295435b-b53b-462f-8573-0364fb953327 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:19.246562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b295435b-b53b-462f-8573-0364fb953327 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:19.247069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b295435b-b53b-462f-8573-0364fb953327 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:19.276996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b295435b-b53b-462f-8573-0364fb953327 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042783 Sep 14 19:50:19.277577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 773/1581] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:19.499047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-871adcd3-0a08-4378-a0a5-877a3d15d1e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:19.499918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-871adcd3-0a08-4378-a0a5-877a3d15d1e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:19.506536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-871adcd3-0a08-4378-a0a5-877a3d15d1e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:19.506985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-871adcd3-0a08-4378-a0a5-877a3d15d1e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:19.507754 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-871adcd3-0a08-4378-a0a5-877a3d15d1e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:19.508193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-871adcd3-0a08-4378-a0a5-877a3d15d1e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:19.537168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-871adcd3-0a08-4378-a0a5-877a3d15d1e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041934 Sep 14 19:50:19.537815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 809/1582] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:19.697392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-99e70e98-bd92-4ebf-8f58-3dd89e42c202 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:19.698045 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-99e70e98-bd92-4ebf-8f58-3dd89e42c202 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:19.704061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99e70e98-bd92-4ebf-8f58-3dd89e42c202 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:19.704529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99e70e98-bd92-4ebf-8f58-3dd89e42c202 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:19.705320 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99e70e98-bd92-4ebf-8f58-3dd89e42c202 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:19.705787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99e70e98-bd92-4ebf-8f58-3dd89e42c202 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:19.749457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d66ebdd0-0930-48d5-9e1d-8cfb6e8205e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:19.750454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d66ebdd0-0930-48d5-9e1d-8cfb6e8205e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:19.756875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d66ebdd0-0930-48d5-9e1d-8cfb6e8205e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:19.757303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d66ebdd0-0930-48d5-9e1d-8cfb6e8205e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:19.758103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d66ebdd0-0930-48d5-9e1d-8cfb6e8205e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:19.758540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d66ebdd0-0930-48d5-9e1d-8cfb6e8205e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:19.788713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d66ebdd0-0930-48d5-9e1d-8cfb6e8205e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043152 Sep 14 19:50:19.789282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 810/1583] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:19 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:19.829646 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-99e70e98-bd92-4ebf-8f58-3dd89e42c202 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:19.838139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-99e70e98-bd92-4ebf-8f58-3dd89e42c202 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143919 Sep 14 19:50:19.845297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 774/1584] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:19 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:20.288327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-47b927cd-807d-415f-962f-38b3103952f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:20.289438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-47b927cd-807d-415f-962f-38b3103952f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:20.295155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47b927cd-807d-415f-962f-38b3103952f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:20.295602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47b927cd-807d-415f-962f-38b3103952f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:20.296373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47b927cd-807d-415f-962f-38b3103952f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:20.296811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47b927cd-807d-415f-962f-38b3103952f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:20.326835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-47b927cd-807d-415f-962f-38b3103952f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042293 Sep 14 19:50:20.327310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 811/1585] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:20.548744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-12cdee0e-8265-43b1-9acf-c6e97e941949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:20.549742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-12cdee0e-8265-43b1-9acf-c6e97e941949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:20.555699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12cdee0e-8265-43b1-9acf-c6e97e941949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:20.558168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12cdee0e-8265-43b1-9acf-c6e97e941949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:20.558168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12cdee0e-8265-43b1-9acf-c6e97e941949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:20.558168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12cdee0e-8265-43b1-9acf-c6e97e941949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:20.586148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-12cdee0e-8265-43b1-9acf-c6e97e941949 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041402 Sep 14 19:50:20.586703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 775/1586] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:20 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:20.800532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-aba03a9a-1f7b-46c2-bbe1-857e09d3eef0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:20.801434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-aba03a9a-1f7b-46c2-bbe1-857e09d3eef0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:20.808106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aba03a9a-1f7b-46c2-bbe1-857e09d3eef0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:20.808585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aba03a9a-1f7b-46c2-bbe1-857e09d3eef0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:20.809377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aba03a9a-1f7b-46c2-bbe1-857e09d3eef0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:20.809843 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aba03a9a-1f7b-46c2-bbe1-857e09d3eef0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:20.839676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-aba03a9a-1f7b-46c2-bbe1-857e09d3eef0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042261 Sep 14 19:50:20.840248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 812/1587] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:20 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:20.861182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bc0fae85-3f50-4032-8175-905e126b68d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:20.861829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bc0fae85-3f50-4032-8175-905e126b68d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:20.868078 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc0fae85-3f50-4032-8175-905e126b68d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:20.868520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc0fae85-3f50-4032-8175-905e126b68d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:20.869327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc0fae85-3f50-4032-8175-905e126b68d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:20.869813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc0fae85-3f50-4032-8175-905e126b68d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:20.987496 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bc0fae85-3f50-4032-8175-905e126b68d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:20.995304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bc0fae85-3f50-4032-8175-905e126b68d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137712 Sep 14 19:50:20.995859 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 776/1588] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:20 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:21.338223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7719394b-58f6-4892-bddb-11bbf7011d77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:21.339112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7719394b-58f6-4892-bddb-11bbf7011d77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:21.344904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7719394b-58f6-4892-bddb-11bbf7011d77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:21.345297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7719394b-58f6-4892-bddb-11bbf7011d77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:21.346088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7719394b-58f6-4892-bddb-11bbf7011d77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:21.346519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7719394b-58f6-4892-bddb-11bbf7011d77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:21.375255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7719394b-58f6-4892-bddb-11bbf7011d77 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040833 Sep 14 19:50:21.375793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 813/1589] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:21 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:21.597665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fef8f792-0059-4fea-af05-f33d441d5bc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:21.598505 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fef8f792-0059-4fea-af05-f33d441d5bc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:21.604977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fef8f792-0059-4fea-af05-f33d441d5bc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:21.605431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fef8f792-0059-4fea-af05-f33d441d5bc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:21.606233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fef8f792-0059-4fea-af05-f33d441d5bc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:21.606668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fef8f792-0059-4fea-af05-f33d441d5bc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:21.635559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fef8f792-0059-4fea-af05-f33d441d5bc9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 Sep 14 19:50:21.636131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 777/1590] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:21 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:21.852040 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c5e7644f-6dfe-4d18-bb52-5bf206a198c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:21.852871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c5e7644f-6dfe-4d18-bb52-5bf206a198c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:21.859242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5e7644f-6dfe-4d18-bb52-5bf206a198c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:21.859684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5e7644f-6dfe-4d18-bb52-5bf206a198c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:21.860512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5e7644f-6dfe-4d18-bb52-5bf206a198c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:21.860946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c5e7644f-6dfe-4d18-bb52-5bf206a198c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:21.899226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c5e7644f-6dfe-4d18-bb52-5bf206a198c5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051682 Sep 14 19:50:21.899816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 814/1591] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:21 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:22.013546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f94d9793-e1ce-4629-bab6-235c66fc0267 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:22.014305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f94d9793-e1ce-4629-bab6-235c66fc0267 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:22.020211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f94d9793-e1ce-4629-bab6-235c66fc0267 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:22.020662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f94d9793-e1ce-4629-bab6-235c66fc0267 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:22.022061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f94d9793-e1ce-4629-bab6-235c66fc0267 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:22.022495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f94d9793-e1ce-4629-bab6-235c66fc0267 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:22.143212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f94d9793-e1ce-4629-bab6-235c66fc0267 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:22.151941 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f94d9793-e1ce-4629-bab6-235c66fc0267 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141270 Sep 14 19:50:22.155674 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 778/1592] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:22 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:22.387468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6166683f-179f-48eb-8c7b-c89d1675f2fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:22.388408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6166683f-179f-48eb-8c7b-c89d1675f2fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:22.394522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6166683f-179f-48eb-8c7b-c89d1675f2fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:22.394975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6166683f-179f-48eb-8c7b-c89d1675f2fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:22.395750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6166683f-179f-48eb-8c7b-c89d1675f2fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:22.396186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6166683f-179f-48eb-8c7b-c89d1675f2fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:22.425233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6166683f-179f-48eb-8c7b-c89d1675f2fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041536 Sep 14 19:50:22.425818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 815/1593] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:22 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:22.647115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a30eb2db-f704-413d-bede-ec9c21e0ed02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:22.647929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a30eb2db-f704-413d-bede-ec9c21e0ed02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:22.653700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a30eb2db-f704-413d-bede-ec9c21e0ed02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:22.654152 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a30eb2db-f704-413d-bede-ec9c21e0ed02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:22.654910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a30eb2db-f704-413d-bede-ec9c21e0ed02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:22.655347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a30eb2db-f704-413d-bede-ec9c21e0ed02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:22.684706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a30eb2db-f704-413d-bede-ec9c21e0ed02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041405 Sep 14 19:50:22.685257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 779/1594] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:22 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:22.910645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a5c3147e-fbc2-4e94-8e7d-6ccc55873489 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:22.911973 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a5c3147e-fbc2-4e94-8e7d-6ccc55873489 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:22.917744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5c3147e-fbc2-4e94-8e7d-6ccc55873489 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:22.918192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5c3147e-fbc2-4e94-8e7d-6ccc55873489 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:22.918955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5c3147e-fbc2-4e94-8e7d-6ccc55873489 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:22.919391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5c3147e-fbc2-4e94-8e7d-6ccc55873489 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:22.948174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a5c3147e-fbc2-4e94-8e7d-6ccc55873489 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 Sep 14 19:50:22.948729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 816/1595] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:22 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:23.168430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d757b06b-990d-4bc4-a4fd-3758e7e369a0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:23.168952 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d757b06b-990d-4bc4-a4fd-3758e7e369a0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:23.174991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d757b06b-990d-4bc4-a4fd-3758e7e369a0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:23.175435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d757b06b-990d-4bc4-a4fd-3758e7e369a0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:23.176189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d757b06b-990d-4bc4-a4fd-3758e7e369a0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:23.176619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d757b06b-990d-4bc4-a4fd-3758e7e369a0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:23.302628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d757b06b-990d-4bc4-a4fd-3758e7e369a0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:23.310107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d757b06b-990d-4bc4-a4fd-3758e7e369a0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.145355 Sep 14 19:50:23.310709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 780/1596] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:23 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:23.437301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-560de388-7b63-4706-ac32-864a9d2a2939 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:23.438153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-560de388-7b63-4706-ac32-864a9d2a2939 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:23.444558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-560de388-7b63-4706-ac32-864a9d2a2939 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:23.445006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-560de388-7b63-4706-ac32-864a9d2a2939 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:23.445804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-560de388-7b63-4706-ac32-864a9d2a2939 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:23.446245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-560de388-7b63-4706-ac32-864a9d2a2939 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:23.475048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-560de388-7b63-4706-ac32-864a9d2a2939 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041546 Sep 14 19:50:23.481238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 817/1597] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:23.696756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f3469bf5-c560-4f17-94c8-fcaaf2c66d15 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:23.697605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f3469bf5-c560-4f17-94c8-fcaaf2c66d15 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:23.703471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3469bf5-c560-4f17-94c8-fcaaf2c66d15 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:23.703918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3469bf5-c560-4f17-94c8-fcaaf2c66d15 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:23.704717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3469bf5-c560-4f17-94c8-fcaaf2c66d15 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:23.705146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f3469bf5-c560-4f17-94c8-fcaaf2c66d15 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:23.734594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f3469bf5-c560-4f17-94c8-fcaaf2c66d15 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042126 Sep 14 19:50:23.735123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 781/1598] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:23 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:23.959572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9a6a67fd-43d2-410e-b4e0-a2af8ac02295 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:23.960393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9a6a67fd-43d2-410e-b4e0-a2af8ac02295 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:23.966280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a6a67fd-43d2-410e-b4e0-a2af8ac02295 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:23.966732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a6a67fd-43d2-410e-b4e0-a2af8ac02295 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:23.967498 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a6a67fd-43d2-410e-b4e0-a2af8ac02295 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:23.967931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a6a67fd-43d2-410e-b4e0-a2af8ac02295 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:23.996580 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9a6a67fd-43d2-410e-b4e0-a2af8ac02295 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Sep 14 19:50:23.997130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 818/1599] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:23 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:24.326650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-809bd480-644b-48ea-93ea-d73faab4baec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:24.327288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-809bd480-644b-48ea-93ea-d73faab4baec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:24.333017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-809bd480-644b-48ea-93ea-d73faab4baec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:24.333556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-809bd480-644b-48ea-93ea-d73faab4baec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:24.334347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-809bd480-644b-48ea-93ea-d73faab4baec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:24.334780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-809bd480-644b-48ea-93ea-d73faab4baec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:24.451718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-809bd480-644b-48ea-93ea-d73faab4baec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:24.459077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-809bd480-644b-48ea-93ea-d73faab4baec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.136035 Sep 14 19:50:24.459633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 782/1600] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:24 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:24.491434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-91410d0b-ce40-41a2-8337-56670f2b3a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:24.492363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-91410d0b-ce40-41a2-8337-56670f2b3a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:24.498349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91410d0b-ce40-41a2-8337-56670f2b3a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:24.498802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91410d0b-ce40-41a2-8337-56670f2b3a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:24.499572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91410d0b-ce40-41a2-8337-56670f2b3a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:24.500011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91410d0b-ce40-41a2-8337-56670f2b3a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:24.529805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-91410d0b-ce40-41a2-8337-56670f2b3a0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042816 Sep 14 19:50:24.530371 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 819/1601] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:24.746130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1e25d6a6-49c9-476d-87d7-67dae82364b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:24.747029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1e25d6a6-49c9-476d-87d7-67dae82364b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:24.753431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e25d6a6-49c9-476d-87d7-67dae82364b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:24.753915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e25d6a6-49c9-476d-87d7-67dae82364b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:24.754675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e25d6a6-49c9-476d-87d7-67dae82364b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:24.755108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e25d6a6-49c9-476d-87d7-67dae82364b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:24.783673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1e25d6a6-49c9-476d-87d7-67dae82364b5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041326 Sep 14 19:50:24.784154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 783/1602] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:24 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:25.008693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-336a4e48-eb35-42cf-b453-3b3e1867428a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:25.009637 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-336a4e48-eb35-42cf-b453-3b3e1867428a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:25.015506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-336a4e48-eb35-42cf-b453-3b3e1867428a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:25.015956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-336a4e48-eb35-42cf-b453-3b3e1867428a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:25.016724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-336a4e48-eb35-42cf-b453-3b3e1867428a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:25.017164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-336a4e48-eb35-42cf-b453-3b3e1867428a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:25.046742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-336a4e48-eb35-42cf-b453-3b3e1867428a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042360 Sep 14 19:50:25.047219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 820/1603] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:25 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:25.476566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-add158bd-8108-495b-a776-1745591a1e65 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:25.477166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-add158bd-8108-495b-a776-1745591a1e65 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:25.483024 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-add158bd-8108-495b-a776-1745591a1e65 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:25.483468 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-add158bd-8108-495b-a776-1745591a1e65 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:25.484235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-add158bd-8108-495b-a776-1745591a1e65 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:25.484672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-add158bd-8108-495b-a776-1745591a1e65 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:25.540904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e110584a-60c6-4b05-92f0-f8e9053c2928 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:25.541831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e110584a-60c6-4b05-92f0-f8e9053c2928 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:25.547721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e110584a-60c6-4b05-92f0-f8e9053c2928 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:25.548421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e110584a-60c6-4b05-92f0-f8e9053c2928 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:25.549194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e110584a-60c6-4b05-92f0-f8e9053c2928 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:25.549671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e110584a-60c6-4b05-92f0-f8e9053c2928 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:25.579003 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e110584a-60c6-4b05-92f0-f8e9053c2928 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042534 Sep 14 19:50:25.579623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 821/1604] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:50:25.615526 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-add158bd-8108-495b-a776-1745591a1e65 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:25.622695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-add158bd-8108-495b-a776-1745591a1e65 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.150611 Sep 14 19:50:25.623254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 784/1605] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:25 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:25.796024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c1c399bf-7653-4fe2-8885-cbf2cab72f64 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:25.799573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c1c399bf-7653-4fe2-8885-cbf2cab72f64 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:25.803119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c399bf-7653-4fe2-8885-cbf2cab72f64 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:25.803566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c399bf-7653-4fe2-8885-cbf2cab72f64 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:25.804326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c399bf-7653-4fe2-8885-cbf2cab72f64 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:25.804757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c399bf-7653-4fe2-8885-cbf2cab72f64 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:25.834920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c1c399bf-7653-4fe2-8885-cbf2cab72f64 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042609 Sep 14 19:50:25.835396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 822/1606] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:25 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:26.059055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7cb9d9ba-20ab-47f7-953e-f6eed454acf9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:26.059964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7cb9d9ba-20ab-47f7-953e-f6eed454acf9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:26.065944 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7cb9d9ba-20ab-47f7-953e-f6eed454acf9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:26.066393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7cb9d9ba-20ab-47f7-953e-f6eed454acf9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:26.067156 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7cb9d9ba-20ab-47f7-953e-f6eed454acf9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:26.067590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7cb9d9ba-20ab-47f7-953e-f6eed454acf9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:26.097152 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7cb9d9ba-20ab-47f7-953e-f6eed454acf9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041798 Sep 14 19:50:26.097651 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 785/1607] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:26 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:26.590557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-389c6bb9-4071-4beb-bc3c-806d5d1898a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:26.591462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-389c6bb9-4071-4beb-bc3c-806d5d1898a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:26.593766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 19:50:26.598164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-389c6bb9-4071-4beb-bc3c-806d5d1898a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:26.598616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-389c6bb9-4071-4beb-bc3c-806d5d1898a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:26.599870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-389c6bb9-4071-4beb-bc3c-806d5d1898a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:26.600305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-389c6bb9-4071-4beb-bc3c-806d5d1898a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:26.629029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-389c6bb9-4071-4beb-bc3c-806d5d1898a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042261 Sep 14 19:50:26.629603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 823/1608] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:50:26.639638 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9e2b47a2-8eda-47b4-bd03-978ba99dd355 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:26.640237 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9e2b47a2-8eda-47b4-bd03-978ba99dd355 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:26.645918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2b47a2-8eda-47b4-bd03-978ba99dd355 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:26.646355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2b47a2-8eda-47b4-bd03-978ba99dd355 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:26.647106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2b47a2-8eda-47b4-bd03-978ba99dd355 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:26.647528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9e2b47a2-8eda-47b4-bd03-978ba99dd355 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:26.767995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9e2b47a2-8eda-47b4-bd03-978ba99dd355 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:26.776352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9e2b47a2-8eda-47b4-bd03-978ba99dd355 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140296 Sep 14 19:50:26.776913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 786/1609] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:26 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:26.846110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1e93bca1-aa2d-4ae3-ba69-4f0310fbfd54 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:26.847027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1e93bca1-aa2d-4ae3-ba69-4f0310fbfd54 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:26.853320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e93bca1-aa2d-4ae3-ba69-4f0310fbfd54 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:26.853811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e93bca1-aa2d-4ae3-ba69-4f0310fbfd54 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:26.854581 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e93bca1-aa2d-4ae3-ba69-4f0310fbfd54 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:26.855019 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e93bca1-aa2d-4ae3-ba69-4f0310fbfd54 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:26.882891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1e93bca1-aa2d-4ae3-ba69-4f0310fbfd54 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040451 Sep 14 19:50:26.883368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 824/1610] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:26 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:27.107682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1e55c6a6-d9a7-4906-85a3-0492113f49b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:27.108610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1e55c6a6-d9a7-4906-85a3-0492113f49b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:27.114517 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e55c6a6-d9a7-4906-85a3-0492113f49b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:27.114980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e55c6a6-d9a7-4906-85a3-0492113f49b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:27.115737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e55c6a6-d9a7-4906-85a3-0492113f49b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:27.116160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e55c6a6-d9a7-4906-85a3-0492113f49b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:27.144809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1e55c6a6-d9a7-4906-85a3-0492113f49b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040785 Sep 14 19:50:27.145290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 787/1611] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:27 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:27.640555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3018877c-82bc-4560-b4cc-2e7278801b99 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:27.641454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3018877c-82bc-4560-b4cc-2e7278801b99 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:27.658989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3018877c-82bc-4560-b4cc-2e7278801b99 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:27.659378 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3018877c-82bc-4560-b4cc-2e7278801b99 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:27.660151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3018877c-82bc-4560-b4cc-2e7278801b99 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:27.660589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3018877c-82bc-4560-b4cc-2e7278801b99 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:27.665665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 55596. Sep 14 19:50:27.691201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3018877c-82bc-4560-b4cc-2e7278801b99 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054456 Sep 14 19:50:27.691769 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 825/1612] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:27 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:27.790579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 19:50:27.793839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-31210847-7bd9-4d27-b515-cb64b9957012 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:27.794444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-31210847-7bd9-4d27-b515-cb64b9957012 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:27.800546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-31210847-7bd9-4d27-b515-cb64b9957012 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:27.800993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-31210847-7bd9-4d27-b515-cb64b9957012 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:27.801796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-31210847-7bd9-4d27-b515-cb64b9957012 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:27.802257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-31210847-7bd9-4d27-b515-cb64b9957012 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:27.895060 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c4f718c1-c2ce-4f8f-a0e8-aa9883784cee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:27.895971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c4f718c1-c2ce-4f8f-a0e8-aa9883784cee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:27.901672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4f718c1-c2ce-4f8f-a0e8-aa9883784cee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:27.902153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4f718c1-c2ce-4f8f-a0e8-aa9883784cee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:27.902933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4f718c1-c2ce-4f8f-a0e8-aa9883784cee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:27.903371 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4f718c1-c2ce-4f8f-a0e8-aa9883784cee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:27.921801 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-31210847-7bd9-4d27-b515-cb64b9957012 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:27.930068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-31210847-7bd9-4d27-b515-cb64b9957012 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140819 Sep 14 19:50:27.930639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 788/1613] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:27 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:27.934130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c4f718c1-c2ce-4f8f-a0e8-aa9883784cee tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042817 Sep 14 19:50:27.934685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 826/1614] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:27 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:28.156188 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-545799c6-684f-4107-b63f-af795f86484a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:28.157127 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-545799c6-684f-4107-b63f-af795f86484a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:28.163430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-545799c6-684f-4107-b63f-af795f86484a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:28.163864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-545799c6-684f-4107-b63f-af795f86484a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:28.164613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-545799c6-684f-4107-b63f-af795f86484a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:28.165038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-545799c6-684f-4107-b63f-af795f86484a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:28.193692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-545799c6-684f-4107-b63f-af795f86484a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041121 Sep 14 19:50:28.194168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 789/1615] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:28 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:28.702454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b1e5bc13-f9c9-4a0e-95d0-86524fcc1d97 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:28.703506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b1e5bc13-f9c9-4a0e-95d0-86524fcc1d97 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:28.710706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1e5bc13-f9c9-4a0e-95d0-86524fcc1d97 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:28.711080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1e5bc13-f9c9-4a0e-95d0-86524fcc1d97 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:28.711870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1e5bc13-f9c9-4a0e-95d0-86524fcc1d97 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:28.712306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1e5bc13-f9c9-4a0e-95d0-86524fcc1d97 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:28.742696 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b1e5bc13-f9c9-4a0e-95d0-86524fcc1d97 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043943 Sep 14 19:50:28.743261 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 827/1616] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:28 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:28.945813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a659cdde-fe14-4f98-a84f-63ee5823861a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:28.946746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a659cdde-fe14-4f98-a84f-63ee5823861a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:28.953267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3d5c1072-831f-4e75-beb5-b0bdf938c2d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:28.953977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3d5c1072-831f-4e75-beb5-b0bdf938c2d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:28.961446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d5c1072-831f-4e75-beb5-b0bdf938c2d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:28.961880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d5c1072-831f-4e75-beb5-b0bdf938c2d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:28.962667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d5c1072-831f-4e75-beb5-b0bdf938c2d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:28.963243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d5c1072-831f-4e75-beb5-b0bdf938c2d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:28.963703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a659cdde-fe14-4f98-a84f-63ee5823861a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:28.964148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a659cdde-fe14-4f98-a84f-63ee5823861a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:28.964906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a659cdde-fe14-4f98-a84f-63ee5823861a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:28.965329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a659cdde-fe14-4f98-a84f-63ee5823861a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:28.980467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 55616. Sep 14 19:50:28.996288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a659cdde-fe14-4f98-a84f-63ee5823861a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054359 Sep 14 19:50:28.996844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 790/1617] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:28 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:29.082756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3d5c1072-831f-4e75-beb5-b0bdf938c2d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:29.090914 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3d5c1072-831f-4e75-beb5-b0bdf938c2d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.147849 Sep 14 19:50:29.091488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 828/1618] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:28 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:50:29.205001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-65d0a962-3369-4659-9bd2-8470b7e6854e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:29.205967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-65d0a962-3369-4659-9bd2-8470b7e6854e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:29.212413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65d0a962-3369-4659-9bd2-8470b7e6854e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:29.212808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65d0a962-3369-4659-9bd2-8470b7e6854e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:29.213649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65d0a962-3369-4659-9bd2-8470b7e6854e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:29.214110 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-65d0a962-3369-4659-9bd2-8470b7e6854e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:29.243271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-65d0a962-3369-4659-9bd2-8470b7e6854e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042103 Sep 14 19:50:29.243824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 791/1619] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:29 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:29.754401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a8d02f92-7856-4f6e-8cf3-722e3471f140 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:29.755301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a8d02f92-7856-4f6e-8cf3-722e3471f140 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:29.762126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a8d02f92-7856-4f6e-8cf3-722e3471f140 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:29.762515 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a8d02f92-7856-4f6e-8cf3-722e3471f140 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:29.763281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a8d02f92-7856-4f6e-8cf3-722e3471f140 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:29.763713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a8d02f92-7856-4f6e-8cf3-722e3471f140 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:29.792196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a8d02f92-7856-4f6e-8cf3-722e3471f140 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041531 Sep 14 19:50:29.793070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 829/1620] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:29 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:30.008321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3348869b-0bd4-46a6-ae0f-373fd3440ef1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:30.009344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3348869b-0bd4-46a6-ae0f-373fd3440ef1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:30.015447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3348869b-0bd4-46a6-ae0f-373fd3440ef1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:30.015837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3348869b-0bd4-46a6-ae0f-373fd3440ef1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:30.016610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3348869b-0bd4-46a6-ae0f-373fd3440ef1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:30.017048 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3348869b-0bd4-46a6-ae0f-373fd3440ef1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:30.045445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3348869b-0bd4-46a6-ae0f-373fd3440ef1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041457 Sep 14 19:50:30.046031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 792/1621] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:30 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:30.108482 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4da2ff6a-f1a2-4de6-9a6d-aa2553bb03e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:30.109091 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4da2ff6a-f1a2-4de6-9a6d-aa2553bb03e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:30.115726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4da2ff6a-f1a2-4de6-9a6d-aa2553bb03e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:30.116186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4da2ff6a-f1a2-4de6-9a6d-aa2553bb03e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:30.117017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4da2ff6a-f1a2-4de6-9a6d-aa2553bb03e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:30.117457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4da2ff6a-f1a2-4de6-9a6d-aa2553bb03e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:30.241002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4da2ff6a-f1a2-4de6-9a6d-aa2553bb03e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:30.248427 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4da2ff6a-f1a2-4de6-9a6d-aa2553bb03e4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143720 Sep 14 19:50:30.249049 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 830/1622] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:30 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:30.254469 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0cfc8481-7936-46f6-8d03-8c666d4d6768 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:30.255372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0cfc8481-7936-46f6-8d03-8c666d4d6768 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:30.261282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0cfc8481-7936-46f6-8d03-8c666d4d6768 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:30.261764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0cfc8481-7936-46f6-8d03-8c666d4d6768 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:30.262539 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0cfc8481-7936-46f6-8d03-8c666d4d6768 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:30.262978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0cfc8481-7936-46f6-8d03-8c666d4d6768 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:30.292794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0cfc8481-7936-46f6-8d03-8c666d4d6768 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041921 Sep 14 19:50:30.293271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 793/1623] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:30 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:30.804276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d4908a54-d09f-4275-a279-b83aaa0624f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:30.805215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d4908a54-d09f-4275-a279-b83aaa0624f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:30.811281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4908a54-d09f-4275-a279-b83aaa0624f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:30.811562 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4908a54-d09f-4275-a279-b83aaa0624f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:30.812333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4908a54-d09f-4275-a279-b83aaa0624f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:30.812767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4908a54-d09f-4275-a279-b83aaa0624f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:30.841876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d4908a54-d09f-4275-a279-b83aaa0624f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041460 Sep 14 19:50:30.842425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 831/1624] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:30 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:31.057212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1df59128-9730-487f-a71e-0ff49fe4b60d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:31.058142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1df59128-9730-487f-a71e-0ff49fe4b60d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:31.063912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1df59128-9730-487f-a71e-0ff49fe4b60d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:31.064292 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1df59128-9730-487f-a71e-0ff49fe4b60d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:31.065041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1df59128-9730-487f-a71e-0ff49fe4b60d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:31.065464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1df59128-9730-487f-a71e-0ff49fe4b60d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:31.094057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1df59128-9730-487f-a71e-0ff49fe4b60d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040718 Sep 14 19:50:31.094592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 794/1625] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:31 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:31.265351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3898b9ba-7361-47da-a621-e87c656e2340 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:31.266010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3898b9ba-7361-47da-a621-e87c656e2340 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:31.275481 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3898b9ba-7361-47da-a621-e87c656e2340 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:31.276250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3898b9ba-7361-47da-a621-e87c656e2340 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:31.277658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3898b9ba-7361-47da-a621-e87c656e2340 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:31.278349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3898b9ba-7361-47da-a621-e87c656e2340 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:31.304970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-82cfbdfa-8049-408c-8b48-ef92971cd7ce tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:31.306068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-82cfbdfa-8049-408c-8b48-ef92971cd7ce tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:31.311906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-82cfbdfa-8049-408c-8b48-ef92971cd7ce tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:31.312357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-82cfbdfa-8049-408c-8b48-ef92971cd7ce tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:31.313141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-82cfbdfa-8049-408c-8b48-ef92971cd7ce tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:31.313636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-82cfbdfa-8049-408c-8b48-ef92971cd7ce tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:31.343401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-82cfbdfa-8049-408c-8b48-ef92971cd7ce tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042711 Sep 14 19:50:31.343887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 795/1626] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:31 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:31.399640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3898b9ba-7361-47da-a621-e87c656e2340 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:31.406838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3898b9ba-7361-47da-a621-e87c656e2340 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.145284 Sep 14 19:50:31.407388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 832/1627] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:31 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:31.852990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-767921f5-0931-4a69-b992-e11391e0f539 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:31.853916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-767921f5-0931-4a69-b992-e11391e0f539 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:31.859734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-767921f5-0931-4a69-b992-e11391e0f539 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:31.860174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-767921f5-0931-4a69-b992-e11391e0f539 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:31.860926 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-767921f5-0931-4a69-b992-e11391e0f539 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:31.861399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-767921f5-0931-4a69-b992-e11391e0f539 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:31.889734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-767921f5-0931-4a69-b992-e11391e0f539 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040941 Sep 14 19:50:31.890284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 796/1628] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:31 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:32.106703 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a41bcb2d-e35f-4216-9600-0254aac7e1de tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:32.107602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a41bcb2d-e35f-4216-9600-0254aac7e1de tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:32.113468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a41bcb2d-e35f-4216-9600-0254aac7e1de tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:32.113883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a41bcb2d-e35f-4216-9600-0254aac7e1de tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:32.114638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a41bcb2d-e35f-4216-9600-0254aac7e1de tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:32.115124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a41bcb2d-e35f-4216-9600-0254aac7e1de tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:32.144014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a41bcb2d-e35f-4216-9600-0254aac7e1de tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041025 Sep 14 19:50:32.144553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 833/1629] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:32 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:32.355431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5fb2a3c3-18d6-4b37-a721-6ec928c4eefb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:32.356330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5fb2a3c3-18d6-4b37-a721-6ec928c4eefb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:32.362311 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5fb2a3c3-18d6-4b37-a721-6ec928c4eefb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:32.362771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5fb2a3c3-18d6-4b37-a721-6ec928c4eefb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:32.363582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5fb2a3c3-18d6-4b37-a721-6ec928c4eefb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:32.363971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5fb2a3c3-18d6-4b37-a721-6ec928c4eefb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:32.392461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5fb2a3c3-18d6-4b37-a721-6ec928c4eefb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040991 Sep 14 19:50:32.393008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 797/1630] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:32 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:32.428213 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2c5e5117-25e2-4ad1-a3f5-10b1912805ad tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:32.428827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2c5e5117-25e2-4ad1-a3f5-10b1912805ad tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:32.434569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c5e5117-25e2-4ad1-a3f5-10b1912805ad tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:32.435009 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c5e5117-25e2-4ad1-a3f5-10b1912805ad tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:32.435765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c5e5117-25e2-4ad1-a3f5-10b1912805ad tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:32.436193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c5e5117-25e2-4ad1-a3f5-10b1912805ad tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:32.556303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2c5e5117-25e2-4ad1-a3f5-10b1912805ad tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:32.563570 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2c5e5117-25e2-4ad1-a3f5-10b1912805ad tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139004 Sep 14 19:50:32.564120 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 834/1631] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:32 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:32.768754 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:50:32.768941 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 19:50:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:50:32.901610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d6f99cb3-2ce1-4b6d-bd5c-5853cf366827 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:32.902538 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d6f99cb3-2ce1-4b6d-bd5c-5853cf366827 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:32.908458 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6f99cb3-2ce1-4b6d-bd5c-5853cf366827 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:32.908933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6f99cb3-2ce1-4b6d-bd5c-5853cf366827 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:32.909727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6f99cb3-2ce1-4b6d-bd5c-5853cf366827 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:32.910161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6f99cb3-2ce1-4b6d-bd5c-5853cf366827 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:32.940322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d6f99cb3-2ce1-4b6d-bd5c-5853cf366827 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042474 Sep 14 19:50:32.940806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 798/1632] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:32 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:33.155806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bdaaaed0-1300-43d9-8ad0-e42cc3a7fbf8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:33.156732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bdaaaed0-1300-43d9-8ad0-e42cc3a7fbf8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:33.163020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bdaaaed0-1300-43d9-8ad0-e42cc3a7fbf8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:33.163466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bdaaaed0-1300-43d9-8ad0-e42cc3a7fbf8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:33.164227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bdaaaed0-1300-43d9-8ad0-e42cc3a7fbf8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:33.164658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bdaaaed0-1300-43d9-8ad0-e42cc3a7fbf8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:33.193798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bdaaaed0-1300-43d9-8ad0-e42cc3a7fbf8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041563 Sep 14 19:50:33.194246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 835/1633] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:33 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:33.404174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6bb5e3ab-572d-4a35-8fb5-00076b7b55e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:33.405044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6bb5e3ab-572d-4a35-8fb5-00076b7b55e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:33.410923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6bb5e3ab-572d-4a35-8fb5-00076b7b55e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:33.411364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6bb5e3ab-572d-4a35-8fb5-00076b7b55e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:33.412114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6bb5e3ab-572d-4a35-8fb5-00076b7b55e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:33.413032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6bb5e3ab-572d-4a35-8fb5-00076b7b55e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:33.441464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6bb5e3ab-572d-4a35-8fb5-00076b7b55e7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041048 Sep 14 19:50:33.442018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 799/1634] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:33 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:33.579754 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5883cd09-100a-4ad0-826c-0169027b0486 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:33.580358 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5883cd09-100a-4ad0-826c-0169027b0486 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:33.586620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5883cd09-100a-4ad0-826c-0169027b0486 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:33.587066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5883cd09-100a-4ad0-826c-0169027b0486 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:33.587829 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5883cd09-100a-4ad0-826c-0169027b0486 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:33.588290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5883cd09-100a-4ad0-826c-0169027b0486 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:33.708399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5883cd09-100a-4ad0-826c-0169027b0486 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:33.717518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5883cd09-100a-4ad0-826c-0169027b0486 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141303 Sep 14 19:50:33.718099 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 836/1635] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:33 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:33.952220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-42f2baa0-aa23-4e02-8879-5a1daefac775 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:33.953098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-42f2baa0-aa23-4e02-8879-5a1daefac775 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:33.958853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-42f2baa0-aa23-4e02-8879-5a1daefac775 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:33.959962 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-42f2baa0-aa23-4e02-8879-5a1daefac775 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:33.960722 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-42f2baa0-aa23-4e02-8879-5a1daefac775 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:33.961144 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-42f2baa0-aa23-4e02-8879-5a1daefac775 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:33.988678 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-42f2baa0-aa23-4e02-8879-5a1daefac775 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040222 Sep 14 19:50:33.989220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 800/1636] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:33 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:34.205226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-69d46649-0ea9-47a4-b643-afab5034210f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:34.206157 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-69d46649-0ea9-47a4-b643-afab5034210f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:34.212727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-69d46649-0ea9-47a4-b643-afab5034210f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:34.213173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-69d46649-0ea9-47a4-b643-afab5034210f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:34.213981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-69d46649-0ea9-47a4-b643-afab5034210f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:34.214417 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-69d46649-0ea9-47a4-b643-afab5034210f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:34.242935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-69d46649-0ea9-47a4-b643-afab5034210f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041478 Sep 14 19:50:34.243477 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 837/1637] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:34 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:34.452104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d9b14c5e-1a2c-445d-9d42-845c31ab0f79 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:34.453014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d9b14c5e-1a2c-445d-9d42-845c31ab0f79 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:34.458905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9b14c5e-1a2c-445d-9d42-845c31ab0f79 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:34.459298 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9b14c5e-1a2c-445d-9d42-845c31ab0f79 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:34.460069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9b14c5e-1a2c-445d-9d42-845c31ab0f79 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:34.460501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9b14c5e-1a2c-445d-9d42-845c31ab0f79 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:34.488293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d9b14c5e-1a2c-445d-9d42-845c31ab0f79 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040020 Sep 14 19:50:34.488856 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 801/1638] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:34 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:34.735523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-26216239-ba18-4929-befe-d7fe36fb3467 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:34.736069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-26216239-ba18-4929-befe-d7fe36fb3467 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:34.741842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26216239-ba18-4929-befe-d7fe36fb3467 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:34.742282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26216239-ba18-4929-befe-d7fe36fb3467 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:34.743036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26216239-ba18-4929-befe-d7fe36fb3467 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:34.743461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26216239-ba18-4929-befe-d7fe36fb3467 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:34.863541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-26216239-ba18-4929-befe-d7fe36fb3467 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:34.871298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-26216239-ba18-4929-befe-d7fe36fb3467 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139513 Sep 14 19:50:34.871862 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 838/1639] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:34 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:35.000321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ce037411-3458-4949-a1ff-3b552eed1033 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:35.001160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ce037411-3458-4949-a1ff-3b552eed1033 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:35.007710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce037411-3458-4949-a1ff-3b552eed1033 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:35.008154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce037411-3458-4949-a1ff-3b552eed1033 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:35.008916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce037411-3458-4949-a1ff-3b552eed1033 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:35.009352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce037411-3458-4949-a1ff-3b552eed1033 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:35.037570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ce037411-3458-4949-a1ff-3b552eed1033 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041103 Sep 14 19:50:35.038118 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 802/1640] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:34 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:35.254665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2dac6d57-e93b-4316-955d-b5f604799dce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:35.255528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2dac6d57-e93b-4316-955d-b5f604799dce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:35.262226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2dac6d57-e93b-4316-955d-b5f604799dce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:35.262668 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2dac6d57-e93b-4316-955d-b5f604799dce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:35.263446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2dac6d57-e93b-4316-955d-b5f604799dce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:35.263878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2dac6d57-e93b-4316-955d-b5f604799dce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:35.292797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2dac6d57-e93b-4316-955d-b5f604799dce tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042206 Sep 14 19:50:35.293338 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 839/1641] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:35 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:35.500254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5f0c2995-5cd8-4efe-95db-e576d77c7f11 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:35.501196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5f0c2995-5cd8-4efe-95db-e576d77c7f11 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:35.507370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f0c2995-5cd8-4efe-95db-e576d77c7f11 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:35.507760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f0c2995-5cd8-4efe-95db-e576d77c7f11 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:35.508524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f0c2995-5cd8-4efe-95db-e576d77c7f11 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:35.508956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f0c2995-5cd8-4efe-95db-e576d77c7f11 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:35.536797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5f0c2995-5cd8-4efe-95db-e576d77c7f11 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040399 Sep 14 19:50:35.537885 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 803/1642] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:35 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:35.887623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9de169a8-a534-4f43-894d-ae6fff8f8b3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:35.888234 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9de169a8-a534-4f43-894d-ae6fff8f8b3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:35.893975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9de169a8-a534-4f43-894d-ae6fff8f8b3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:35.894417 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9de169a8-a534-4f43-894d-ae6fff8f8b3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:35.895169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9de169a8-a534-4f43-894d-ae6fff8f8b3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:35.895595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9de169a8-a534-4f43-894d-ae6fff8f8b3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:36.013778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9de169a8-a534-4f43-894d-ae6fff8f8b3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:36.021249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9de169a8-a534-4f43-894d-ae6fff8f8b3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137228 Sep 14 19:50:36.022337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 840/1643] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:35 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:36.048792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6ba38d2b-bb4e-492f-8cd0-70d51fe23c67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:36.049719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6ba38d2b-bb4e-492f-8cd0-70d51fe23c67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:36.055507 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba38d2b-bb4e-492f-8cd0-70d51fe23c67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:36.055952 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba38d2b-bb4e-492f-8cd0-70d51fe23c67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:36.056710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba38d2b-bb4e-492f-8cd0-70d51fe23c67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:36.057140 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ba38d2b-bb4e-492f-8cd0-70d51fe23c67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:36.086186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6ba38d2b-bb4e-492f-8cd0-70d51fe23c67 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041356 Sep 14 19:50:36.086663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 804/1644] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:36 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:36.304671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e2c0bb56-78d6-42b7-a476-baffd2aa8863 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:36.305637 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e2c0bb56-78d6-42b7-a476-baffd2aa8863 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:36.311496 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e2c0bb56-78d6-42b7-a476-baffd2aa8863 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:36.311947 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e2c0bb56-78d6-42b7-a476-baffd2aa8863 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:36.312732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e2c0bb56-78d6-42b7-a476-baffd2aa8863 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:36.313169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e2c0bb56-78d6-42b7-a476-baffd2aa8863 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:36.342492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e2c0bb56-78d6-42b7-a476-baffd2aa8863 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 Sep 14 19:50:36.342950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 841/1645] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:36 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:36.549018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1c620009-247d-4e51-bf69-fd61d8a9cf86 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:36.549953 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1c620009-247d-4e51-bf69-fd61d8a9cf86 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:36.556271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c620009-247d-4e51-bf69-fd61d8a9cf86 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:36.556719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c620009-247d-4e51-bf69-fd61d8a9cf86 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:36.557488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c620009-247d-4e51-bf69-fd61d8a9cf86 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:36.557950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c620009-247d-4e51-bf69-fd61d8a9cf86 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:36.586397 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1c620009-247d-4e51-bf69-fd61d8a9cf86 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 Sep 14 19:50:36.586956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 805/1646] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:36 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:37.039071 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2154653b-6db4-4af9-8731-2a96a673db3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:37.039608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2154653b-6db4-4af9-8731-2a96a673db3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:37.045637 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2154653b-6db4-4af9-8731-2a96a673db3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:37.046089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2154653b-6db4-4af9-8731-2a96a673db3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:37.046911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2154653b-6db4-4af9-8731-2a96a673db3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:37.047351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2154653b-6db4-4af9-8731-2a96a673db3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:37.097927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2d225e8a-b40a-45f9-bcbf-5a6b4eaf7225 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:37.098933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2d225e8a-b40a-45f9-bcbf-5a6b4eaf7225 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:37.106099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d225e8a-b40a-45f9-bcbf-5a6b4eaf7225 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:37.106637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d225e8a-b40a-45f9-bcbf-5a6b4eaf7225 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:37.107423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d225e8a-b40a-45f9-bcbf-5a6b4eaf7225 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:37.107860 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d225e8a-b40a-45f9-bcbf-5a6b4eaf7225 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:37.138240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2d225e8a-b40a-45f9-bcbf-5a6b4eaf7225 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044220 Sep 14 19:50:37.138822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 806/1647] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:50:37.176833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2154653b-6db4-4af9-8731-2a96a673db3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:37.185534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2154653b-6db4-4af9-8731-2a96a673db3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.150728 Sep 14 19:50:37.186115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 842/1648] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:37 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:37.354562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b12055b1-5d70-48be-b1cc-e7d2150dd209 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:37.355412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b12055b1-5d70-48be-b1cc-e7d2150dd209 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:37.361274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b12055b1-5d70-48be-b1cc-e7d2150dd209 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:37.361757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b12055b1-5d70-48be-b1cc-e7d2150dd209 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:37.362532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b12055b1-5d70-48be-b1cc-e7d2150dd209 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:37.363011 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b12055b1-5d70-48be-b1cc-e7d2150dd209 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:37.392531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b12055b1-5d70-48be-b1cc-e7d2150dd209 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042337 Sep 14 19:50:37.393098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 807/1649] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:37 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:37.597951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f93436bb-786a-4160-a5fa-2dd7777377fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:37.598860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f93436bb-786a-4160-a5fa-2dd7777377fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:37.604838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f93436bb-786a-4160-a5fa-2dd7777377fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:37.605220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f93436bb-786a-4160-a5fa-2dd7777377fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:37.606060 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f93436bb-786a-4160-a5fa-2dd7777377fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:37.606497 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f93436bb-786a-4160-a5fa-2dd7777377fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:37.635796 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f93436bb-786a-4160-a5fa-2dd7777377fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041642 Sep 14 19:50:37.636478 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 843/1650] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:37 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:38.149959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c8ad07f8-00bc-4f88-b721-10727a3274fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:38.150895 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c8ad07f8-00bc-4f88-b721-10727a3274fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:38.156912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c8ad07f8-00bc-4f88-b721-10727a3274fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:38.157403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c8ad07f8-00bc-4f88-b721-10727a3274fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:38.158200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c8ad07f8-00bc-4f88-b721-10727a3274fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:38.158635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c8ad07f8-00bc-4f88-b721-10727a3274fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:38.188916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c8ad07f8-00bc-4f88-b721-10727a3274fc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042674 Sep 14 19:50:38.189368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 808/1651] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:38 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:38.202460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8c1d87b6-1fbb-49ec-9a58-d91adfefeea1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:38.203119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8c1d87b6-1fbb-49ec-9a58-d91adfefeea1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:38.208975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c1d87b6-1fbb-49ec-9a58-d91adfefeea1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:38.209420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c1d87b6-1fbb-49ec-9a58-d91adfefeea1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:38.217269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c1d87b6-1fbb-49ec-9a58-d91adfefeea1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:38.217269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c1d87b6-1fbb-49ec-9a58-d91adfefeea1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:38.334445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8c1d87b6-1fbb-49ec-9a58-d91adfefeea1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:38.342036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8c1d87b6-1fbb-49ec-9a58-d91adfefeea1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143278 Sep 14 19:50:38.342679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 844/1652] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:38 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:38.404493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2b501481-4ad9-4a2a-a4bf-bd55811fd41d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:38.405396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2b501481-4ad9-4a2a-a4bf-bd55811fd41d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:38.411782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b501481-4ad9-4a2a-a4bf-bd55811fd41d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:38.411782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b501481-4ad9-4a2a-a4bf-bd55811fd41d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:38.412923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b501481-4ad9-4a2a-a4bf-bd55811fd41d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:38.413360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b501481-4ad9-4a2a-a4bf-bd55811fd41d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:38.442351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2b501481-4ad9-4a2a-a4bf-bd55811fd41d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041499 Sep 14 19:50:38.442826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 809/1653] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:38 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:38.646360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-98d43018-93d4-44cf-ae26-7c349e89a4bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:38.647883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-98d43018-93d4-44cf-ae26-7c349e89a4bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:38.653716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98d43018-93d4-44cf-ae26-7c349e89a4bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:38.654171 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98d43018-93d4-44cf-ae26-7c349e89a4bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:38.654945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98d43018-93d4-44cf-ae26-7c349e89a4bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:38.655411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98d43018-93d4-44cf-ae26-7c349e89a4bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:38.683503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-98d43018-93d4-44cf-ae26-7c349e89a4bf tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040881 Sep 14 19:50:38.684054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 845/1654] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:38 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:39.200818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-71309b1d-bdb0-497e-8bb6-e5fd55d4322b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:39.201741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-71309b1d-bdb0-497e-8bb6-e5fd55d4322b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:39.207483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71309b1d-bdb0-497e-8bb6-e5fd55d4322b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:39.207926 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71309b1d-bdb0-497e-8bb6-e5fd55d4322b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:39.208704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71309b1d-bdb0-497e-8bb6-e5fd55d4322b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:39.209154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-71309b1d-bdb0-497e-8bb6-e5fd55d4322b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:39.237431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-71309b1d-bdb0-497e-8bb6-e5fd55d4322b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040435 Sep 14 19:50:39.238004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 810/1655] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:39 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:39.360177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-abd2577d-561e-42ab-b2b6-389c40aeeeaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:39.360786 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-abd2577d-561e-42ab-b2b6-389c40aeeeaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:39.367396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-abd2577d-561e-42ab-b2b6-389c40aeeeaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:39.367865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-abd2577d-561e-42ab-b2b6-389c40aeeeaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:39.368614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-abd2577d-561e-42ab-b2b6-389c40aeeeaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:39.369053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-abd2577d-561e-42ab-b2b6-389c40aeeeaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:39.454865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8d781ef6-e5b7-4fd9-8f60-f0ad2f3db58c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:39.456406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8d781ef6-e5b7-4fd9-8f60-f0ad2f3db58c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:39.463458 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d781ef6-e5b7-4fd9-8f60-f0ad2f3db58c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:39.463897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d781ef6-e5b7-4fd9-8f60-f0ad2f3db58c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:39.464656 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d781ef6-e5b7-4fd9-8f60-f0ad2f3db58c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:39.465090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d781ef6-e5b7-4fd9-8f60-f0ad2f3db58c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:39.492466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-abd2577d-561e-42ab-b2b6-389c40aeeeaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:39.495074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8d781ef6-e5b7-4fd9-8f60-f0ad2f3db58c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044053 Sep 14 19:50:39.495635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 811/1656] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:39 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:39.499997 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-abd2577d-561e-42ab-b2b6-389c40aeeeaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143572 Sep 14 19:50:39.500548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 846/1657] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:39 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:50:39.695112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e3200932-40df-4664-b2eb-97a1856c14f1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:39.696035 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e3200932-40df-4664-b2eb-97a1856c14f1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:39.701808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e3200932-40df-4664-b2eb-97a1856c14f1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:39.702251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e3200932-40df-4664-b2eb-97a1856c14f1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:39.703007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e3200932-40df-4664-b2eb-97a1856c14f1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:39.703430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e3200932-40df-4664-b2eb-97a1856c14f1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:39.733836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e3200932-40df-4664-b2eb-97a1856c14f1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041049 Sep 14 19:50:39.733836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 812/1658] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:39 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:40.250321 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-10ff9a45-6346-465d-abdd-1a7a25dce9b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:40.251221 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-10ff9a45-6346-465d-abdd-1a7a25dce9b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:40.257032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10ff9a45-6346-465d-abdd-1a7a25dce9b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:40.257484 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10ff9a45-6346-465d-abdd-1a7a25dce9b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:40.258289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10ff9a45-6346-465d-abdd-1a7a25dce9b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:40.259362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10ff9a45-6346-465d-abdd-1a7a25dce9b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:40.290580 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-10ff9a45-6346-465d-abdd-1a7a25dce9b4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043042 Sep 14 19:50:40.290580 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 847/1659] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:40.506474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-96e29df7-05b0-4c05-b58f-6c206b5293ad tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:40.507380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-96e29df7-05b0-4c05-b58f-6c206b5293ad tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:40.513951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-96e29df7-05b0-4c05-b58f-6c206b5293ad tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:40.514403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-96e29df7-05b0-4c05-b58f-6c206b5293ad tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:40.515180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-96e29df7-05b0-4c05-b58f-6c206b5293ad tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:40.515619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-96e29df7-05b0-4c05-b58f-6c206b5293ad tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:40.516435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-888c0910-1b76-4dec-9f39-b9cbbb8365c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:40.517071 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-888c0910-1b76-4dec-9f39-b9cbbb8365c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:40.522791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-888c0910-1b76-4dec-9f39-b9cbbb8365c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:40.523229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-888c0910-1b76-4dec-9f39-b9cbbb8365c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:40.523989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-888c0910-1b76-4dec-9f39-b9cbbb8365c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:40.524419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-888c0910-1b76-4dec-9f39-b9cbbb8365c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:40.545144 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-96e29df7-05b0-4c05-b58f-6c206b5293ad tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042438 Sep 14 19:50:40.545648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 813/1660] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:40 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:40.658558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-888c0910-1b76-4dec-9f39-b9cbbb8365c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:40.667961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-888c0910-1b76-4dec-9f39-b9cbbb8365c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.154980 Sep 14 19:50:40.669006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 848/1661] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:40 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:50:40.744360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-99234417-92f3-402c-8031-c892ed4148df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:40.745617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-99234417-92f3-402c-8031-c892ed4148df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:40.751540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99234417-92f3-402c-8031-c892ed4148df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:40.752215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99234417-92f3-402c-8031-c892ed4148df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:40.753236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99234417-92f3-402c-8031-c892ed4148df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:40.753676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-99234417-92f3-402c-8031-c892ed4148df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:40.783766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-99234417-92f3-402c-8031-c892ed4148df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044702 Sep 14 19:50:40.784331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 814/1662] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:40 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:41.301907 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-32c9fcd8-92c3-49f1-8337-2f91e3a6459f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:41.302819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-32c9fcd8-92c3-49f1-8337-2f91e3a6459f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:41.312339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-32c9fcd8-92c3-49f1-8337-2f91e3a6459f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:41.312786 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-32c9fcd8-92c3-49f1-8337-2f91e3a6459f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:41.313724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-32c9fcd8-92c3-49f1-8337-2f91e3a6459f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:41.314280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-32c9fcd8-92c3-49f1-8337-2f91e3a6459f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:41.345777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-32c9fcd8-92c3-49f1-8337-2f91e3a6459f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048041 Sep 14 19:50:41.346250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 849/1663] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:41 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:41.556807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f0e00298-4a14-46d5-bfbb-242b617ab749 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:41.557766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f0e00298-4a14-46d5-bfbb-242b617ab749 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:41.563552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f0e00298-4a14-46d5-bfbb-242b617ab749 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:41.563996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f0e00298-4a14-46d5-bfbb-242b617ab749 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:41.564750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f0e00298-4a14-46d5-bfbb-242b617ab749 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:41.565246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f0e00298-4a14-46d5-bfbb-242b617ab749 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:41.593992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f0e00298-4a14-46d5-bfbb-242b617ab749 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040875 Sep 14 19:50:41.594531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 815/1664] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:41 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:41.685179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8f14bb6e-f518-43ef-a6ba-9b9e3b2529ef tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:41.685808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8f14bb6e-f518-43ef-a6ba-9b9e3b2529ef tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:41.691583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f14bb6e-f518-43ef-a6ba-9b9e3b2529ef tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:41.692038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f14bb6e-f518-43ef-a6ba-9b9e3b2529ef tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:41.692809 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f14bb6e-f518-43ef-a6ba-9b9e3b2529ef tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:41.693242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8f14bb6e-f518-43ef-a6ba-9b9e3b2529ef tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:41.795498 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d595be6e-571e-4cd7-a1d8-7411934feae7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:41.796015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d595be6e-571e-4cd7-a1d8-7411934feae7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:41.802042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d595be6e-571e-4cd7-a1d8-7411934feae7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:41.802494 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d595be6e-571e-4cd7-a1d8-7411934feae7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:41.803268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d595be6e-571e-4cd7-a1d8-7411934feae7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:41.803700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d595be6e-571e-4cd7-a1d8-7411934feae7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:41.812802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8f14bb6e-f518-43ef-a6ba-9b9e3b2529ef tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:41.820198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8f14bb6e-f518-43ef-a6ba-9b9e3b2529ef tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.138616 Sep 14 19:50:41.820762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 850/1665] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:41 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:41.833588 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d595be6e-571e-4cd7-a1d8-7411934feae7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 Sep 14 19:50:41.834193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 816/1666] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:41 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:42.357772 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-588aa746-2412-4c22-a3aa-679b8f04cb25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:42.358666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-588aa746-2412-4c22-a3aa-679b8f04cb25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:42.364515 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-588aa746-2412-4c22-a3aa-679b8f04cb25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:42.364960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-588aa746-2412-4c22-a3aa-679b8f04cb25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:42.365910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-588aa746-2412-4c22-a3aa-679b8f04cb25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:42.366352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-588aa746-2412-4c22-a3aa-679b8f04cb25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:42.395341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-588aa746-2412-4c22-a3aa-679b8f04cb25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041443 Sep 14 19:50:42.395870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 851/1667] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:42 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:50:42.606055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e7926a3b-03bd-4c1b-bdab-63a1f2135666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:42.607047 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e7926a3b-03bd-4c1b-bdab-63a1f2135666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:42.612915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7926a3b-03bd-4c1b-bdab-63a1f2135666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:42.613364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7926a3b-03bd-4c1b-bdab-63a1f2135666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:42.614205 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7926a3b-03bd-4c1b-bdab-63a1f2135666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:42.614642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7926a3b-03bd-4c1b-bdab-63a1f2135666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:42.643006 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e7926a3b-03bd-4c1b-bdab-63a1f2135666 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041302 Sep 14 19:50:42.643559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 817/1668] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:42 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:42.838092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a173c169-3743-48b8-bf90-2a8117640243 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:42.838733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a173c169-3743-48b8-bf90-2a8117640243 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:42.844064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-36b5ac07-9c17-4987-8141-adbec16db942 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:42.844847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a173c169-3743-48b8-bf90-2a8117640243 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:42.845114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-36b5ac07-9c17-4987-8141-adbec16db942 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:42.845289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a173c169-3743-48b8-bf90-2a8117640243 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:42.846076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a173c169-3743-48b8-bf90-2a8117640243 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:42.846503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a173c169-3743-48b8-bf90-2a8117640243 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:42.851076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36b5ac07-9c17-4987-8141-adbec16db942 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:42.851604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36b5ac07-9c17-4987-8141-adbec16db942 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:42.852381 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36b5ac07-9c17-4987-8141-adbec16db942 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:42.852817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36b5ac07-9c17-4987-8141-adbec16db942 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:42.881448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-36b5ac07-9c17-4987-8141-adbec16db942 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041061 Sep 14 19:50:42.882036 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 818/1669] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:42 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:42.963458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a173c169-3743-48b8-bf90-2a8117640243 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:42.970733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a173c169-3743-48b8-bf90-2a8117640243 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.136960 Sep 14 19:50:42.971298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 852/1670] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:42 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:43.407439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ed5fa3db-7908-4a6e-8307-40c15d7941cc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:43.408334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ed5fa3db-7908-4a6e-8307-40c15d7941cc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:43.414291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed5fa3db-7908-4a6e-8307-40c15d7941cc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:43.414730 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed5fa3db-7908-4a6e-8307-40c15d7941cc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:43.415481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed5fa3db-7908-4a6e-8307-40c15d7941cc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:43.415906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed5fa3db-7908-4a6e-8307-40c15d7941cc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:43.444772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ed5fa3db-7908-4a6e-8307-40c15d7941cc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041010 Sep 14 19:50:43.445237 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 819/1671] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:43.653975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-03b00934-da96-477c-93d6-b6cafb76aba7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:43.654882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-03b00934-da96-477c-93d6-b6cafb76aba7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:43.660873 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03b00934-da96-477c-93d6-b6cafb76aba7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:43.661326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03b00934-da96-477c-93d6-b6cafb76aba7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:43.662131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03b00934-da96-477c-93d6-b6cafb76aba7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:43.662578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03b00934-da96-477c-93d6-b6cafb76aba7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:43.693104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-03b00934-da96-477c-93d6-b6cafb76aba7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Sep 14 19:50:43.693717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 853/1672] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:43 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:43.893354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-14d1cfe1-c26e-4f7a-be1f-ab42cadf40fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:43.894334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-14d1cfe1-c26e-4f7a-be1f-ab42cadf40fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:43.900716 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14d1cfe1-c26e-4f7a-be1f-ab42cadf40fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:43.901162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14d1cfe1-c26e-4f7a-be1f-ab42cadf40fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:43.901950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14d1cfe1-c26e-4f7a-be1f-ab42cadf40fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:43.902417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14d1cfe1-c26e-4f7a-be1f-ab42cadf40fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:43.931050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-14d1cfe1-c26e-4f7a-be1f-ab42cadf40fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041433 Sep 14 19:50:43.931602 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 820/1673] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:43 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:43.987227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2cfdd917-6ba1-4318-ae43-5c6a1ad361c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:43.987902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2cfdd917-6ba1-4318-ae43-5c6a1ad361c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:43.993776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2cfdd917-6ba1-4318-ae43-5c6a1ad361c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:43.994228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2cfdd917-6ba1-4318-ae43-5c6a1ad361c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:43.995001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2cfdd917-6ba1-4318-ae43-5c6a1ad361c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:43.995461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2cfdd917-6ba1-4318-ae43-5c6a1ad361c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:44.117858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2cfdd917-6ba1-4318-ae43-5c6a1ad361c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:44.125148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2cfdd917-6ba1-4318-ae43-5c6a1ad361c7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141591 Sep 14 19:50:44.125738 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 854/1674] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:43 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:44.456197 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-46a46fc4-71bd-471f-953c-93caf76d4181 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:44.457126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-46a46fc4-71bd-471f-953c-93caf76d4181 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:44.463554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-46a46fc4-71bd-471f-953c-93caf76d4181 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:44.464001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-46a46fc4-71bd-471f-953c-93caf76d4181 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:44.464765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-46a46fc4-71bd-471f-953c-93caf76d4181 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:44.465199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-46a46fc4-71bd-471f-953c-93caf76d4181 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:44.493482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-46a46fc4-71bd-471f-953c-93caf76d4181 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041075 Sep 14 19:50:44.494073 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 821/1675] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:44.704223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-46586a7b-8a7f-4779-81c0-c44c40ea4b11 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:44.705043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-46586a7b-8a7f-4779-81c0-c44c40ea4b11 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:44.711172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46586a7b-8a7f-4779-81c0-c44c40ea4b11 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:44.711860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46586a7b-8a7f-4779-81c0-c44c40ea4b11 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:44.712648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46586a7b-8a7f-4779-81c0-c44c40ea4b11 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:44.713084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46586a7b-8a7f-4779-81c0-c44c40ea4b11 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:44.743288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-46586a7b-8a7f-4779-81c0-c44c40ea4b11 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042265 Sep 14 19:50:44.743848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 855/1676] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:44 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:44.942594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9634104a-d3a5-4eee-afb9-763a4253dde0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:44.943506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9634104a-d3a5-4eee-afb9-763a4253dde0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:44.950058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9634104a-d3a5-4eee-afb9-763a4253dde0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:44.950509 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9634104a-d3a5-4eee-afb9-763a4253dde0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:44.951305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9634104a-d3a5-4eee-afb9-763a4253dde0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:44.951734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9634104a-d3a5-4eee-afb9-763a4253dde0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:44.980043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9634104a-d3a5-4eee-afb9-763a4253dde0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041161 Sep 14 19:50:44.980525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 822/1677] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:44 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:45.141702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-00b5a81c-fdc5-4242-8a60-8321f7f769d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:45.142313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-00b5a81c-fdc5-4242-8a60-8321f7f769d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:45.148180 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00b5a81c-fdc5-4242-8a60-8321f7f769d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:45.148628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00b5a81c-fdc5-4242-8a60-8321f7f769d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:45.149397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00b5a81c-fdc5-4242-8a60-8321f7f769d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:45.149864 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00b5a81c-fdc5-4242-8a60-8321f7f769d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:45.272505 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-00b5a81c-fdc5-4242-8a60-8321f7f769d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:45.280227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-00b5a81c-fdc5-4242-8a60-8321f7f769d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142092 Sep 14 19:50:45.280807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 856/1678] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:45 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:45.504694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ff83abe6-befb-41ae-aaba-cd999e0ea093 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:45.505871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ff83abe6-befb-41ae-aaba-cd999e0ea093 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:45.511938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff83abe6-befb-41ae-aaba-cd999e0ea093 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:45.517332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff83abe6-befb-41ae-aaba-cd999e0ea093 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:45.517332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff83abe6-befb-41ae-aaba-cd999e0ea093 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:45.517332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff83abe6-befb-41ae-aaba-cd999e0ea093 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:45.543582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ff83abe6-befb-41ae-aaba-cd999e0ea093 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042633 Sep 14 19:50:45.544067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 823/1679] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:45.754681 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-650bdddc-c572-401b-92b5-2760b8649f3a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:45.755590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-650bdddc-c572-401b-92b5-2760b8649f3a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:45.762000 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-650bdddc-c572-401b-92b5-2760b8649f3a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:45.762446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-650bdddc-c572-401b-92b5-2760b8649f3a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:45.763222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-650bdddc-c572-401b-92b5-2760b8649f3a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:45.763658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-650bdddc-c572-401b-92b5-2760b8649f3a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:45.792091 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-650bdddc-c572-401b-92b5-2760b8649f3a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041177 Sep 14 19:50:45.792647 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 857/1680] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:45 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:45.991354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3a8a3072-1aad-4677-a3e0-10717d3d6aee tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:45.992368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3a8a3072-1aad-4677-a3e0-10717d3d6aee tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:45.998251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a8a3072-1aad-4677-a3e0-10717d3d6aee tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:45.998699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a8a3072-1aad-4677-a3e0-10717d3d6aee tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:45.999471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a8a3072-1aad-4677-a3e0-10717d3d6aee tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:45.999937 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a8a3072-1aad-4677-a3e0-10717d3d6aee tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:46.030649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3a8a3072-1aad-4677-a3e0-10717d3d6aee tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042967 Sep 14 19:50:46.031193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 824/1681] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:45 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:46.299162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f10003ab-ba70-4eb1-b150-9a6930d1a826 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:46.299775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f10003ab-ba70-4eb1-b150-9a6930d1a826 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:46.306331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f10003ab-ba70-4eb1-b150-9a6930d1a826 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:46.306779 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f10003ab-ba70-4eb1-b150-9a6930d1a826 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:46.307591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f10003ab-ba70-4eb1-b150-9a6930d1a826 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:46.308032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f10003ab-ba70-4eb1-b150-9a6930d1a826 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:46.442409 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f10003ab-ba70-4eb1-b150-9a6930d1a826 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:46.450301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f10003ab-ba70-4eb1-b150-9a6930d1a826 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.155138 Sep 14 19:50:46.450864 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 858/1682] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:46 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:46.555853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a0726ff1-04ff-4f82-bc5f-2dd2e38c11b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:46.556840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a0726ff1-04ff-4f82-bc5f-2dd2e38c11b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:46.562652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a0726ff1-04ff-4f82-bc5f-2dd2e38c11b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:46.563095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a0726ff1-04ff-4f82-bc5f-2dd2e38c11b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:46.563851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a0726ff1-04ff-4f82-bc5f-2dd2e38c11b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:46.564280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a0726ff1-04ff-4f82-bc5f-2dd2e38c11b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:46.592139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a0726ff1-04ff-4f82-bc5f-2dd2e38c11b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040831 Sep 14 19:50:46.592683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 825/1683] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:46.803695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4282deff-de8d-4256-8c87-ac52a43f341a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:46.804532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4282deff-de8d-4256-8c87-ac52a43f341a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:46.811087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4282deff-de8d-4256-8c87-ac52a43f341a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:46.811540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4282deff-de8d-4256-8c87-ac52a43f341a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:46.812304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4282deff-de8d-4256-8c87-ac52a43f341a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:46.812744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4282deff-de8d-4256-8c87-ac52a43f341a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:46.841080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4282deff-de8d-4256-8c87-ac52a43f341a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041225 Sep 14 19:50:46.841673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 859/1684] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:46 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:47.042530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e3b28ff7-3da5-420a-9323-00f83d692002 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:47.043438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e3b28ff7-3da5-420a-9323-00f83d692002 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:47.049744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e3b28ff7-3da5-420a-9323-00f83d692002 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:47.050194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e3b28ff7-3da5-420a-9323-00f83d692002 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:47.050967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e3b28ff7-3da5-420a-9323-00f83d692002 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:47.051400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e3b28ff7-3da5-420a-9323-00f83d692002 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:47.080885 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e3b28ff7-3da5-420a-9323-00f83d692002 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042603 Sep 14 19:50:47.081364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 826/1685] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:47 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:47.467544 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-89a2fdc5-846e-4819-a223-797711a2e4ed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:47.468142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-89a2fdc5-846e-4819-a223-797711a2e4ed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:47.473942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89a2fdc5-846e-4819-a223-797711a2e4ed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:47.474379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89a2fdc5-846e-4819-a223-797711a2e4ed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:47.478841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89a2fdc5-846e-4819-a223-797711a2e4ed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:47.478841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89a2fdc5-846e-4819-a223-797711a2e4ed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:47.597661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-89a2fdc5-846e-4819-a223-797711a2e4ed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:47.603608 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c0485c60-70de-410f-9a2a-a061a3bee145 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:47.604503 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c0485c60-70de-410f-9a2a-a061a3bee145 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:47.604873 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-89a2fdc5-846e-4819-a223-797711a2e4ed tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140896 Sep 14 19:50:47.605433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 860/1686] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:47 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:47.610298 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0485c60-70de-410f-9a2a-a061a3bee145 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:47.610745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0485c60-70de-410f-9a2a-a061a3bee145 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:47.611507 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0485c60-70de-410f-9a2a-a061a3bee145 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:47.611939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0485c60-70de-410f-9a2a-a061a3bee145 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:47.640829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c0485c60-70de-410f-9a2a-a061a3bee145 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040992 Sep 14 19:50:47.641302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 827/1687] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:47 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:50:47.852232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-db9b9909-b6ab-46ec-80dd-0dcff2775a53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:47.853172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-db9b9909-b6ab-46ec-80dd-0dcff2775a53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:47.858923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-db9b9909-b6ab-46ec-80dd-0dcff2775a53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:47.859368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-db9b9909-b6ab-46ec-80dd-0dcff2775a53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:47.860138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-db9b9909-b6ab-46ec-80dd-0dcff2775a53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:47.860571 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-db9b9909-b6ab-46ec-80dd-0dcff2775a53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:47.889399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-db9b9909-b6ab-46ec-80dd-0dcff2775a53 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040995 Sep 14 19:50:47.889980 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 861/1688] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:47 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:48.092156 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7d46984b-96d9-4baf-8804-05070a9cd0c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:48.093061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7d46984b-96d9-4baf-8804-05070a9cd0c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:48.098766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d46984b-96d9-4baf-8804-05070a9cd0c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:48.099221 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d46984b-96d9-4baf-8804-05070a9cd0c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:48.099989 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d46984b-96d9-4baf-8804-05070a9cd0c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:48.100430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d46984b-96d9-4baf-8804-05070a9cd0c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:48.137087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7d46984b-96d9-4baf-8804-05070a9cd0c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048720 Sep 14 19:50:48.137673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 828/1689] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:48 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:48.621985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2c045a12-8be7-4936-bd66-2a9d7ae210f3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:48.622596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2c045a12-8be7-4936-bd66-2a9d7ae210f3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:48.628470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c045a12-8be7-4936-bd66-2a9d7ae210f3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:48.629037 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c045a12-8be7-4936-bd66-2a9d7ae210f3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:48.629840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c045a12-8be7-4936-bd66-2a9d7ae210f3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:48.630295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c045a12-8be7-4936-bd66-2a9d7ae210f3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:48.652968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3502fc8f-dfc2-49d5-be02-59cb38a551b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:48.653902 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3502fc8f-dfc2-49d5-be02-59cb38a551b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:48.660043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3502fc8f-dfc2-49d5-be02-59cb38a551b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:48.660483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3502fc8f-dfc2-49d5-be02-59cb38a551b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:48.661258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3502fc8f-dfc2-49d5-be02-59cb38a551b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:48.661728 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3502fc8f-dfc2-49d5-be02-59cb38a551b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:48.693714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3502fc8f-dfc2-49d5-be02-59cb38a551b5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045009 Sep 14 19:50:48.694171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 829/1690] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:48 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:50:48.751891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2c045a12-8be7-4936-bd66-2a9d7ae210f3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:48.759228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2c045a12-8be7-4936-bd66-2a9d7ae210f3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141362 Sep 14 19:50:48.760324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 862/1691] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:48 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:48.901354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ed9d4133-eb88-47ef-b48d-0e441e3a5704 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:48.902348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ed9d4133-eb88-47ef-b48d-0e441e3a5704 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:48.908208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed9d4133-eb88-47ef-b48d-0e441e3a5704 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:48.908647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed9d4133-eb88-47ef-b48d-0e441e3a5704 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:48.909422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed9d4133-eb88-47ef-b48d-0e441e3a5704 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:48.909882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed9d4133-eb88-47ef-b48d-0e441e3a5704 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:48.938271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ed9d4133-eb88-47ef-b48d-0e441e3a5704 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 Sep 14 19:50:48.938742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 830/1692] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:48 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:49.148130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b9227759-1980-4851-8b0d-714ce743b7c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:49.149074 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b9227759-1980-4851-8b0d-714ce743b7c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:49.154943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9227759-1980-4851-8b0d-714ce743b7c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:49.155437 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9227759-1980-4851-8b0d-714ce743b7c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:49.156213 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9227759-1980-4851-8b0d-714ce743b7c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:49.156642 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b9227759-1980-4851-8b0d-714ce743b7c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:49.185984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b9227759-1980-4851-8b0d-714ce743b7c1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041552 Sep 14 19:50:49.186536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 863/1693] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:49 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:49.704918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fedc6762-de2c-43cc-9c0a-d30fe3a26c8e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:49.705863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fedc6762-de2c-43cc-9c0a-d30fe3a26c8e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:49.711650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fedc6762-de2c-43cc-9c0a-d30fe3a26c8e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:49.712097 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fedc6762-de2c-43cc-9c0a-d30fe3a26c8e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:49.712860 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fedc6762-de2c-43cc-9c0a-d30fe3a26c8e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:49.713296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fedc6762-de2c-43cc-9c0a-d30fe3a26c8e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:49.742409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fedc6762-de2c-43cc-9c0a-d30fe3a26c8e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041196 Sep 14 19:50:49.742979 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 831/1694] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:49 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:49.776641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c8d67063-0d48-47ad-8d0b-d7b8a6a81236 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:49.777246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c8d67063-0d48-47ad-8d0b-d7b8a6a81236 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:49.782963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8d67063-0d48-47ad-8d0b-d7b8a6a81236 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:49.783399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8d67063-0d48-47ad-8d0b-d7b8a6a81236 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:49.784151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8d67063-0d48-47ad-8d0b-d7b8a6a81236 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:49.784577 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8d67063-0d48-47ad-8d0b-d7b8a6a81236 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:49.903232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c8d67063-0d48-47ad-8d0b-d7b8a6a81236 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:49.910606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c8d67063-0d48-47ad-8d0b-d7b8a6a81236 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137561 Sep 14 19:50:49.911197 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 864/1695] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:49 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:49.949402 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-69e239f0-cefe-44e1-b13e-5e8ba014e3e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:49.950333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-69e239f0-cefe-44e1-b13e-5e8ba014e3e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:49.956227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-69e239f0-cefe-44e1-b13e-5e8ba014e3e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:49.956604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-69e239f0-cefe-44e1-b13e-5e8ba014e3e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:49.957357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-69e239f0-cefe-44e1-b13e-5e8ba014e3e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:49.957815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-69e239f0-cefe-44e1-b13e-5e8ba014e3e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:49.986286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-69e239f0-cefe-44e1-b13e-5e8ba014e3e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040669 Sep 14 19:50:49.986831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 832/1696] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:49 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:50.197664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-93cf6525-73e5-4773-b7dc-8d9ce5ef791f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:50.198573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-93cf6525-73e5-4773-b7dc-8d9ce5ef791f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:50.204438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93cf6525-73e5-4773-b7dc-8d9ce5ef791f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:50.204888 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93cf6525-73e5-4773-b7dc-8d9ce5ef791f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:50.205685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93cf6525-73e5-4773-b7dc-8d9ce5ef791f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:50.206154 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93cf6525-73e5-4773-b7dc-8d9ce5ef791f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:50.243401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-93cf6525-73e5-4773-b7dc-8d9ce5ef791f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042694 Sep 14 19:50:50.243401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 865/1697] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:50 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:50.754615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6e854341-001f-44fe-bb71-1e110baed1e6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:50.755514 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6e854341-001f-44fe-bb71-1e110baed1e6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:50.761984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6e854341-001f-44fe-bb71-1e110baed1e6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:50.762435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6e854341-001f-44fe-bb71-1e110baed1e6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:50.763200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6e854341-001f-44fe-bb71-1e110baed1e6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:50.763809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6e854341-001f-44fe-bb71-1e110baed1e6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:50.792133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6e854341-001f-44fe-bb71-1e110baed1e6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041222 Sep 14 19:50:50.792615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 833/1698] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:50 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:50:50.928355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3ddba814-3d98-4166-86ce-2299c5842fda tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:50.928964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3ddba814-3d98-4166-86ce-2299c5842fda tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:50.935336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3ddba814-3d98-4166-86ce-2299c5842fda tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:50.935767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3ddba814-3d98-4166-86ce-2299c5842fda tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:50.936530 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3ddba814-3d98-4166-86ce-2299c5842fda tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:50.936960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3ddba814-3d98-4166-86ce-2299c5842fda tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:50.998249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c73ed22c-d856-48d4-a0e9-66eca0cb01ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:50.999267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c73ed22c-d856-48d4-a0e9-66eca0cb01ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:51.005039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c73ed22c-d856-48d4-a0e9-66eca0cb01ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:51.005489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c73ed22c-d856-48d4-a0e9-66eca0cb01ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:51.006293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c73ed22c-d856-48d4-a0e9-66eca0cb01ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:51.006732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c73ed22c-d856-48d4-a0e9-66eca0cb01ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:51.035492 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c73ed22c-d856-48d4-a0e9-66eca0cb01ba tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041705 Sep 14 19:50:51.036243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 834/1699] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:50 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:51.059775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3ddba814-3d98-4166-86ce-2299c5842fda tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:51.067003 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3ddba814-3d98-4166-86ce-2299c5842fda tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142300 Sep 14 19:50:51.067551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 866/1700] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:50 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:51.252692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5afc18ef-eaae-4439-bdce-50d8fbb54678 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:51.253623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5afc18ef-eaae-4439-bdce-50d8fbb54678 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:51.259465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5afc18ef-eaae-4439-bdce-50d8fbb54678 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:51.259917 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5afc18ef-eaae-4439-bdce-50d8fbb54678 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:51.260689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5afc18ef-eaae-4439-bdce-50d8fbb54678 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:51.261129 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5afc18ef-eaae-4439-bdce-50d8fbb54678 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:51.289987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5afc18ef-eaae-4439-bdce-50d8fbb54678 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040956 Sep 14 19:50:51.290547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 835/1701] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:51 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:51.804137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f7a22902-605c-416e-b000-4893e3f532be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:51.805074 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f7a22902-605c-416e-b000-4893e3f532be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:51.811085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f7a22902-605c-416e-b000-4893e3f532be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:51.811534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f7a22902-605c-416e-b000-4893e3f532be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:51.812303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f7a22902-605c-416e-b000-4893e3f532be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:51.812742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f7a22902-605c-416e-b000-4893e3f532be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:51.846066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f7a22902-605c-416e-b000-4893e3f532be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045747 Sep 14 19:50:51.846620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 867/1702] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:51 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:52.046611 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eb534b83-d1f7-4bef-ad7d-88820c3f42c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:52.047650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eb534b83-d1f7-4bef-ad7d-88820c3f42c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:52.053742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb534b83-d1f7-4bef-ad7d-88820c3f42c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:52.054193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb534b83-d1f7-4bef-ad7d-88820c3f42c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:52.054956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb534b83-d1f7-4bef-ad7d-88820c3f42c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:52.055424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb534b83-d1f7-4bef-ad7d-88820c3f42c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:52.083963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-59111f1b-6fb7-43ec-a7a1-64e246d47133 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:52.084595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eb534b83-d1f7-4bef-ad7d-88820c3f42c4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041798 Sep 14 19:50:52.084746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-59111f1b-6fb7-43ec-a7a1-64e246d47133 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:52.085334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 836/1703] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:52 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:52.090385 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59111f1b-6fb7-43ec-a7a1-64e246d47133 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:52.090827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59111f1b-6fb7-43ec-a7a1-64e246d47133 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:52.091588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59111f1b-6fb7-43ec-a7a1-64e246d47133 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:52.092014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59111f1b-6fb7-43ec-a7a1-64e246d47133 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:52.211894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-59111f1b-6fb7-43ec-a7a1-64e246d47133 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:52.219430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-59111f1b-6fb7-43ec-a7a1-64e246d47133 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139079 Sep 14 19:50:52.219993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 868/1704] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:52 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:50:52.302219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1a31c265-18fd-48d6-8e32-c8a5fabf2266 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:52.303462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1a31c265-18fd-48d6-8e32-c8a5fabf2266 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:52.309992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a31c265-18fd-48d6-8e32-c8a5fabf2266 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:52.310467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a31c265-18fd-48d6-8e32-c8a5fabf2266 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:52.311235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a31c265-18fd-48d6-8e32-c8a5fabf2266 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:52.311671 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a31c265-18fd-48d6-8e32-c8a5fabf2266 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:52.340861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1a31c265-18fd-48d6-8e32-c8a5fabf2266 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 Sep 14 19:50:52.341419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 837/1705] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:52 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:52.858485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b0121ffc-32c0-4380-bf19-4ff2e8e32eb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:52.859381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b0121ffc-32c0-4380-bf19-4ff2e8e32eb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:52.865386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0121ffc-32c0-4380-bf19-4ff2e8e32eb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:52.865894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0121ffc-32c0-4380-bf19-4ff2e8e32eb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:52.866662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0121ffc-32c0-4380-bf19-4ff2e8e32eb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:52.867090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0121ffc-32c0-4380-bf19-4ff2e8e32eb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:52.895434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b0121ffc-32c0-4380-bf19-4ff2e8e32eb6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041551 Sep 14 19:50:52.895973 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 869/1706] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:53.096057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-979af8cf-07ec-4419-8bfe-f91a81c2573f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:53.096869 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-979af8cf-07ec-4419-8bfe-f91a81c2573f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:53.102894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-979af8cf-07ec-4419-8bfe-f91a81c2573f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:53.103339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-979af8cf-07ec-4419-8bfe-f91a81c2573f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:53.104142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-979af8cf-07ec-4419-8bfe-f91a81c2573f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:53.104567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-979af8cf-07ec-4419-8bfe-f91a81c2573f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:53.133888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-979af8cf-07ec-4419-8bfe-f91a81c2573f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041745 Sep 14 19:50:53.134445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 838/1707] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:53 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:53.236685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-837c8c33-062a-455d-a261-83728da44b43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:53.237285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-837c8c33-062a-455d-a261-83728da44b43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:53.243095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-837c8c33-062a-455d-a261-83728da44b43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:53.243534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-837c8c33-062a-455d-a261-83728da44b43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:53.244289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-837c8c33-062a-455d-a261-83728da44b43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:53.244714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-837c8c33-062a-455d-a261-83728da44b43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:53.352132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8333207c-ad2d-4a0a-b9f8-30f4db14566d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:53.352949 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8333207c-ad2d-4a0a-b9f8-30f4db14566d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:53.359243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8333207c-ad2d-4a0a-b9f8-30f4db14566d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:53.359686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8333207c-ad2d-4a0a-b9f8-30f4db14566d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:53.360452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8333207c-ad2d-4a0a-b9f8-30f4db14566d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:53.360882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8333207c-ad2d-4a0a-b9f8-30f4db14566d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:53.367960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-837c8c33-062a-455d-a261-83728da44b43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:53.375638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-837c8c33-062a-455d-a261-83728da44b43 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142564 Sep 14 19:50:53.376205 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 870/1708] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:53 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:53.391484 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8333207c-ad2d-4a0a-b9f8-30f4db14566d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043113 Sep 14 19:50:53.392029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 839/1709] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:53 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:53.906880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2b065843-776d-453a-a782-5bb094c05a78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:53.907786 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2b065843-776d-453a-a782-5bb094c05a78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:53.913686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b065843-776d-453a-a782-5bb094c05a78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:53.914140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b065843-776d-453a-a782-5bb094c05a78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:53.914911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b065843-776d-453a-a782-5bb094c05a78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:53.915347 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b065843-776d-453a-a782-5bb094c05a78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:53.944308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2b065843-776d-453a-a782-5bb094c05a78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041703 Sep 14 19:50:53.944790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 871/1710] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:53 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:54.145880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2ed172cc-da0d-4ca0-9c4f-93d36793aa04 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:54.146783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2ed172cc-da0d-4ca0-9c4f-93d36793aa04 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:54.152511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ed172cc-da0d-4ca0-9c4f-93d36793aa04 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:54.153631 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ed172cc-da0d-4ca0-9c4f-93d36793aa04 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:54.154395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ed172cc-da0d-4ca0-9c4f-93d36793aa04 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:54.154826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ed172cc-da0d-4ca0-9c4f-93d36793aa04 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:54.182579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2ed172cc-da0d-4ca0-9c4f-93d36793aa04 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040419 Sep 14 19:50:54.183127 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 840/1711] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:54 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:54.392504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-30a04755-0b59-4897-9b7e-e7588c50a0df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:54.393133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-30a04755-0b59-4897-9b7e-e7588c50a0df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:54.399034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-30a04755-0b59-4897-9b7e-e7588c50a0df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:54.399486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-30a04755-0b59-4897-9b7e-e7588c50a0df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:54.400259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-30a04755-0b59-4897-9b7e-e7588c50a0df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:54.400699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-30a04755-0b59-4897-9b7e-e7588c50a0df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:54.402380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c55ad084-8035-4d48-af3b-42667354536f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:54.403338 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c55ad084-8035-4d48-af3b-42667354536f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:54.408988 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c55ad084-8035-4d48-af3b-42667354536f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:54.409426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c55ad084-8035-4d48-af3b-42667354536f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:54.410230 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c55ad084-8035-4d48-af3b-42667354536f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:54.410662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c55ad084-8035-4d48-af3b-42667354536f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:54.440625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c55ad084-8035-4d48-af3b-42667354536f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041824 Sep 14 19:50:54.441209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 841/1712] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:54 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:50:54.524997 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-30a04755-0b59-4897-9b7e-e7588c50a0df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:54.532672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-30a04755-0b59-4897-9b7e-e7588c50a0df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143822 Sep 14 19:50:54.541673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 872/1713] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:54 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:54.955859 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a5875c40-0b8c-4e1a-ae6c-e78b2b29f39b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:54.956756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a5875c40-0b8c-4e1a-ae6c-e78b2b29f39b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:54.962585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5875c40-0b8c-4e1a-ae6c-e78b2b29f39b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:54.963029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5875c40-0b8c-4e1a-ae6c-e78b2b29f39b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:54.963786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5875c40-0b8c-4e1a-ae6c-e78b2b29f39b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:54.964214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5875c40-0b8c-4e1a-ae6c-e78b2b29f39b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:54.992382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a5875c40-0b8c-4e1a-ae6c-e78b2b29f39b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040311 Sep 14 19:50:54.992854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 842/1714] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:55.193942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cd729d79-48b1-4fec-9a5a-4826622a8e43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:55.194848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cd729d79-48b1-4fec-9a5a-4826622a8e43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:55.200699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd729d79-48b1-4fec-9a5a-4826622a8e43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:55.201152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd729d79-48b1-4fec-9a5a-4826622a8e43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:55.201955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd729d79-48b1-4fec-9a5a-4826622a8e43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:55.202395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cd729d79-48b1-4fec-9a5a-4826622a8e43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:55.231726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cd729d79-48b1-4fec-9a5a-4826622a8e43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040900 Sep 14 19:50:55.232310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 873/1715] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:55 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:55.452794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e4d2f495-0f26-410b-96f2-65cea73e71db tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:55.453723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e4d2f495-0f26-410b-96f2-65cea73e71db tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:55.459546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4d2f495-0f26-410b-96f2-65cea73e71db tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:55.460008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4d2f495-0f26-410b-96f2-65cea73e71db tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:55.460763 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4d2f495-0f26-410b-96f2-65cea73e71db tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:55.461189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4d2f495-0f26-410b-96f2-65cea73e71db tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:55.490516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e4d2f495-0f26-410b-96f2-65cea73e71db tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042044 Sep 14 19:50:55.491070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 843/1716] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:55 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:55.549601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2f82513f-6711-4cbe-901d-8d49328d117a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:55.550314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2f82513f-6711-4cbe-901d-8d49328d117a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:55.556186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f82513f-6711-4cbe-901d-8d49328d117a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:55.556621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f82513f-6711-4cbe-901d-8d49328d117a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:55.557374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f82513f-6711-4cbe-901d-8d49328d117a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:55.557826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f82513f-6711-4cbe-901d-8d49328d117a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:55.677031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2f82513f-6711-4cbe-901d-8d49328d117a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:55.684853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2f82513f-6711-4cbe-901d-8d49328d117a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139025 Sep 14 19:50:55.685434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 874/1717] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:55 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:56.004209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-acf48879-85ba-4a9c-88b8-f4571b080864 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:56.005120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-acf48879-85ba-4a9c-88b8-f4571b080864 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:56.017034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-acf48879-85ba-4a9c-88b8-f4571b080864 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:56.017034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-acf48879-85ba-4a9c-88b8-f4571b080864 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:56.017034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-acf48879-85ba-4a9c-88b8-f4571b080864 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:56.017034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-acf48879-85ba-4a9c-88b8-f4571b080864 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:56.044041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-acf48879-85ba-4a9c-88b8-f4571b080864 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043514 Sep 14 19:50:56.044521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 844/1718] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:55 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:56.243209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-56401c27-7f5a-4b34-a502-8df1e097afda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:56.244112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-56401c27-7f5a-4b34-a502-8df1e097afda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:56.250691 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-56401c27-7f5a-4b34-a502-8df1e097afda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:56.251131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-56401c27-7f5a-4b34-a502-8df1e097afda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:56.251894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-56401c27-7f5a-4b34-a502-8df1e097afda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:56.252323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-56401c27-7f5a-4b34-a502-8df1e097afda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:56.282503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-56401c27-7f5a-4b34-a502-8df1e097afda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Sep 14 19:50:56.283048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 875/1719] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:56 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:56.502760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-819a9961-41aa-435e-951f-8dce18c716fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:56.503697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-819a9961-41aa-435e-951f-8dce18c716fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:56.509657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-819a9961-41aa-435e-951f-8dce18c716fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:56.510131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-819a9961-41aa-435e-951f-8dce18c716fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:56.510969 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-819a9961-41aa-435e-951f-8dce18c716fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:56.511418 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-819a9961-41aa-435e-951f-8dce18c716fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:56.542281 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-819a9961-41aa-435e-951f-8dce18c716fa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 Sep 14 19:50:56.542866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 845/1720] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:56 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:56.701985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5d997789-c792-4331-80e8-f517c21b3647 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:56.702596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5d997789-c792-4331-80e8-f517c21b3647 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:56.708596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d997789-c792-4331-80e8-f517c21b3647 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:56.709064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d997789-c792-4331-80e8-f517c21b3647 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:56.709862 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d997789-c792-4331-80e8-f517c21b3647 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:56.710294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d997789-c792-4331-80e8-f517c21b3647 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:56.831505 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5d997789-c792-4331-80e8-f517c21b3647 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:56.839302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5d997789-c792-4331-80e8-f517c21b3647 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140951 Sep 14 19:50:56.840504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 876/1721] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:56 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:57.055669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-32491689-27b4-486d-bda5-cc56c247771f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:57.056486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-32491689-27b4-486d-bda5-cc56c247771f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:57.062590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32491689-27b4-486d-bda5-cc56c247771f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:57.063037 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32491689-27b4-486d-bda5-cc56c247771f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:57.063800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32491689-27b4-486d-bda5-cc56c247771f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:57.064246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32491689-27b4-486d-bda5-cc56c247771f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:57.093122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-32491689-27b4-486d-bda5-cc56c247771f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041307 Sep 14 19:50:57.093735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 846/1722] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:57 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:57.293950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4fa69fcc-f3a1-4186-9d91-772090fc910a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:57.294868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4fa69fcc-f3a1-4186-9d91-772090fc910a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:57.301038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4fa69fcc-f3a1-4186-9d91-772090fc910a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:57.301488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4fa69fcc-f3a1-4186-9d91-772090fc910a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:57.302325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4fa69fcc-f3a1-4186-9d91-772090fc910a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:57.302765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4fa69fcc-f3a1-4186-9d91-772090fc910a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:57.332499 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4fa69fcc-f3a1-4186-9d91-772090fc910a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042288 Sep 14 19:50:57.332971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 877/1723] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:57 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:57.554811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9bbb43f9-5c24-4f75-be81-f21a501481b5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:57.555707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9bbb43f9-5c24-4f75-be81-f21a501481b5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:57.562140 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9bbb43f9-5c24-4f75-be81-f21a501481b5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:57.562587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9bbb43f9-5c24-4f75-be81-f21a501481b5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:57.563355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9bbb43f9-5c24-4f75-be81-f21a501481b5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:57.563789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9bbb43f9-5c24-4f75-be81-f21a501481b5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:57.593292 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9bbb43f9-5c24-4f75-be81-f21a501481b5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042119 Sep 14 19:50:57.593797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 847/1724] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:57 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:57.856544 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3844efd9-0ccd-4a51-9e25-54d18af8d7e1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:57.857097 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3844efd9-0ccd-4a51-9e25-54d18af8d7e1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:57.863177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3844efd9-0ccd-4a51-9e25-54d18af8d7e1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:57.863626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3844efd9-0ccd-4a51-9e25-54d18af8d7e1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:57.864399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3844efd9-0ccd-4a51-9e25-54d18af8d7e1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:57.864836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3844efd9-0ccd-4a51-9e25-54d18af8d7e1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:57.985977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3844efd9-0ccd-4a51-9e25-54d18af8d7e1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:57.993246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3844efd9-0ccd-4a51-9e25-54d18af8d7e1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141051 Sep 14 19:50:57.993850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 878/1725] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:57 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:58.104344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-895604bc-e72d-474f-b538-73e4f9d1ceff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:58.105313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-895604bc-e72d-474f-b538-73e4f9d1ceff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:58.111739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-895604bc-e72d-474f-b538-73e4f9d1ceff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:58.112180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-895604bc-e72d-474f-b538-73e4f9d1ceff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:58.112940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-895604bc-e72d-474f-b538-73e4f9d1ceff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:58.113364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-895604bc-e72d-474f-b538-73e4f9d1ceff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:58.142142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-895604bc-e72d-474f-b538-73e4f9d1ceff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041674 Sep 14 19:50:58.142702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 848/1726] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:58 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:50:58.344434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9ec72d30-6e18-4146-83dd-8ff8a517f5e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:58.345343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9ec72d30-6e18-4146-83dd-8ff8a517f5e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:58.351230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ec72d30-6e18-4146-83dd-8ff8a517f5e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:58.351679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ec72d30-6e18-4146-83dd-8ff8a517f5e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:58.352447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ec72d30-6e18-4146-83dd-8ff8a517f5e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:58.352883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ec72d30-6e18-4146-83dd-8ff8a517f5e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:58.382013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9ec72d30-6e18-4146-83dd-8ff8a517f5e9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041798 Sep 14 19:50:58.382487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 879/1727] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:58 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:58.604485 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bc309946-1b54-4a46-8868-7e709e376ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:58.605394 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bc309946-1b54-4a46-8868-7e709e376ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:58.611704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc309946-1b54-4a46-8868-7e709e376ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:58.612150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc309946-1b54-4a46-8868-7e709e376ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:58.612924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc309946-1b54-4a46-8868-7e709e376ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:58.613361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc309946-1b54-4a46-8868-7e709e376ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:58.642897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bc309946-1b54-4a46-8868-7e709e376ba2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041971 Sep 14 19:50:58.643339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 849/1728] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:58 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:59.010611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ccaec04b-719c-4031-811f-17e8511e66db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:59.011230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ccaec04b-719c-4031-811f-17e8511e66db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:59.017059 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ccaec04b-719c-4031-811f-17e8511e66db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:59.017536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ccaec04b-719c-4031-811f-17e8511e66db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:59.018313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ccaec04b-719c-4031-811f-17e8511e66db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:59.018753 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ccaec04b-719c-4031-811f-17e8511e66db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:59.154293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-41d21c7f-9190-4479-8f40-933ea1670346 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:59.155179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-41d21c7f-9190-4479-8f40-933ea1670346 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:59.160955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41d21c7f-9190-4479-8f40-933ea1670346 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:59.161627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41d21c7f-9190-4479-8f40-933ea1670346 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:59.162202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41d21c7f-9190-4479-8f40-933ea1670346 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:59.162629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41d21c7f-9190-4479-8f40-933ea1670346 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:59.192766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-41d21c7f-9190-4479-8f40-933ea1670346 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042775 Sep 14 19:50:59.193476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 850/1729] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:50:59 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:50:59.232815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ccaec04b-719c-4031-811f-17e8511e66db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:50:59.240405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ccaec04b-719c-4031-811f-17e8511e66db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.233499 Sep 14 19:50:59.241053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 880/1730] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:50:59 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:50:59.393784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b4013d0c-5c11-4a6b-947c-0ff1cdb99516 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:59.394714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b4013d0c-5c11-4a6b-947c-0ff1cdb99516 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:59.400393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4013d0c-5c11-4a6b-947c-0ff1cdb99516 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:59.400841 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4013d0c-5c11-4a6b-947c-0ff1cdb99516 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:59.401651 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4013d0c-5c11-4a6b-947c-0ff1cdb99516 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:59.402053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4013d0c-5c11-4a6b-947c-0ff1cdb99516 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:59.583054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b4013d0c-5c11-4a6b-947c-0ff1cdb99516 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192899 Sep 14 19:50:59.583519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 851/1731] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:59 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:50:59.653617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-80e37ac6-4d2b-4705-9fec-062b14d49f34 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:50:59.654489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-80e37ac6-4d2b-4705-9fec-062b14d49f34 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:50:59.660246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-80e37ac6-4d2b-4705-9fec-062b14d49f34 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:59.660681 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-80e37ac6-4d2b-4705-9fec-062b14d49f34 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:59.661435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-80e37ac6-4d2b-4705-9fec-062b14d49f34 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:50:59.661894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-80e37ac6-4d2b-4705-9fec-062b14d49f34 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:50:59.690082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-80e37ac6-4d2b-4705-9fec-062b14d49f34 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040301 Sep 14 19:50:59.690620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 881/1732] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:50:59 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:00.203993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d3331e6c-9d90-420e-8d95-fa0321365545 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:00.204927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d3331e6c-9d90-420e-8d95-fa0321365545 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:00.210834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3331e6c-9d90-420e-8d95-fa0321365545 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:00.211279 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3331e6c-9d90-420e-8d95-fa0321365545 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:00.212076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3331e6c-9d90-420e-8d95-fa0321365545 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:00.212506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3331e6c-9d90-420e-8d95-fa0321365545 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:00.241255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d3331e6c-9d90-420e-8d95-fa0321365545 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041074 Sep 14 19:51:00.241834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 852/1733] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:00 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:00.257114 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e3885a70-812f-4cea-b186-415cb6c5f77e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:00.257765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e3885a70-812f-4cea-b186-415cb6c5f77e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:00.263857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3885a70-812f-4cea-b186-415cb6c5f77e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:00.264315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3885a70-812f-4cea-b186-415cb6c5f77e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:00.265204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3885a70-812f-4cea-b186-415cb6c5f77e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:00.265547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3885a70-812f-4cea-b186-415cb6c5f77e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:00.387626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e3885a70-812f-4cea-b186-415cb6c5f77e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:00.395735 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e3885a70-812f-4cea-b186-415cb6c5f77e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142191 Sep 14 19:51:00.396289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 882/1734] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:00 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:00.595287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-47b9305b-122b-41a8-b656-a08aea74328e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:00.596130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-47b9305b-122b-41a8-b656-a08aea74328e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:00.601978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-47b9305b-122b-41a8-b656-a08aea74328e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:00.602425 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-47b9305b-122b-41a8-b656-a08aea74328e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:00.603186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-47b9305b-122b-41a8-b656-a08aea74328e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:00.603615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-47b9305b-122b-41a8-b656-a08aea74328e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:00.634566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-47b9305b-122b-41a8-b656-a08aea74328e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043032 Sep 14 19:51:00.635111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 853/1735] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:00 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:00.701904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c6b8863e-737e-4294-8b01-47844c477304 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:00.702810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c6b8863e-737e-4294-8b01-47844c477304 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:00.709462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6b8863e-737e-4294-8b01-47844c477304 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:00.710011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6b8863e-737e-4294-8b01-47844c477304 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:00.710831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6b8863e-737e-4294-8b01-47844c477304 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:00.711264 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6b8863e-737e-4294-8b01-47844c477304 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:00.740655 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c6b8863e-737e-4294-8b01-47844c477304 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Sep 14 19:51:00.741287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 883/1736] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:00 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:01.252273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5f2858cf-8519-4d02-95ee-e0bb2da79e1b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:01.253164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5f2858cf-8519-4d02-95ee-e0bb2da79e1b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:01.259007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f2858cf-8519-4d02-95ee-e0bb2da79e1b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:01.259449 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f2858cf-8519-4d02-95ee-e0bb2da79e1b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:01.260212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f2858cf-8519-4d02-95ee-e0bb2da79e1b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:01.260634 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f2858cf-8519-4d02-95ee-e0bb2da79e1b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:01.289775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5f2858cf-8519-4d02-95ee-e0bb2da79e1b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041221 Sep 14 19:51:01.290344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 854/1737] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:01 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:01.413169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9b6da543-0a38-45e5-b637-5f9aecdb2a42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:01.413798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9b6da543-0a38-45e5-b637-5f9aecdb2a42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:01.419541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b6da543-0a38-45e5-b637-5f9aecdb2a42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:01.419981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b6da543-0a38-45e5-b637-5f9aecdb2a42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:01.420733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b6da543-0a38-45e5-b637-5f9aecdb2a42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:01.421162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b6da543-0a38-45e5-b637-5f9aecdb2a42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:01.539165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9b6da543-0a38-45e5-b637-5f9aecdb2a42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:01.546495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9b6da543-0a38-45e5-b637-5f9aecdb2a42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.136940 Sep 14 19:51:01.547047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 884/1738] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:01 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:01.645102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4b77b877-3a8e-4fed-badc-4afecfbd3215 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:01.646068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4b77b877-3a8e-4fed-badc-4afecfbd3215 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:01.652368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b77b877-3a8e-4fed-badc-4afecfbd3215 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:01.652994 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b77b877-3a8e-4fed-badc-4afecfbd3215 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:01.653838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b77b877-3a8e-4fed-badc-4afecfbd3215 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:01.654267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b77b877-3a8e-4fed-badc-4afecfbd3215 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:01.682844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4b77b877-3a8e-4fed-badc-4afecfbd3215 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041426 Sep 14 19:51:01.683309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 855/1739] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:01 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:01.752724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c3675d60-da7a-4f4e-a5bc-ac94e74575a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:01.753648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c3675d60-da7a-4f4e-a5bc-ac94e74575a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:01.759561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c3675d60-da7a-4f4e-a5bc-ac94e74575a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:01.759995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c3675d60-da7a-4f4e-a5bc-ac94e74575a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:01.760757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c3675d60-da7a-4f4e-a5bc-ac94e74575a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:01.761186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c3675d60-da7a-4f4e-a5bc-ac94e74575a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:01.789729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c3675d60-da7a-4f4e-a5bc-ac94e74575a8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040647 Sep 14 19:51:01.790272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 885/1740] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:01 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:02.301205 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1745549c-8ade-4c8e-a6a2-f3362c629623 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:02.302068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1745549c-8ade-4c8e-a6a2-f3362c629623 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:02.307934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1745549c-8ade-4c8e-a6a2-f3362c629623 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:02.308381 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1745549c-8ade-4c8e-a6a2-f3362c629623 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:02.309243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1745549c-8ade-4c8e-a6a2-f3362c629623 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:02.309780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1745549c-8ade-4c8e-a6a2-f3362c629623 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:02.338360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1745549c-8ade-4c8e-a6a2-f3362c629623 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041468 Sep 14 19:51:02.338899 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 856/1741] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:02 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:02.564128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e47ebb5a-8637-4727-88a8-8ef2659a5224 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:02.564645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e47ebb5a-8637-4727-88a8-8ef2659a5224 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:02.570448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e47ebb5a-8637-4727-88a8-8ef2659a5224 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:02.570895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e47ebb5a-8637-4727-88a8-8ef2659a5224 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:02.571658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e47ebb5a-8637-4727-88a8-8ef2659a5224 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:02.572092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e47ebb5a-8637-4727-88a8-8ef2659a5224 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:02.688789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e47ebb5a-8637-4727-88a8-8ef2659a5224 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:02.694810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-acb65737-af40-47dd-a7fe-1c1424382971 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:02.695701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-acb65737-af40-47dd-a7fe-1c1424382971 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:02.696121 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e47ebb5a-8637-4727-88a8-8ef2659a5224 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.136241 Sep 14 19:51:02.696727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 886/1742] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:02 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:02.702155 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-acb65737-af40-47dd-a7fe-1c1424382971 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:02.702628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-acb65737-af40-47dd-a7fe-1c1424382971 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:02.703396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-acb65737-af40-47dd-a7fe-1c1424382971 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:02.703819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-acb65737-af40-47dd-a7fe-1c1424382971 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:02.733355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-acb65737-af40-47dd-a7fe-1c1424382971 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042421 Sep 14 19:51:02.733913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 857/1743] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:02 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:02.801733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d8404183-9e84-4325-b73c-742b21ed528d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:02.802695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d8404183-9e84-4325-b73c-742b21ed528d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:02.808787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d8404183-9e84-4325-b73c-742b21ed528d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:02.809239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d8404183-9e84-4325-b73c-742b21ed528d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:02.810535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d8404183-9e84-4325-b73c-742b21ed528d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:02.810974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d8404183-9e84-4325-b73c-742b21ed528d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:02.841341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d8404183-9e84-4325-b73c-742b21ed528d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 Sep 14 19:51:02.841955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 887/1744] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:02 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:03.350561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f8361ef2-29d4-4a3d-8a7d-550ca9bcec47 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:03.351483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f8361ef2-29d4-4a3d-8a7d-550ca9bcec47 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:03.357995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8361ef2-29d4-4a3d-8a7d-550ca9bcec47 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:03.358438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8361ef2-29d4-4a3d-8a7d-550ca9bcec47 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:03.359202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8361ef2-29d4-4a3d-8a7d-550ca9bcec47 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:03.359637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8361ef2-29d4-4a3d-8a7d-550ca9bcec47 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:03.387888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f8361ef2-29d4-4a3d-8a7d-550ca9bcec47 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041136 Sep 14 19:51:03.388413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 858/1745] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:03.719721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-00670599-b590-41c9-b63f-82f763953fc7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:03.720336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-00670599-b590-41c9-b63f-82f763953fc7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:03.735648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00670599-b590-41c9-b63f-82f763953fc7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:03.736105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00670599-b590-41c9-b63f-82f763953fc7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:03.736901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00670599-b590-41c9-b63f-82f763953fc7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:03.737339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00670599-b590-41c9-b63f-82f763953fc7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:03.744298 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7f2dbbcf-f279-430c-9453-fc64d0f03840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:03.745203 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7f2dbbcf-f279-430c-9453-fc64d0f03840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:03.751633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f2dbbcf-f279-430c-9453-fc64d0f03840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:03.752077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f2dbbcf-f279-430c-9453-fc64d0f03840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:03.752853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f2dbbcf-f279-430c-9453-fc64d0f03840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:03.753280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7f2dbbcf-f279-430c-9453-fc64d0f03840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:03.781723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7f2dbbcf-f279-430c-9453-fc64d0f03840 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041040 Sep 14 19:51:03.782299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 859/1746] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:03 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:03.852907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d4a5f017-9688-4361-ae72-92829c0a714d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:03.853843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d4a5f017-9688-4361-ae72-92829c0a714d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:03.860214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4a5f017-9688-4361-ae72-92829c0a714d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:03.860663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4a5f017-9688-4361-ae72-92829c0a714d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:03.860969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-00670599-b590-41c9-b63f-82f763953fc7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:03.861431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4a5f017-9688-4361-ae72-92829c0a714d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:03.861871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4a5f017-9688-4361-ae72-92829c0a714d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:03.868292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-00670599-b590-41c9-b63f-82f763953fc7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.152421 Sep 14 19:51:03.869052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 888/1747] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:03 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:03.890764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d4a5f017-9688-4361-ae72-92829c0a714d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041622 Sep 14 19:51:03.891312 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 860/1748] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:03 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:04.399445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6bd7a2d2-461d-477c-aba5-54a0e64e0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:04.400346 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6bd7a2d2-461d-477c-aba5-54a0e64e0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:04.406902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6bd7a2d2-461d-477c-aba5-54a0e64e0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:04.407353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6bd7a2d2-461d-477c-aba5-54a0e64e0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:04.408125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6bd7a2d2-461d-477c-aba5-54a0e64e0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:04.408639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6bd7a2d2-461d-477c-aba5-54a0e64e0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:04.437624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6bd7a2d2-461d-477c-aba5-54a0e64e0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041925 Sep 14 19:51:04.438184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 889/1749] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:04 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:04.792362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-25cd8e55-59a8-459b-885d-8dd7ecdfb24c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:04.793278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-25cd8e55-59a8-459b-885d-8dd7ecdfb24c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:04.799548 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25cd8e55-59a8-459b-885d-8dd7ecdfb24c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:04.799993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25cd8e55-59a8-459b-885d-8dd7ecdfb24c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:04.800761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25cd8e55-59a8-459b-885d-8dd7ecdfb24c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:04.801199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25cd8e55-59a8-459b-885d-8dd7ecdfb24c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:04.830341 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-25cd8e55-59a8-459b-885d-8dd7ecdfb24c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041830 Sep 14 19:51:04.830899 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 861/1750] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:04 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:04.884814 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4d0a8411-0891-4266-8b40-75f555d6b868 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:04.885421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4d0a8411-0891-4266-8b40-75f555d6b868 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:04.891924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4d0a8411-0891-4266-8b40-75f555d6b868 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:04.892377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4d0a8411-0891-4266-8b40-75f555d6b868 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:04.893139 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4d0a8411-0891-4266-8b40-75f555d6b868 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:04.893620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4d0a8411-0891-4266-8b40-75f555d6b868 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:04.901573 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f49e1220-4bb6-4117-a405-5e59e546495a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:04.902511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f49e1220-4bb6-4117-a405-5e59e546495a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:04.908230 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f49e1220-4bb6-4117-a405-5e59e546495a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:04.908676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f49e1220-4bb6-4117-a405-5e59e546495a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:04.909436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f49e1220-4bb6-4117-a405-5e59e546495a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:04.909890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f49e1220-4bb6-4117-a405-5e59e546495a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:04.939308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f49e1220-4bb6-4117-a405-5e59e546495a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041341 Sep 14 19:51:04.939866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 862/1751] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:04 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:05.012645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4d0a8411-0891-4266-8b40-75f555d6b868 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:05.019881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4d0a8411-0891-4266-8b40-75f555d6b868 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.138751 Sep 14 19:51:05.020433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 890/1752] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:04 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:05.449111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1b2477c4-07db-4402-945b-e972171f5d3a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:05.450021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1b2477c4-07db-4402-945b-e972171f5d3a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:05.456636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b2477c4-07db-4402-945b-e972171f5d3a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:05.457111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b2477c4-07db-4402-945b-e972171f5d3a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:05.460719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b2477c4-07db-4402-945b-e972171f5d3a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:05.460719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b2477c4-07db-4402-945b-e972171f5d3a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:05.486902 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1b2477c4-07db-4402-945b-e972171f5d3a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041511 Sep 14 19:51:05.487456 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 863/1753] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:05 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:05.841626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-efaa085a-b9ae-48fc-9e08-9aa31fcb4830 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:05.842552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-efaa085a-b9ae-48fc-9e08-9aa31fcb4830 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:05.848393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efaa085a-b9ae-48fc-9e08-9aa31fcb4830 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:05.848836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efaa085a-b9ae-48fc-9e08-9aa31fcb4830 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:05.849630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efaa085a-b9ae-48fc-9e08-9aa31fcb4830 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:05.850060 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-efaa085a-b9ae-48fc-9e08-9aa31fcb4830 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:05.878914 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-efaa085a-b9ae-48fc-9e08-9aa31fcb4830 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041082 Sep 14 19:51:05.879457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 891/1754] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:05 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:05.950519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ff59c408-bbce-43b6-ba99-3cd8f899e6e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:05.951426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ff59c408-bbce-43b6-ba99-3cd8f899e6e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:05.957791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff59c408-bbce-43b6-ba99-3cd8f899e6e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:05.958241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff59c408-bbce-43b6-ba99-3cd8f899e6e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:05.959011 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff59c408-bbce-43b6-ba99-3cd8f899e6e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:05.959448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff59c408-bbce-43b6-ba99-3cd8f899e6e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:05.988152 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ff59c408-bbce-43b6-ba99-3cd8f899e6e8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041397 Sep 14 19:51:05.988702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 864/1755] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:05 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:06.036847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-538ebe32-c47e-4363-8a9d-a9e788825651 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:06.037460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-538ebe32-c47e-4363-8a9d-a9e788825651 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:06.043619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-538ebe32-c47e-4363-8a9d-a9e788825651 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:06.044066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-538ebe32-c47e-4363-8a9d-a9e788825651 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:06.045365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-538ebe32-c47e-4363-8a9d-a9e788825651 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:06.045851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-538ebe32-c47e-4363-8a9d-a9e788825651 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:06.167527 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-538ebe32-c47e-4363-8a9d-a9e788825651 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:06.175480 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-538ebe32-c47e-4363-8a9d-a9e788825651 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142286 Sep 14 19:51:06.176032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 892/1756] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:06 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:06.498384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4dd0d169-1164-482b-9b4a-86b21460081c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:06.499286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4dd0d169-1164-482b-9b4a-86b21460081c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:06.505179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4dd0d169-1164-482b-9b4a-86b21460081c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:06.505664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4dd0d169-1164-482b-9b4a-86b21460081c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:06.506430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4dd0d169-1164-482b-9b4a-86b21460081c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:06.506868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4dd0d169-1164-482b-9b4a-86b21460081c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:06.536050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4dd0d169-1164-482b-9b4a-86b21460081c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041462 Sep 14 19:51:06.536598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 865/1757] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:06 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:06.890798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fda2327a-e4ec-4efe-a25d-0ddd199b04f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:06.891702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fda2327a-e4ec-4efe-a25d-0ddd199b04f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:06.897649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fda2327a-e4ec-4efe-a25d-0ddd199b04f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:06.898104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fda2327a-e4ec-4efe-a25d-0ddd199b04f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:06.898871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fda2327a-e4ec-4efe-a25d-0ddd199b04f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:06.899307 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fda2327a-e4ec-4efe-a25d-0ddd199b04f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:06.927927 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fda2327a-e4ec-4efe-a25d-0ddd199b04f4 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041342 Sep 14 19:51:06.928462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 893/1758] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:06 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:07.002498 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dca979ac-e62a-4405-bf46-a537c566c935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:07.003410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dca979ac-e62a-4405-bf46-a537c566c935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:07.009403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dca979ac-e62a-4405-bf46-a537c566c935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:07.009909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dca979ac-e62a-4405-bf46-a537c566c935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:07.010670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dca979ac-e62a-4405-bf46-a537c566c935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:07.011106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dca979ac-e62a-4405-bf46-a537c566c935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:07.040009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dca979ac-e62a-4405-bf46-a537c566c935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041393 Sep 14 19:51:07.040554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 866/1759] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:06 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:07.192109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0d33951d-1718-4444-9b2e-f578a807825e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:07.192805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0d33951d-1718-4444-9b2e-f578a807825e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:07.198726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d33951d-1718-4444-9b2e-f578a807825e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:07.199179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d33951d-1718-4444-9b2e-f578a807825e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:07.199948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d33951d-1718-4444-9b2e-f578a807825e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:07.200391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d33951d-1718-4444-9b2e-f578a807825e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:07.324216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0d33951d-1718-4444-9b2e-f578a807825e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:07.332170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0d33951d-1718-4444-9b2e-f578a807825e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143751 Sep 14 19:51:07.332738 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 894/1760] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:07 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:07.548136 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4cf00493-4b39-4e66-940c-f04d510c76a0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:07.549280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4cf00493-4b39-4e66-940c-f04d510c76a0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:07.555250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4cf00493-4b39-4e66-940c-f04d510c76a0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:07.555700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4cf00493-4b39-4e66-940c-f04d510c76a0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:07.556512 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4cf00493-4b39-4e66-940c-f04d510c76a0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:07.556949 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4cf00493-4b39-4e66-940c-f04d510c76a0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:07.585590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4cf00493-4b39-4e66-940c-f04d510c76a0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041842 Sep 14 19:51:07.586132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 867/1761] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:07 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:07.939179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-44eecf0f-7f09-4c2e-b681-63d605a4e821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:07.940086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-44eecf0f-7f09-4c2e-b681-63d605a4e821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:07.946137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-44eecf0f-7f09-4c2e-b681-63d605a4e821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:07.946594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-44eecf0f-7f09-4c2e-b681-63d605a4e821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:07.947370 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-44eecf0f-7f09-4c2e-b681-63d605a4e821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:07.947818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-44eecf0f-7f09-4c2e-b681-63d605a4e821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:07.976104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-44eecf0f-7f09-4c2e-b681-63d605a4e821 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040657 Sep 14 19:51:07.976648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 895/1762] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:07 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:08.051848 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-50002101-8fd8-457b-9c14-70d39d490d1b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:08.052751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-50002101-8fd8-457b-9c14-70d39d490d1b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:08.058655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50002101-8fd8-457b-9c14-70d39d490d1b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:08.059114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50002101-8fd8-457b-9c14-70d39d490d1b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:08.059924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50002101-8fd8-457b-9c14-70d39d490d1b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:08.060373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50002101-8fd8-457b-9c14-70d39d490d1b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:08.088341 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-50002101-8fd8-457b-9c14-70d39d490d1b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040498 Sep 14 19:51:08.088815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 868/1763] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:08 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:08.348977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b42e26c7-bfc2-4896-8d45-8ff0068ab1cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:08.349491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b42e26c7-bfc2-4896-8d45-8ff0068ab1cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:08.355305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b42e26c7-bfc2-4896-8d45-8ff0068ab1cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:08.355753 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b42e26c7-bfc2-4896-8d45-8ff0068ab1cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:08.356565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b42e26c7-bfc2-4896-8d45-8ff0068ab1cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:08.356996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b42e26c7-bfc2-4896-8d45-8ff0068ab1cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:08.478079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b42e26c7-bfc2-4896-8d45-8ff0068ab1cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:08.485582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b42e26c7-bfc2-4896-8d45-8ff0068ab1cd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140360 Sep 14 19:51:08.486142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 896/1764] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:08 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:08.597030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-43c17d64-5c3f-4068-9b2c-9d25956658e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:08.597948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-43c17d64-5c3f-4068-9b2c-9d25956658e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:08.603974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43c17d64-5c3f-4068-9b2c-9d25956658e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:08.604362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43c17d64-5c3f-4068-9b2c-9d25956658e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:08.605129 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43c17d64-5c3f-4068-9b2c-9d25956658e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:08.605600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43c17d64-5c3f-4068-9b2c-9d25956658e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:08.634242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-43c17d64-5c3f-4068-9b2c-9d25956658e8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040969 Sep 14 19:51:08.634786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 869/1765] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:08 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:08.987464 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-03e6af85-981d-4b88-8604-67bad71846d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:08.988360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-03e6af85-981d-4b88-8604-67bad71846d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:08.994372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03e6af85-981d-4b88-8604-67bad71846d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:08.994838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03e6af85-981d-4b88-8604-67bad71846d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:08.995623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03e6af85-981d-4b88-8604-67bad71846d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:08.996035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-03e6af85-981d-4b88-8604-67bad71846d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:09.024291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-03e6af85-981d-4b88-8604-67bad71846d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040570 Sep 14 19:51:09.024830 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 897/1766] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:08 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:09.100065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5e6676f3-757f-4ddc-98f1-de8f8196df25 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:09.100968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5e6676f3-757f-4ddc-98f1-de8f8196df25 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:09.107371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e6676f3-757f-4ddc-98f1-de8f8196df25 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:09.107822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e6676f3-757f-4ddc-98f1-de8f8196df25 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:09.108590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e6676f3-757f-4ddc-98f1-de8f8196df25 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:09.109027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e6676f3-757f-4ddc-98f1-de8f8196df25 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:09.137950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5e6676f3-757f-4ddc-98f1-de8f8196df25 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041636 Sep 14 19:51:09.138538 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 870/1767] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:09 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:09.503469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-52b02786-4321-4b86-b5aa-5287102c5288 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:09.504062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-52b02786-4321-4b86-b5aa-5287102c5288 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:09.509815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52b02786-4321-4b86-b5aa-5287102c5288 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:09.510269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52b02786-4321-4b86-b5aa-5287102c5288 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:09.511106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52b02786-4321-4b86-b5aa-5287102c5288 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:09.511572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52b02786-4321-4b86-b5aa-5287102c5288 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:09.630811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-52b02786-4321-4b86-b5aa-5287102c5288 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:09.638543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-52b02786-4321-4b86-b5aa-5287102c5288 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.138766 Sep 14 19:51:09.639104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 898/1768] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:09 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:09.646494 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-95300ca9-fee8-4270-bf1e-c8a5e99b1cb7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:09.647517 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-95300ca9-fee8-4270-bf1e-c8a5e99b1cb7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:09.653274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-95300ca9-fee8-4270-bf1e-c8a5e99b1cb7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:09.654434 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-95300ca9-fee8-4270-bf1e-c8a5e99b1cb7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:09.655210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-95300ca9-fee8-4270-bf1e-c8a5e99b1cb7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:09.655691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-95300ca9-fee8-4270-bf1e-c8a5e99b1cb7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:09.683811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-95300ca9-fee8-4270-bf1e-c8a5e99b1cb7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041057 Sep 14 19:51:09.684358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 871/1769] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:10.034994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b8fdc587-b39f-49fa-857c-cdaf66c59e27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:10.035928 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b8fdc587-b39f-49fa-857c-cdaf66c59e27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:10.041814 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b8fdc587-b39f-49fa-857c-cdaf66c59e27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:10.042253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b8fdc587-b39f-49fa-857c-cdaf66c59e27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:10.043012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b8fdc587-b39f-49fa-857c-cdaf66c59e27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:10.043444 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b8fdc587-b39f-49fa-857c-cdaf66c59e27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:10.075191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b8fdc587-b39f-49fa-857c-cdaf66c59e27 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Sep 14 19:51:10.076691 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 899/1770] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:10 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:10.149685 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c80e447e-25c8-49bf-9e02-a9d6e93c405e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:10.150593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c80e447e-25c8-49bf-9e02-a9d6e93c405e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:10.156527 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c80e447e-25c8-49bf-9e02-a9d6e93c405e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:10.156973 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c80e447e-25c8-49bf-9e02-a9d6e93c405e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:10.157771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c80e447e-25c8-49bf-9e02-a9d6e93c405e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:10.158199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c80e447e-25c8-49bf-9e02-a9d6e93c405e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:10.187189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c80e447e-25c8-49bf-9e02-a9d6e93c405e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041449 Sep 14 19:51:10.187738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 872/1771] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:10 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:10.654225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2eac60fe-75ca-4bfd-8061-9c33b05eafb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:10.654866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2eac60fe-75ca-4bfd-8061-9c33b05eafb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:10.660714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2eac60fe-75ca-4bfd-8061-9c33b05eafb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:10.661161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2eac60fe-75ca-4bfd-8061-9c33b05eafb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:10.661951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2eac60fe-75ca-4bfd-8061-9c33b05eafb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:10.662391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2eac60fe-75ca-4bfd-8061-9c33b05eafb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:10.695442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5e7d5937-0470-4ddd-b47f-d07d0af41786 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:10.696284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5e7d5937-0470-4ddd-b47f-d07d0af41786 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:10.702191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e7d5937-0470-4ddd-b47f-d07d0af41786 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:10.702642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e7d5937-0470-4ddd-b47f-d07d0af41786 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:10.703422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e7d5937-0470-4ddd-b47f-d07d0af41786 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:10.703853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e7d5937-0470-4ddd-b47f-d07d0af41786 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:10.734727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5e7d5937-0470-4ddd-b47f-d07d0af41786 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043117 Sep 14 19:51:10.735306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 873/1772] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:10.794063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2eac60fe-75ca-4bfd-8061-9c33b05eafb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:10.804442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2eac60fe-75ca-4bfd-8061-9c33b05eafb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.153851 Sep 14 19:51:10.805017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 900/1773] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:10 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:11.088605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0edbbce6-80b6-4ddd-8c21-a6c8c73f456d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:11.089463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0edbbce6-80b6-4ddd-8c21-a6c8c73f456d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:11.095845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0edbbce6-80b6-4ddd-8c21-a6c8c73f456d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:11.096299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0edbbce6-80b6-4ddd-8c21-a6c8c73f456d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:11.097069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0edbbce6-80b6-4ddd-8c21-a6c8c73f456d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:11.097520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0edbbce6-80b6-4ddd-8c21-a6c8c73f456d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:11.128639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0edbbce6-80b6-4ddd-8c21-a6c8c73f456d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Sep 14 19:51:11.129202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 874/1774] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:11.198986 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-340888e7-6c5b-46d4-87b6-1ef7a03f8c04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:11.199898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-340888e7-6c5b-46d4-87b6-1ef7a03f8c04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:11.206454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-340888e7-6c5b-46d4-87b6-1ef7a03f8c04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:11.206981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-340888e7-6c5b-46d4-87b6-1ef7a03f8c04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:11.207756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-340888e7-6c5b-46d4-87b6-1ef7a03f8c04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:11.208192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-340888e7-6c5b-46d4-87b6-1ef7a03f8c04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:11.237537 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-340888e7-6c5b-46d4-87b6-1ef7a03f8c04 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042332 Sep 14 19:51:11.238085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 901/1775] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:11 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:11.629829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-51668cea-2bf2-4fca-aaee-a9923f2e1926 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:11.630334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-51668cea-2bf2-4fca-aaee-a9923f2e1926 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:11.636172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51668cea-2bf2-4fca-aaee-a9923f2e1926 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:11.636619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51668cea-2bf2-4fca-aaee-a9923f2e1926 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:11.637399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51668cea-2bf2-4fca-aaee-a9923f2e1926 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:11.638513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51668cea-2bf2-4fca-aaee-a9923f2e1926 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:11.721331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-51668cea-2bf2-4fca-aaee-a9923f2e1926 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lazy-loading 'services' on Instance uuid 3106dd73-2741-49d1-9906-80ecde50dd8e {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:51:11.749103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c93d1f42-20bd-45ef-b542-c5cc0d7f2af6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:11.750631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c93d1f42-20bd-45ef-b542-c5cc0d7f2af6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:11.756479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c93d1f42-20bd-45ef-b542-c5cc0d7f2af6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:11.757026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c93d1f42-20bd-45ef-b542-c5cc0d7f2af6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:11.757914 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c93d1f42-20bd-45ef-b542-c5cc0d7f2af6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:11.758361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c93d1f42-20bd-45ef-b542-c5cc0d7f2af6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:11.790621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c93d1f42-20bd-45ef-b542-c5cc0d7f2af6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045894 Sep 14 19:51:11.791178 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 902/1776] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:11 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:11.821314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8ac94bbe-506b-449b-b7e5-5b7c442e8be9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:11.821981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8ac94bbe-506b-449b-b7e5-5b7c442e8be9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:11.828675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ac94bbe-506b-449b-b7e5-5b7c442e8be9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:11.829132 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ac94bbe-506b-449b-b7e5-5b7c442e8be9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:11.829940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ac94bbe-506b-449b-b7e5-5b7c442e8be9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:11.830486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ac94bbe-506b-449b-b7e5-5b7c442e8be9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:11.926158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-51668cea-2bf2-4fca-aaee-a9923f2e1926 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e/os-volume_attachments/36bd72e3-08dc-4ac4-b4a0-72d4b49aab9d" status: 202 len: 0 microversion: 2.1 time: 0.299780 Sep 14 19:51:11.929551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 875/1777] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Sep 14 19:51:11 2021] DELETE /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e/os-volume_attachments/36bd72e3-08dc-4ac4-b4a0-72d4b49aab9d => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:51:11.953013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8ac94bbe-506b-449b-b7e5-5b7c442e8be9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:11.960296 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8ac94bbe-506b-449b-b7e5-5b7c442e8be9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142746 Sep 14 19:51:11.960856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 903/1778] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:11 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:12.140086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5df83d44-59c3-4628-bb47-026ed6df9c0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:12.141077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5df83d44-59c3-4628-bb47-026ed6df9c0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:12.147053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5df83d44-59c3-4628-bb47-026ed6df9c0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.147495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5df83d44-59c3-4628-bb47-026ed6df9c0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.148257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5df83d44-59c3-4628-bb47-026ed6df9c0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.148686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5df83d44-59c3-4628-bb47-026ed6df9c0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.177020 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5df83d44-59c3-4628-bb47-026ed6df9c0a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040942 Sep 14 19:51:12.177490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 876/1779] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:12 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:12.249552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7cbf2d07-a6c7-460d-b324-a206c9d622a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:12.250453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7cbf2d07-a6c7-460d-b324-a206c9d622a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:12.256578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7cbf2d07-a6c7-460d-b324-a206c9d622a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.257061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7cbf2d07-a6c7-460d-b324-a206c9d622a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.257945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7cbf2d07-a6c7-460d-b324-a206c9d622a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.258385 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7cbf2d07-a6c7-460d-b324-a206c9d622a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.287774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7cbf2d07-a6c7-460d-b324-a206c9d622a0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042649 Sep 14 19:51:12.289594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 904/1780] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:12 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:12.456956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d9485a7a-001e-45c9-90f7-8a2f0b026488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:12.457438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d9485a7a-001e-45c9-90f7-8a2f0b026488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:12.463152 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9485a7a-001e-45c9-90f7-8a2f0b026488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.463590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9485a7a-001e-45c9-90f7-8a2f0b026488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.464341 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9485a7a-001e-45c9-90f7-8a2f0b026488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.464768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9485a7a-001e-45c9-90f7-8a2f0b026488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.489027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d9485a7a-001e-45c9-90f7-8a2f0b026488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Going to try to terminate instance {{(pid=115679) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 19:51:12.802826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5f936b69-a79c-4153-8779-16f0abb82174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:12.803679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5f936b69-a79c-4153-8779-16f0abb82174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:12.809472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f936b69-a79c-4153-8779-16f0abb82174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.809967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f936b69-a79c-4153-8779-16f0abb82174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.810757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f936b69-a79c-4153-8779-16f0abb82174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.811190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5f936b69-a79c-4153-8779-16f0abb82174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.821739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d9485a7a-001e-45c9-90f7-8a2f0b026488 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 204 len: 0 microversion: 2.1 time: 0.368073 Sep 14 19:51:12.822322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 877/1781] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 19:51:12 2021] DELETE /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:51:12.831823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e033990b-3704-4be5-bd23-cfd5c1e53dad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:12.832783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e033990b-3704-4be5-bd23-cfd5c1e53dad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:12.839818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e033990b-3704-4be5-bd23-cfd5c1e53dad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.840471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e033990b-3704-4be5-bd23-cfd5c1e53dad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.841906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e033990b-3704-4be5-bd23-cfd5c1e53dad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.842051 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5f936b69-a79c-4153-8779-16f0abb82174 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042727 Sep 14 19:51:12.842331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e033990b-3704-4be5-bd23-cfd5c1e53dad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.842614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 905/1782] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:12 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:12.963186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e033990b-3704-4be5-bd23-cfd5c1e53dad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:12.971017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e033990b-3704-4be5-bd23-cfd5c1e53dad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1671 microversion: 2.1 time: 0.143299 Sep 14 19:51:12.971585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 878/1783] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:12 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1671 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:12.977123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-36631575-45ca-4a44-a7b1-72ae95cbbde2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:12.977742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-36631575-45ca-4a44-a7b1-72ae95cbbde2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:12.983620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36631575-45ca-4a44-a7b1-72ae95cbbde2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.988763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36631575-45ca-4a44-a7b1-72ae95cbbde2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:12.988763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36631575-45ca-4a44-a7b1-72ae95cbbde2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:12.988763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36631575-45ca-4a44-a7b1-72ae95cbbde2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:13.106158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-36631575-45ca-4a44-a7b1-72ae95cbbde2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:13.113312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-36631575-45ca-4a44-a7b1-72ae95cbbde2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139835 Sep 14 19:51:13.113898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 906/1784] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:12 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:13.188838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-192075a9-cda8-48cd-9fa4-03590ea1071b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:13.189846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-192075a9-cda8-48cd-9fa4-03590ea1071b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:13.195661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-192075a9-cda8-48cd-9fa4-03590ea1071b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:13.196108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-192075a9-cda8-48cd-9fa4-03590ea1071b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:13.196878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-192075a9-cda8-48cd-9fa4-03590ea1071b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:13.197318 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-192075a9-cda8-48cd-9fa4-03590ea1071b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:13.281586 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-192075a9-cda8-48cd-9fa4-03590ea1071b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/action" status: 200 len: 84375 microversion: 2.1 time: 0.096822 Sep 14 19:51:13.282208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 879/1785] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:13 2021] POST /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0/action => generated 84375 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:13.299111 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1a3f2b39-121f-441a-b044-eb6451b450cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:13.300026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1a3f2b39-121f-441a-b044-eb6451b450cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:13.305807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a3f2b39-121f-441a-b044-eb6451b450cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:13.306260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a3f2b39-121f-441a-b044-eb6451b450cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:13.307068 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a3f2b39-121f-441a-b044-eb6451b450cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:13.307476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a3f2b39-121f-441a-b044-eb6451b450cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:13.337047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1a3f2b39-121f-441a-b044-eb6451b450cb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041878 Sep 14 19:51:13.337627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 907/1786] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:13 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:13.854283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7131fc9d-9898-4464-a4e3-c8b47b6ef74f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:13.855277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7131fc9d-9898-4464-a4e3-c8b47b6ef74f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:13.862450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7131fc9d-9898-4464-a4e3-c8b47b6ef74f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:13.862897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7131fc9d-9898-4464-a4e3-c8b47b6ef74f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:13.863702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7131fc9d-9898-4464-a4e3-c8b47b6ef74f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:13.864136 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7131fc9d-9898-4464-a4e3-c8b47b6ef74f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:13.893663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7131fc9d-9898-4464-a4e3-c8b47b6ef74f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043545 Sep 14 19:51:13.894470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 880/1787] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:13.988686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4a1da069-b76a-4a0e-9fe3-2f1bb23d4472 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:13.989282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4a1da069-b76a-4a0e-9fe3-2f1bb23d4472 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:13.995081 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a1da069-b76a-4a0e-9fe3-2f1bb23d4472 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:13.995529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a1da069-b76a-4a0e-9fe3-2f1bb23d4472 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:13.996366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a1da069-b76a-4a0e-9fe3-2f1bb23d4472 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:13.996873 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a1da069-b76a-4a0e-9fe3-2f1bb23d4472 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:14.091910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4a1da069-b76a-4a0e-9fe3-2f1bb23d4472 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:14.100543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4a1da069-b76a-4a0e-9fe3-2f1bb23d4472 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1604 microversion: 2.1 time: 0.115602 Sep 14 19:51:14.101110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 908/1788] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:13 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1604 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:14.130530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ae3c62b9-ebeb-4af3-9797-ef8df1d0249f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:14.131143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ae3c62b9-ebeb-4af3-9797-ef8df1d0249f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:14.137066 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae3c62b9-ebeb-4af3-9797-ef8df1d0249f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:14.137575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae3c62b9-ebeb-4af3-9797-ef8df1d0249f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:14.138825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae3c62b9-ebeb-4af3-9797-ef8df1d0249f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:14.139259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae3c62b9-ebeb-4af3-9797-ef8df1d0249f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:14.272744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ae3c62b9-ebeb-4af3-9797-ef8df1d0249f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:14.281291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ae3c62b9-ebeb-4af3-9797-ef8df1d0249f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.154337 Sep 14 19:51:14.282305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 881/1789] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:14 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:14.350387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cca188ff-d911-46bd-bd92-c147e214b0be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:14.352210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cca188ff-d911-46bd-bd92-c147e214b0be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:14.358734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cca188ff-d911-46bd-bd92-c147e214b0be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:14.359473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cca188ff-d911-46bd-bd92-c147e214b0be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:14.360298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cca188ff-d911-46bd-bd92-c147e214b0be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:14.360729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cca188ff-d911-46bd-bd92-c147e214b0be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:14.391953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cca188ff-d911-46bd-bd92-c147e214b0be tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046727 Sep 14 19:51:14.392521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 909/1790] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:14 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:14.607289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-e1213b8d-7cac-4927-8f42-168f97d1ac78 req-d0a24fb9-0476-4a4f-a950-46c907a79bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1719e572-6299-43f2-a47b-f1774166a3a6", "name": "network-vif-deleted", "tag": "532c332c-72bb-4af2-a240-857f96b8522b"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:14.611410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:51:14.611410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:51:14.616337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-e1213b8d-7cac-4927-8f42-168f97d1ac78 req-d0a24fb9-0476-4a4f-a950-46c907a79bc8 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:14.616776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-e1213b8d-7cac-4927-8f42-168f97d1ac78 req-d0a24fb9-0476-4a4f-a950-46c907a79bc8 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:14.630182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-e1213b8d-7cac-4927-8f42-168f97d1ac78 req-d0a24fb9-0476-4a4f-a950-46c907a79bc8 service nova] Creating event network-vif-deleted:532c332c-72bb-4af2-a240-857f96b8522b for instance 1719e572-6299-43f2-a47b-f1774166a3a6 on hv-cinder-80588 Sep 14 19:51:14.636539 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-e1213b8d-7cac-4927-8f42-168f97d1ac78 req-d0a24fb9-0476-4a4f-a950-46c907a79bc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091206 Sep 14 19:51:14.637140 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 882/1791] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:51:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:14.905225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-40d3ce15-6662-49fa-ab76-0924c2d092c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:14.906446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-40d3ce15-6662-49fa-ab76-0924c2d092c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:14.912933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40d3ce15-6662-49fa-ab76-0924c2d092c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:14.914650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40d3ce15-6662-49fa-ab76-0924c2d092c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:14.914650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40d3ce15-6662-49fa-ab76-0924c2d092c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:14.915811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40d3ce15-6662-49fa-ab76-0924c2d092c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:14.947382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-40d3ce15-6662-49fa-ab76-0924c2d092c8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046201 Sep 14 19:51:14.951500 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 910/1792] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:14 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:15.119173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:15.119883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:15.130276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:15.131025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:15.132002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:15.132450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:15.188204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:15.189004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:15.189004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lazy-loading 'fault' on Instance uuid 1719e572-6299-43f2-a47b-f1774166a3a6 {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:51:15.230505 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:15.238557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cb42a558-eab7-4092-a16a-8fef2786ff49 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 200 len: 1326 microversion: 2.1 time: 0.124071 Sep 14 19:51:15.239122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 883/1793] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:15 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:15.301374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-406c3ac9-50ed-4e7b-b7d5-77276d8f4c4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:15.307185 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-406c3ac9-50ed-4e7b-b7d5-77276d8f4c4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:15.313962 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-406c3ac9-50ed-4e7b-b7d5-77276d8f4c4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:15.314284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-406c3ac9-50ed-4e7b-b7d5-77276d8f4c4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:15.315057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-406c3ac9-50ed-4e7b-b7d5-77276d8f4c4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:15.315506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-406c3ac9-50ed-4e7b-b7d5-77276d8f4c4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:15.403013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eb616686-8830-46ce-a8a2-67908f82f046 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:15.404475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eb616686-8830-46ce-a8a2-67908f82f046 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:15.411625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb616686-8830-46ce-a8a2-67908f82f046 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:15.412050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb616686-8830-46ce-a8a2-67908f82f046 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:15.413110 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb616686-8830-46ce-a8a2-67908f82f046 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:15.419920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb616686-8830-46ce-a8a2-67908f82f046 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:15.456340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eb616686-8830-46ce-a8a2-67908f82f046 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056938 Sep 14 19:51:15.457311 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 884/1794] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:15 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:15.462989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-406c3ac9-50ed-4e7b-b7d5-77276d8f4c4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:15.471984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-406c3ac9-50ed-4e7b-b7d5-77276d8f4c4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.176094 Sep 14 19:51:15.481549 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 911/1795] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:15 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:15.958997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-43f65c5f-c994-4009-8453-13edf34e9c28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:15.959815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-43f65c5f-c994-4009-8453-13edf34e9c28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:15.965706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43f65c5f-c994-4009-8453-13edf34e9c28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:15.966794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43f65c5f-c994-4009-8453-13edf34e9c28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:15.967554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43f65c5f-c994-4009-8453-13edf34e9c28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:15.967986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43f65c5f-c994-4009-8453-13edf34e9c28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:15.995841 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-43f65c5f-c994-4009-8453-13edf34e9c28 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040691 Sep 14 19:51:15.996385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 885/1796] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:15 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:16.260102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-59066d38-04b6-4d8d-bab7-5b2c25e60e11 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:16.261031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-59066d38-04b6-4d8d-bab7-5b2c25e60e11 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:16.267750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59066d38-04b6-4d8d-bab7-5b2c25e60e11 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:16.268208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59066d38-04b6-4d8d-bab7-5b2c25e60e11 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:16.268998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59066d38-04b6-4d8d-bab7-5b2c25e60e11 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:16.269480 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-59066d38-04b6-4d8d-bab7-5b2c25e60e11 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:16.283931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-59066d38-04b6-4d8d-bab7-5b2c25e60e11 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] HTTP exception thrown: Instance 1719e572-6299-43f2-a47b-f1774166a3a6 could not be found. Sep 14 19:51:16.284392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-59066d38-04b6-4d8d-bab7-5b2c25e60e11 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Returning 404 to user: Instance 1719e572-6299-43f2-a47b-f1774166a3a6 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:51:16.285235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-59066d38-04b6-4d8d-bab7-5b2c25e60e11 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 404 len: 111 microversion: 2.1 time: 0.028945 Sep 14 19:51:16.285832 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 912/1797] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:16 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:51:16.294700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-32550073-1092-47e7-9fd6-873518994375 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '.version_select at 0x7fd0c8451e50>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:16.377362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-32550073-1092-47e7-9fd6-873518994375 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-417207832" status: 202 len: 0 microversion: 2.1 time: 0.086742 Sep 14 19:51:16.377983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 886/1798] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Sep 14 19:51:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-417207832 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:51:16.467908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dcee91ae-baed-403e-ae5c-efb945f992df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:16.468783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dcee91ae-baed-403e-ae5c-efb945f992df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:16.474615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcee91ae-baed-403e-ae5c-efb945f992df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:16.475062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcee91ae-baed-403e-ae5c-efb945f992df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:16.475838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcee91ae-baed-403e-ae5c-efb945f992df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:16.476273 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcee91ae-baed-403e-ae5c-efb945f992df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:16.496542 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3108c708-7c94-425c-8808-126cb7f71317 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:16.496542 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3108c708-7c94-425c-8808-126cb7f71317 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:16.505327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3108c708-7c94-425c-8808-126cb7f71317 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:16.506147 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3108c708-7c94-425c-8808-126cb7f71317 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:16.507218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3108c708-7c94-425c-8808-126cb7f71317 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:16.507873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3108c708-7c94-425c-8808-126cb7f71317 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:16.511127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dcee91ae-baed-403e-ae5c-efb945f992df tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047111 Sep 14 19:51:16.511713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 913/1799] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:16 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:16.663789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3108c708-7c94-425c-8808-126cb7f71317 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:16.671758 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3108c708-7c94-425c-8808-126cb7f71317 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.182444 Sep 14 19:51:16.672327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 887/1800] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:16 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:17.008363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e117e41d-8060-4ea5-8dd5-e002a853a113 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:17.011531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e117e41d-8060-4ea5-8dd5-e002a853a113 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:17.015148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e117e41d-8060-4ea5-8dd5-e002a853a113 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:17.015598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e117e41d-8060-4ea5-8dd5-e002a853a113 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:17.016369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e117e41d-8060-4ea5-8dd5-e002a853a113 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:17.016804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e117e41d-8060-4ea5-8dd5-e002a853a113 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:17.049949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e117e41d-8060-4ea5-8dd5-e002a853a113 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045697 Sep 14 19:51:17.050509 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 914/1801] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:17 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:17.155756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4ed5a4db-fa74-428c-bfcc-99f09a6204c0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'create', calling method: .version_select at 0x7fd0c84229d0>, body: {"keypair": {"name": "tempest-keypair-992678241"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:17.175068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-4ed5a4db-fa74-428c-bfcc-99f09a6204c0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:51:17.178993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-4ed5a4db-fa74-428c-bfcc-99f09a6204c0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for user 698509e250034b698e057bacbf44393d and project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:51:17.334361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-4ed5a4db-fa74-428c-bfcc-99f09a6204c0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:51:17.338017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-4ed5a4db-fa74-428c-bfcc-99f09a6204c0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for user 698509e250034b698e057bacbf44393d and project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'key_pairs'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:51:17.351403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4ed5a4db-fa74-428c-bfcc-99f09a6204c0 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.199994 Sep 14 19:51:17.352000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 888/1802] 10.222.0.58 () {60 vars in 1158 bytes} [Tue Sep 14 19:51:17 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:17.522526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ed4a0842-9d95-4007-8a7d-93ef118a6d4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:17.523394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ed4a0842-9d95-4007-8a7d-93ef118a6d4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:17.529381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed4a0842-9d95-4007-8a7d-93ef118a6d4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:17.529890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed4a0842-9d95-4007-8a7d-93ef118a6d4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:17.530665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed4a0842-9d95-4007-8a7d-93ef118a6d4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:17.531109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ed4a0842-9d95-4007-8a7d-93ef118a6d4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:17.561648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ed4a0842-9d95-4007-8a7d-93ef118a6d4d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042912 Sep 14 19:51:17.564733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 915/1803] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:17 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:17.688848 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3b677e02-0971-4e22-936c-f973290d212b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:17.689471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3b677e02-0971-4e22-936c-f973290d212b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:17.695604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b677e02-0971-4e22-936c-f973290d212b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:17.696971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b677e02-0971-4e22-936c-f973290d212b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:17.696971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b677e02-0971-4e22-936c-f973290d212b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:17.697283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b677e02-0971-4e22-936c-f973290d212b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:17.840659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3b677e02-0971-4e22-936c-f973290d212b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:17.848391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3b677e02-0971-4e22-936c-f973290d212b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.163955 Sep 14 19:51:17.848974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 889/1804] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:17 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:18.062365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-89cc7f88-f483-4ced-8e79-454c91628c01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:18.063226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-89cc7f88-f483-4ced-8e79-454c91628c01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:18.069214 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89cc7f88-f483-4ced-8e79-454c91628c01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:18.069714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89cc7f88-f483-4ced-8e79-454c91628c01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:18.070547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89cc7f88-f483-4ced-8e79-454c91628c01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:18.070987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89cc7f88-f483-4ced-8e79-454c91628c01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:18.101229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-89cc7f88-f483-4ced-8e79-454c91628c01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043427 Sep 14 19:51:18.101831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 916/1805] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:18 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:18.572624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f1482104-59f6-4a0f-911f-3c330f1b1933 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:18.573625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f1482104-59f6-4a0f-911f-3c330f1b1933 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:18.579735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f1482104-59f6-4a0f-911f-3c330f1b1933 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:18.580198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f1482104-59f6-4a0f-911f-3c330f1b1933 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:18.580964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f1482104-59f6-4a0f-911f-3c330f1b1933 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:18.581420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f1482104-59f6-4a0f-911f-3c330f1b1933 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:18.611340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f1482104-59f6-4a0f-911f-3c330f1b1933 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042726 Sep 14 19:51:18.611916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 890/1806] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:18 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:18.865886 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ffd79fd7-e5fd-4490-bd46-b775e8abc2f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:18.866615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ffd79fd7-e5fd-4490-bd46-b775e8abc2f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:18.872337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ffd79fd7-e5fd-4490-bd46-b775e8abc2f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:18.872946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ffd79fd7-e5fd-4490-bd46-b775e8abc2f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:18.873575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ffd79fd7-e5fd-4490-bd46-b775e8abc2f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:18.874012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ffd79fd7-e5fd-4490-bd46-b775e8abc2f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:18.998659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ffd79fd7-e5fd-4490-bd46-b775e8abc2f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:19.006285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ffd79fd7-e5fd-4490-bd46-b775e8abc2f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.144125 Sep 14 19:51:19.006887 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 917/1807] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:18 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:19.112629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-de167667-1a8b-4d93-9b87-dc8765eced08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:19.113561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-de167667-1a8b-4d93-9b87-dc8765eced08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:19.119532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de167667-1a8b-4d93-9b87-dc8765eced08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:19.119981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de167667-1a8b-4d93-9b87-dc8765eced08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:19.120746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de167667-1a8b-4d93-9b87-dc8765eced08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:19.121179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de167667-1a8b-4d93-9b87-dc8765eced08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:19.151017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-de167667-1a8b-4d93-9b87-dc8765eced08 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042145 Sep 14 19:51:19.151584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 891/1808] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:19.634116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f26e3152-9021-46c8-8870-58305f9581f8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:19.634116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f26e3152-9021-46c8-8870-58305f9581f8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:19.634116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f26e3152-9021-46c8-8870-58305f9581f8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:19.634116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f26e3152-9021-46c8-8870-58305f9581f8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:19.634589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f26e3152-9021-46c8-8870-58305f9581f8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:19.634589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f26e3152-9021-46c8-8870-58305f9581f8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:19.660737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f26e3152-9021-46c8-8870-58305f9581f8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041753 Sep 14 19:51:19.661297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 918/1809] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:19 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:19.899569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-17575773", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58da4d12-7d41-4731-a464-9cffcf13229f"}], "security_groups": [{"name": "tempest-securitygroup--1039971813"}], "key_name": "tempest-keypair-992678241", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:19.990947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] validate_networks() for [('58da4d12-7d41-4731-a464-9cffcf13229f', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 19:51:20.023906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4cb21459-4f00-4db3-9231-5e5cab450a1d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:20.024663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4cb21459-4f00-4db3-9231-5e5cab450a1d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:20.031313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4cb21459-4f00-4db3-9231-5e5cab450a1d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:20.031707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4cb21459-4f00-4db3-9231-5e5cab450a1d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:20.032489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4cb21459-4f00-4db3-9231-5e5cab450a1d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:20.033147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4cb21459-4f00-4db3-9231-5e5cab450a1d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:20.178368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4cb21459-4f00-4db3-9231-5e5cab450a1d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:20.184191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4cb21459-4f00-4db3-9231-5e5cab450a1d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.163853 Sep 14 19:51:20.184755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 919/1810] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:20 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:20.189249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f6edc8e9-97ce-476a-8b51-8a38987e3ab8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:20.190154 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f6edc8e9-97ce-476a-8b51-8a38987e3ab8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:20.196405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6edc8e9-97ce-476a-8b51-8a38987e3ab8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:20.196755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6edc8e9-97ce-476a-8b51-8a38987e3ab8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:20.197938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6edc8e9-97ce-476a-8b51-8a38987e3ab8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:20.198373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6edc8e9-97ce-476a-8b51-8a38987e3ab8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:20.228950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f6edc8e9-97ce-476a-8b51-8a38987e3ab8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043094 Sep 14 19:51:20.229535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 920/1811] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:20.415613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:51:20.416036 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:51:20.416509 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:51:20.416974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:51:20.417384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:51:20.428710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:20.429091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:20.429983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:20.430513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:20.447274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 19:51:20.452041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Getting quotas for user 698509e250034b698e057bacbf44393d and project a684e190277744a3b1786dc4bf5fe1e7. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 19:51:20.463610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 19:51:20.466522 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 19:51:20.612467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d905462b-a7c1-4f60-8055-8e0e754face2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.716837 Sep 14 19:51:20.613377 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 892/1812] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 19:51:19 2021] POST /compute/v2.1/servers => generated 402 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:51:20.623508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-925504b9-224e-4e6c-8c8e-30e5ba9f02d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:20.624109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-925504b9-224e-4e6c-8c8e-30e5ba9f02d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:20.672558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-30ebd1a9-3aeb-49d4-9d9f-b2729870933e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:20.674271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-30ebd1a9-3aeb-49d4-9d9f-b2729870933e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:20.676508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-925504b9-224e-4e6c-8c8e-30e5ba9f02d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:20.680664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30ebd1a9-3aeb-49d4-9d9f-b2729870933e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:20.681407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30ebd1a9-3aeb-49d4-9d9f-b2729870933e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:20.682353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30ebd1a9-3aeb-49d4-9d9f-b2729870933e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:20.682985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-30ebd1a9-3aeb-49d4-9d9f-b2729870933e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:20.683510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-925504b9-224e-4e6c-8c8e-30e5ba9f02d2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1235 microversion: 2.1 time: 0.063999 Sep 14 19:51:20.684089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 921/1813] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:20 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1235 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:20.722266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-30ebd1a9-3aeb-49d4-9d9f-b2729870933e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053945 Sep 14 19:51:20.722837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 893/1814] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:20 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:21.201935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c966ca34-1b9c-4d12-a1ea-09bbf7966efb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:21.202548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c966ca34-1b9c-4d12-a1ea-09bbf7966efb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:21.208816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c966ca34-1b9c-4d12-a1ea-09bbf7966efb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:21.209308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c966ca34-1b9c-4d12-a1ea-09bbf7966efb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:21.210121 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c966ca34-1b9c-4d12-a1ea-09bbf7966efb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:21.210563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c966ca34-1b9c-4d12-a1ea-09bbf7966efb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:21.240574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fa1fdef5-7db1-411d-afe4-88b762d4f492 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:21.241676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fa1fdef5-7db1-411d-afe4-88b762d4f492 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:21.248650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa1fdef5-7db1-411d-afe4-88b762d4f492 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:21.249166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa1fdef5-7db1-411d-afe4-88b762d4f492 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:21.250071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa1fdef5-7db1-411d-afe4-88b762d4f492 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:21.250562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa1fdef5-7db1-411d-afe4-88b762d4f492 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:21.281012 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fa1fdef5-7db1-411d-afe4-88b762d4f492 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044255 Sep 14 19:51:21.281850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 894/1815] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:21 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:21.337647 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c966ca34-1b9c-4d12-a1ea-09bbf7966efb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:21.345740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c966ca34-1b9c-4d12-a1ea-09bbf7966efb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.147380 Sep 14 19:51:21.348717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 922/1816] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:21 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:21.701350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-43b75f9d-1831-4644-b3fa-e9fc6a94af84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:21.701980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-43b75f9d-1831-4644-b3fa-e9fc6a94af84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:21.707744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43b75f9d-1831-4644-b3fa-e9fc6a94af84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:21.709680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43b75f9d-1831-4644-b3fa-e9fc6a94af84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:21.709680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43b75f9d-1831-4644-b3fa-e9fc6a94af84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:21.709680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43b75f9d-1831-4644-b3fa-e9fc6a94af84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:21.733644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ff255769-4391-40e9-bf32-ffb09be1813c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:21.734549 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ff255769-4391-40e9-bf32-ffb09be1813c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:21.741172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff255769-4391-40e9-bf32-ffb09be1813c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:21.741803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff255769-4391-40e9-bf32-ffb09be1813c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:21.742520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff255769-4391-40e9-bf32-ffb09be1813c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:21.742952 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff255769-4391-40e9-bf32-ffb09be1813c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:21.768366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-43b75f9d-1831-4644-b3fa-e9fc6a94af84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:21.772487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ff255769-4391-40e9-bf32-ffb09be1813c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042642 Sep 14 19:51:21.773286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 923/1817] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:21 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:21.775658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-43b75f9d-1831-4644-b3fa-e9fc6a94af84 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1239 microversion: 2.1 time: 0.078546 Sep 14 19:51:21.776233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 895/1818] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:21 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:22.292508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e89c03f7-d570-457c-933f-1a25b697b9f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:22.293402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e89c03f7-d570-457c-933f-1a25b697b9f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:22.300169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e89c03f7-d570-457c-933f-1a25b697b9f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:22.300608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e89c03f7-d570-457c-933f-1a25b697b9f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:22.301371 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e89c03f7-d570-457c-933f-1a25b697b9f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:22.301828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e89c03f7-d570-457c-933f-1a25b697b9f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:22.330342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e89c03f7-d570-457c-933f-1a25b697b9f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041562 Sep 14 19:51:22.330895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 924/1819] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:22 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:22.362896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-db26384f-e5ea-410d-9f15-a5d8bc347feb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:22.363490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-db26384f-e5ea-410d-9f15-a5d8bc347feb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:22.369222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-db26384f-e5ea-410d-9f15-a5d8bc347feb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:22.369707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-db26384f-e5ea-410d-9f15-a5d8bc347feb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:22.370460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-db26384f-e5ea-410d-9f15-a5d8bc347feb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:22.370887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-db26384f-e5ea-410d-9f15-a5d8bc347feb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:22.489407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-db26384f-e5ea-410d-9f15-a5d8bc347feb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:22.496832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-db26384f-e5ea-410d-9f15-a5d8bc347feb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137496 Sep 14 19:51:22.497401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 896/1820] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:22 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:22.783919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c245344a-2dbf-467c-808a-91857b121bc5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:22.784819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c245344a-2dbf-467c-808a-91857b121bc5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:22.791611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c245344a-2dbf-467c-808a-91857b121bc5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:22.792053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c245344a-2dbf-467c-808a-91857b121bc5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:22.796789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c245344a-2dbf-467c-808a-91857b121bc5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:22.799470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c245344a-2dbf-467c-808a-91857b121bc5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:22.801090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-51db862e-449e-44f2-81f4-01ef9213716b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:22.802457 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-51db862e-449e-44f2-81f4-01ef9213716b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:22.815407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51db862e-449e-44f2-81f4-01ef9213716b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:22.816258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51db862e-449e-44f2-81f4-01ef9213716b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:22.817276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51db862e-449e-44f2-81f4-01ef9213716b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:22.818510 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51db862e-449e-44f2-81f4-01ef9213716b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:22.840938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c245344a-2dbf-467c-808a-91857b121bc5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060020 Sep 14 19:51:22.844616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 925/1821] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:22 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:22.886921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-51db862e-449e-44f2-81f4-01ef9213716b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:22.893078 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-51db862e-449e-44f2-81f4-01ef9213716b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1295 microversion: 2.1 time: 0.104750 Sep 14 19:51:22.893790 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 897/1822] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:22 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:23.341592 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4c43f4f8-08ab-4830-8332-a1143523b90c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:23.342426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4c43f4f8-08ab-4830-8332-a1143523b90c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:23.348614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4c43f4f8-08ab-4830-8332-a1143523b90c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:23.349054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4c43f4f8-08ab-4830-8332-a1143523b90c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:23.349892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4c43f4f8-08ab-4830-8332-a1143523b90c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:23.350388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4c43f4f8-08ab-4830-8332-a1143523b90c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:23.382013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4c43f4f8-08ab-4830-8332-a1143523b90c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044244 Sep 14 19:51:23.382582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 926/1823] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:23.513350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-762f7e47-06e5-4368-851a-90a7146bef6a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:23.513996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-762f7e47-06e5-4368-851a-90a7146bef6a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:23.520181 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-762f7e47-06e5-4368-851a-90a7146bef6a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:23.520628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-762f7e47-06e5-4368-851a-90a7146bef6a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:23.521447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-762f7e47-06e5-4368-851a-90a7146bef6a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:23.522122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-762f7e47-06e5-4368-851a-90a7146bef6a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:23.658480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-762f7e47-06e5-4368-851a-90a7146bef6a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:23.666378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-762f7e47-06e5-4368-851a-90a7146bef6a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.156796 Sep 14 19:51:23.666952 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 898/1824] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:23 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:23.851900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9db3feaf-c818-495e-aed6-60a7a4b10dcd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:23.852845 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9db3feaf-c818-495e-aed6-60a7a4b10dcd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:23.859308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9db3feaf-c818-495e-aed6-60a7a4b10dcd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:23.859752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9db3feaf-c818-495e-aed6-60a7a4b10dcd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:23.860574 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9db3feaf-c818-495e-aed6-60a7a4b10dcd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:23.860953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9db3feaf-c818-495e-aed6-60a7a4b10dcd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:23.890231 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9db3feaf-c818-495e-aed6-60a7a4b10dcd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042067 Sep 14 19:51:23.890802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 927/1825] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:23 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:23.914601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-28f642c3-239f-40fa-a106-88d44f3ae947 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:23.914601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-28f642c3-239f-40fa-a106-88d44f3ae947 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:23.917030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28f642c3-239f-40fa-a106-88d44f3ae947 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:23.917479 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28f642c3-239f-40fa-a106-88d44f3ae947 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:23.918295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28f642c3-239f-40fa-a106-88d44f3ae947 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:23.919280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28f642c3-239f-40fa-a106-88d44f3ae947 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:24.042865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-28f642c3-239f-40fa-a106-88d44f3ae947 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:24.052639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-28f642c3-239f-40fa-a106-88d44f3ae947 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1361 microversion: 2.1 time: 0.144610 Sep 14 19:51:24.062307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 899/1826] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:23 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:24.311169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-bbbfda19-d35e-443f-8eb9-6625fee4de29 req-26c5bade-234f-4d2c-9b64-d857a320b450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e617ad6d-c91d-4057-afb6-d220eb42ef28", "tag": "f3696efd-758e-4203-88ab-508f85e16b9d"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:24.312866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:51:24.312866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:51:24.321170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-bbbfda19-d35e-443f-8eb9-6625fee4de29 req-26c5bade-234f-4d2c-9b64-d857a320b450 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:24.321656 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-bbbfda19-d35e-443f-8eb9-6625fee4de29 req-26c5bade-234f-4d2c-9b64-d857a320b450 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:24.347026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-bbbfda19-d35e-443f-8eb9-6625fee4de29 req-26c5bade-234f-4d2c-9b64-d857a320b450 service nova] Creating event network-changed:f3696efd-758e-4203-88ab-508f85e16b9d for instance e617ad6d-c91d-4057-afb6-d220eb42ef28 on hv-cinder-80588 Sep 14 19:51:24.350560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: ERROR oslo.messaging._drivers.impl_rabbit [req-bbbfda19-d35e-443f-8eb9-6625fee4de29 req-26c5bade-234f-4d2c-9b64-d857a320b450 service nova] [be40a7f7-c728-4f69-b1e1-eb83623c0c29] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 19:51:24.393081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-12f2063b-9e86-41be-aa80-9239368985b0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:24.394148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-12f2063b-9e86-41be-aa80-9239368985b0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:24.401036 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12f2063b-9e86-41be-aa80-9239368985b0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:24.401587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12f2063b-9e86-41be-aa80-9239368985b0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:24.402574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12f2063b-9e86-41be-aa80-9239368985b0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:24.403623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12f2063b-9e86-41be-aa80-9239368985b0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:24.437050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-12f2063b-9e86-41be-aa80-9239368985b0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047776 Sep 14 19:51:24.437914 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 900/1827] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:24.683784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ece8aed9-a0b6-4678-bd43-4442cf1a2ebe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:24.685210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ece8aed9-a0b6-4678-bd43-4442cf1a2ebe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:24.691089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ece8aed9-a0b6-4678-bd43-4442cf1a2ebe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:24.691534 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ece8aed9-a0b6-4678-bd43-4442cf1a2ebe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:24.692317 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ece8aed9-a0b6-4678-bd43-4442cf1a2ebe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:24.692837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ece8aed9-a0b6-4678-bd43-4442cf1a2ebe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:24.815700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ece8aed9-a0b6-4678-bd43-4442cf1a2ebe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:24.823261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ece8aed9-a0b6-4678-bd43-4442cf1a2ebe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143777 Sep 14 19:51:24.823867 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 901/1828] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:24 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:24.901617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-198951e9-af77-4604-9aab-e94fe718ef6b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:24.902542 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-198951e9-af77-4604-9aab-e94fe718ef6b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:24.909133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-198951e9-af77-4604-9aab-e94fe718ef6b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:24.909603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-198951e9-af77-4604-9aab-e94fe718ef6b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:24.910366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-198951e9-af77-4604-9aab-e94fe718ef6b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:24.910786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-198951e9-af77-4604-9aab-e94fe718ef6b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:24.939375 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-198951e9-af77-4604-9aab-e94fe718ef6b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041673 Sep 14 19:51:24.939846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 902/1829] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:24 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:25.068688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-547afc20-d1d3-4215-a532-d28794c8e172 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:25.069316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-547afc20-d1d3-4215-a532-d28794c8e172 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:25.075942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-547afc20-d1d3-4215-a532-d28794c8e172 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:25.076382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-547afc20-d1d3-4215-a532-d28794c8e172 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:25.077130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-547afc20-d1d3-4215-a532-d28794c8e172 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:25.077585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-547afc20-d1d3-4215-a532-d28794c8e172 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:25.196029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-547afc20-d1d3-4215-a532-d28794c8e172 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:25.203933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-547afc20-d1d3-4215-a532-d28794c8e172 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1361 microversion: 2.1 time: 0.138741 Sep 14 19:51:25.204507 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 903/1830] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:25 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1361 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:25.367307 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [req-bbbfda19-d35e-443f-8eb9-6625fee4de29 req-26c5bade-234f-4d2c-9b64-d857a320b450 service nova] [be40a7f7-c728-4f69-b1e1-eb83623c0c29] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 56438. Sep 14 19:51:25.370755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-bbbfda19-d35e-443f-8eb9-6625fee4de29 req-26c5bade-234f-4d2c-9b64-d857a320b450 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.064333 Sep 14 19:51:25.371390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 928/1831] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:51:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:25.448430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b9aeb0d9-16f1-4110-9d22-520ace186cbc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:25.449266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b9aeb0d9-16f1-4110-9d22-520ace186cbc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:25.455317 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b9aeb0d9-16f1-4110-9d22-520ace186cbc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:25.455758 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b9aeb0d9-16f1-4110-9d22-520ace186cbc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:25.456528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b9aeb0d9-16f1-4110-9d22-520ace186cbc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:25.456957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b9aeb0d9-16f1-4110-9d22-520ace186cbc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:25.486594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b9aeb0d9-16f1-4110-9d22-520ace186cbc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041962 Sep 14 19:51:25.487301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 904/1832] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:25.841761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f815ccab-7b4a-4e01-a3a9-962a5debc7e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:25.842459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f815ccab-7b4a-4e01-a3a9-962a5debc7e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:25.848829 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f815ccab-7b4a-4e01-a3a9-962a5debc7e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:25.849275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f815ccab-7b4a-4e01-a3a9-962a5debc7e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:25.850086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f815ccab-7b4a-4e01-a3a9-962a5debc7e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:25.850522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f815ccab-7b4a-4e01-a3a9-962a5debc7e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:25.950581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-97bafa95-54db-4606-b6e2-2d43dd5366bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:25.951481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-97bafa95-54db-4606-b6e2-2d43dd5366bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:25.957227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97bafa95-54db-4606-b6e2-2d43dd5366bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:25.957716 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97bafa95-54db-4606-b6e2-2d43dd5366bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:25.958483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97bafa95-54db-4606-b6e2-2d43dd5366bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:25.958911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97bafa95-54db-4606-b6e2-2d43dd5366bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:25.978891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f815ccab-7b4a-4e01-a3a9-962a5debc7e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:25.986975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f815ccab-7b4a-4e01-a3a9-962a5debc7e9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.149843 Sep 14 19:51:25.987545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 929/1833] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:25 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:25.990366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-97bafa95-54db-4606-b6e2-2d43dd5366bd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043533 Sep 14 19:51:25.990928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 905/1834] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:25 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:26.221278 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5d35179f-f92d-47d7-9971-0aa2f6b0dc26 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:26.221904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5d35179f-f92d-47d7-9971-0aa2f6b0dc26 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:26.227813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d35179f-f92d-47d7-9971-0aa2f6b0dc26 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:26.228254 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d35179f-f92d-47d7-9971-0aa2f6b0dc26 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:26.229024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d35179f-f92d-47d7-9971-0aa2f6b0dc26 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:26.229458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d35179f-f92d-47d7-9971-0aa2f6b0dc26 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:26.349400 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5d35179f-f92d-47d7-9971-0aa2f6b0dc26 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:26.356689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5d35179f-f92d-47d7-9971-0aa2f6b0dc26 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1361 microversion: 2.1 time: 0.139033 Sep 14 19:51:26.357238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 930/1835] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:26 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1361 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:26.498861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c7854a21-d8e8-4e2d-a69c-b95d26513607 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:26.499799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c7854a21-d8e8-4e2d-a69c-b95d26513607 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:26.511207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c7854a21-d8e8-4e2d-a69c-b95d26513607 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:26.511652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c7854a21-d8e8-4e2d-a69c-b95d26513607 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:26.512490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c7854a21-d8e8-4e2d-a69c-b95d26513607 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:26.512923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c7854a21-d8e8-4e2d-a69c-b95d26513607 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:26.544828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c7854a21-d8e8-4e2d-a69c-b95d26513607 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050094 Sep 14 19:51:26.545761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 906/1836] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:27.003931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-54037207-a8e4-4094-8ee5-454ba0cb7222 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:27.004532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-54037207-a8e4-4094-8ee5-454ba0cb7222 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:27.010383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54037207-a8e4-4094-8ee5-454ba0cb7222 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:27.010827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54037207-a8e4-4094-8ee5-454ba0cb7222 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:27.011586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54037207-a8e4-4094-8ee5-454ba0cb7222 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:27.012013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54037207-a8e4-4094-8ee5-454ba0cb7222 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:27.013186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8a9a2521-e249-44c8-9085-d7c307678ba4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:27.014139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8a9a2521-e249-44c8-9085-d7c307678ba4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:27.019976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a9a2521-e249-44c8-9085-d7c307678ba4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:27.020442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a9a2521-e249-44c8-9085-d7c307678ba4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:27.021229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a9a2521-e249-44c8-9085-d7c307678ba4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:27.021699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a9a2521-e249-44c8-9085-d7c307678ba4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:27.052082 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8a9a2521-e249-44c8-9085-d7c307678ba4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043813 Sep 14 19:51:27.052661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 907/1837] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:27 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:27.135463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-54037207-a8e4-4094-8ee5-454ba0cb7222 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:27.143119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-54037207-a8e4-4094-8ee5-454ba0cb7222 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142769 Sep 14 19:51:27.143703 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 931/1838] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:26 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:27.373395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-11e2a522-733d-44d7-a398-eed5fa0ef23f tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:27.374018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-11e2a522-733d-44d7-a398-eed5fa0ef23f tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:27.379734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11e2a522-733d-44d7-a398-eed5fa0ef23f tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:27.380176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11e2a522-733d-44d7-a398-eed5fa0ef23f tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:27.380930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11e2a522-733d-44d7-a398-eed5fa0ef23f tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:27.381357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11e2a522-733d-44d7-a398-eed5fa0ef23f tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:27.506266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-11e2a522-733d-44d7-a398-eed5fa0ef23f tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:27.513620 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-11e2a522-733d-44d7-a398-eed5fa0ef23f tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1361 microversion: 2.1 time: 0.143866 Sep 14 19:51:27.514297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 908/1839] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:27 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:27.558330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-55bce7b6-bdf4-4afb-9e4b-dbf9528db401 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:27.559288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-55bce7b6-bdf4-4afb-9e4b-dbf9528db401 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:27.565252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55bce7b6-bdf4-4afb-9e4b-dbf9528db401 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:27.565743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55bce7b6-bdf4-4afb-9e4b-dbf9528db401 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:27.566575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55bce7b6-bdf4-4afb-9e4b-dbf9528db401 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:27.567004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55bce7b6-bdf4-4afb-9e4b-dbf9528db401 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:27.596938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-55bce7b6-bdf4-4afb-9e4b-dbf9528db401 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042416 Sep 14 19:51:27.597520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 932/1840] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:27 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:28.064174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0364ae55-1b88-4117-acf2-7c76141f647d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:28.065098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0364ae55-1b88-4117-acf2-7c76141f647d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:28.070877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0364ae55-1b88-4117-acf2-7c76141f647d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:28.071318 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0364ae55-1b88-4117-acf2-7c76141f647d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:28.072079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0364ae55-1b88-4117-acf2-7c76141f647d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:28.072503 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0364ae55-1b88-4117-acf2-7c76141f647d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:28.109019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0364ae55-1b88-4117-acf2-7c76141f647d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 Sep 14 19:51:28.109019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 909/1841] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:28 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:28.160029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7b602858-a3a8-4a0f-a9c0-f0e2e225f059 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:28.160808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7b602858-a3a8-4a0f-a9c0-f0e2e225f059 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:28.166714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b602858-a3a8-4a0f-a9c0-f0e2e225f059 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:28.167166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b602858-a3a8-4a0f-a9c0-f0e2e225f059 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:28.167945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b602858-a3a8-4a0f-a9c0-f0e2e225f059 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:28.168422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b602858-a3a8-4a0f-a9c0-f0e2e225f059 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:28.291881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7b602858-a3a8-4a0f-a9c0-f0e2e225f059 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:28.299538 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7b602858-a3a8-4a0f-a9c0-f0e2e225f059 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143279 Sep 14 19:51:28.300100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 933/1842] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:28 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:28.531030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2f8ebc0e-eec3-4df2-ab75-1ff5e47364e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:28.531711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2f8ebc0e-eec3-4df2-ab75-1ff5e47364e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:28.537695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f8ebc0e-eec3-4df2-ab75-1ff5e47364e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:28.538145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f8ebc0e-eec3-4df2-ab75-1ff5e47364e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:28.539624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f8ebc0e-eec3-4df2-ab75-1ff5e47364e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:28.539624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f8ebc0e-eec3-4df2-ab75-1ff5e47364e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:28.608839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a6842764-f594-44d9-8d5e-258f997dd517 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:28.609837 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a6842764-f594-44d9-8d5e-258f997dd517 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:28.615865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6842764-f594-44d9-8d5e-258f997dd517 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:28.616311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6842764-f594-44d9-8d5e-258f997dd517 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:28.617088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6842764-f594-44d9-8d5e-258f997dd517 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:28.617566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6842764-f594-44d9-8d5e-258f997dd517 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:28.648022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a6842764-f594-44d9-8d5e-258f997dd517 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043535 Sep 14 19:51:28.648805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 934/1843] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:28 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:28.670352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2f8ebc0e-eec3-4df2-ab75-1ff5e47364e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:28.678106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2f8ebc0e-eec3-4df2-ab75-1ff5e47364e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1361 microversion: 2.1 time: 0.150704 Sep 14 19:51:28.678625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 910/1844] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:28 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:28.712359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-da21e43b-7eef-43db-ab46-3ea89cf05944 req-3945955e-e0f1-49a7-9b49-4ea252032785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e617ad6d-c91d-4057-afb6-d220eb42ef28", "name": "network-vif-plugged", "status": "completed", "tag": "f3696efd-758e-4203-88ab-508f85e16b9d"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:28.713951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:51:28.713951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:51:28.721337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-da21e43b-7eef-43db-ab46-3ea89cf05944 req-3945955e-e0f1-49a7-9b49-4ea252032785 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:28.721808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-da21e43b-7eef-43db-ab46-3ea89cf05944 req-3945955e-e0f1-49a7-9b49-4ea252032785 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:28.734519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-da21e43b-7eef-43db-ab46-3ea89cf05944 req-3945955e-e0f1-49a7-9b49-4ea252032785 service nova] Creating event network-vif-plugged:f3696efd-758e-4203-88ab-508f85e16b9d for instance e617ad6d-c91d-4057-afb6-d220eb42ef28 on hv-cinder-80588 Sep 14 19:51:28.739855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-da21e43b-7eef-43db-ab46-3ea89cf05944 req-3945955e-e0f1-49a7-9b49-4ea252032785 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086762 Sep 14 19:51:28.740725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 935/1845] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:51:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:29.118348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3f9dce3b-5777-466b-a14e-c7ca25e145fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:29.119249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3f9dce3b-5777-466b-a14e-c7ca25e145fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:29.126238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f9dce3b-5777-466b-a14e-c7ca25e145fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:29.126842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f9dce3b-5777-466b-a14e-c7ca25e145fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:29.127628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f9dce3b-5777-466b-a14e-c7ca25e145fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:29.128096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f9dce3b-5777-466b-a14e-c7ca25e145fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:29.159115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3f9dce3b-5777-466b-a14e-c7ca25e145fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Sep 14 19:51:29.159681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 911/1846] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:29 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:29.316995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-79b05c25-cf86-41e6-897b-f3ae312dd75a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:29.317701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-79b05c25-cf86-41e6-897b-f3ae312dd75a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:29.323663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79b05c25-cf86-41e6-897b-f3ae312dd75a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:29.324103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79b05c25-cf86-41e6-897b-f3ae312dd75a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:29.324906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79b05c25-cf86-41e6-897b-f3ae312dd75a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:29.325290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79b05c25-cf86-41e6-897b-f3ae312dd75a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:29.448185 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-79b05c25-cf86-41e6-897b-f3ae312dd75a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:29.455990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-79b05c25-cf86-41e6-897b-f3ae312dd75a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143023 Sep 14 19:51:29.456552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 936/1847] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:29 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:29.659226 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ff5979af-44d5-433f-a410-433749e7f419 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:29.660115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ff5979af-44d5-433f-a410-433749e7f419 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:29.666257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff5979af-44d5-433f-a410-433749e7f419 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:29.666698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff5979af-44d5-433f-a410-433749e7f419 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:29.667451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff5979af-44d5-433f-a410-433749e7f419 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:29.667877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff5979af-44d5-433f-a410-433749e7f419 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:29.695223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0c0dbb98-8746-43ee-b30b-09ad7006ab3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:29.696015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0c0dbb98-8746-43ee-b30b-09ad7006ab3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:29.697277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ff5979af-44d5-433f-a410-433749e7f419 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041738 Sep 14 19:51:29.697886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 912/1848] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:29 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:29.701928 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0c0dbb98-8746-43ee-b30b-09ad7006ab3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:29.702378 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0c0dbb98-8746-43ee-b30b-09ad7006ab3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:29.703161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0c0dbb98-8746-43ee-b30b-09ad7006ab3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:29.703601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0c0dbb98-8746-43ee-b30b-09ad7006ab3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:29.828697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0c0dbb98-8746-43ee-b30b-09ad7006ab3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:29.837192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0c0dbb98-8746-43ee-b30b-09ad7006ab3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1361 microversion: 2.1 time: 0.145584 Sep 14 19:51:29.837794 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 937/1849] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:29 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:30.170474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-365baab6-0fc5-4da4-9f97-f2fd684ae367 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:30.171367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-365baab6-0fc5-4da4-9f97-f2fd684ae367 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:30.177406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-365baab6-0fc5-4da4-9f97-f2fd684ae367 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:30.177874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-365baab6-0fc5-4da4-9f97-f2fd684ae367 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:30.178630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-365baab6-0fc5-4da4-9f97-f2fd684ae367 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:30.179058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-365baab6-0fc5-4da4-9f97-f2fd684ae367 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:30.207931 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-365baab6-0fc5-4da4-9f97-f2fd684ae367 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041213 Sep 14 19:51:30.208483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 913/1850] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:30 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:30.472664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-98661250-f6b5-4f05-8146-2cef0f1867ff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:30.473261 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-98661250-f6b5-4f05-8146-2cef0f1867ff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:30.479280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98661250-f6b5-4f05-8146-2cef0f1867ff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:30.479731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98661250-f6b5-4f05-8146-2cef0f1867ff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:30.480540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98661250-f6b5-4f05-8146-2cef0f1867ff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:30.480974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98661250-f6b5-4f05-8146-2cef0f1867ff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:30.600866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-98661250-f6b5-4f05-8146-2cef0f1867ff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:30.608840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-98661250-f6b5-4f05-8146-2cef0f1867ff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139864 Sep 14 19:51:30.609679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 938/1851] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:30 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:30.707968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9788b853-55e0-4a5f-ad4c-7703b4b53a7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:30.708861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9788b853-55e0-4a5f-ad4c-7703b4b53a7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:30.714649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9788b853-55e0-4a5f-ad4c-7703b4b53a7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:30.715094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9788b853-55e0-4a5f-ad4c-7703b4b53a7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:30.715864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9788b853-55e0-4a5f-ad4c-7703b4b53a7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:30.716855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9788b853-55e0-4a5f-ad4c-7703b4b53a7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:30.745760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9788b853-55e0-4a5f-ad4c-7703b4b53a7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041488 Sep 14 19:51:30.746305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 914/1852] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:30 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:30.854909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b2e0410d-dead-4eb3-8653-17297a9be7e7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:30.855518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b2e0410d-dead-4eb3-8653-17297a9be7e7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:30.861883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2e0410d-dead-4eb3-8653-17297a9be7e7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:30.862333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2e0410d-dead-4eb3-8653-17297a9be7e7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:30.863120 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2e0410d-dead-4eb3-8653-17297a9be7e7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:30.863556 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b2e0410d-dead-4eb3-8653-17297a9be7e7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:30.985870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b2e0410d-dead-4eb3-8653-17297a9be7e7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:30.993143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b2e0410d-dead-4eb3-8653-17297a9be7e7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1546 microversion: 2.1 time: 0.141873 Sep 14 19:51:30.993747 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 939/1853] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:30 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1546 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:31.009236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d7227c36-90cf-49fe-bcaa-d77dea62fd07 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:31.009786 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d7227c36-90cf-49fe-bcaa-d77dea62fd07 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:31.016272 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d7227c36-90cf-49fe-bcaa-d77dea62fd07 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:31.016723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d7227c36-90cf-49fe-bcaa-d77dea62fd07 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:31.017504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d7227c36-90cf-49fe-bcaa-d77dea62fd07 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:31.017961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d7227c36-90cf-49fe-bcaa-d77dea62fd07 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:31.100831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d7227c36-90cf-49fe-bcaa-d77dea62fd07 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095249 Sep 14 19:51:31.101418 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 915/1854] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Sep 14 19:51:31 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:31.220025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2f8afdf5-5e99-4a06-816f-ee4e464cdd7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:31.220990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2f8afdf5-5e99-4a06-816f-ee4e464cdd7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:31.226953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f8afdf5-5e99-4a06-816f-ee4e464cdd7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:31.227734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f8afdf5-5e99-4a06-816f-ee4e464cdd7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:31.231802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f8afdf5-5e99-4a06-816f-ee4e464cdd7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:31.232240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f8afdf5-5e99-4a06-816f-ee4e464cdd7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:31.261647 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2f8afdf5-5e99-4a06-816f-ee4e464cdd7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046020 Sep 14 19:51:31.266006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 940/1855] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:31 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:31.625948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-85203664-05e0-4a48-ac32-9410138299b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:31.626533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-85203664-05e0-4a48-ac32-9410138299b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:31.632402 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85203664-05e0-4a48-ac32-9410138299b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:31.632850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85203664-05e0-4a48-ac32-9410138299b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:31.633646 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85203664-05e0-4a48-ac32-9410138299b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:31.634069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85203664-05e0-4a48-ac32-9410138299b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:31.757094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-12fabf82-8bd2-480a-9c2f-eafade7aa032 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:31.758031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-12fabf82-8bd2-480a-9c2f-eafade7aa032 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:31.764456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-12fabf82-8bd2-480a-9c2f-eafade7aa032 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:31.764909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-12fabf82-8bd2-480a-9c2f-eafade7aa032 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:31.765719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-12fabf82-8bd2-480a-9c2f-eafade7aa032 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:31.766167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-12fabf82-8bd2-480a-9c2f-eafade7aa032 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:31.797043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-12fabf82-8bd2-480a-9c2f-eafade7aa032 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043638 Sep 14 19:51:31.797964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 941/1856] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:31 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:31.841001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-85203664-05e0-4a48-ac32-9410138299b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:31.848298 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-85203664-05e0-4a48-ac32-9410138299b6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.226595 Sep 14 19:51:31.848873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 916/1857] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:31 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:32.141860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-00299532-baed-411c-b1cb-8ce536bb61e4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:32.143306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-00299532-baed-411c-b1cb-8ce536bb61e4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:32.155407 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00299532-baed-411c-b1cb-8ce536bb61e4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:32.156160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00299532-baed-411c-b1cb-8ce536bb61e4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:32.157107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00299532-baed-411c-b1cb-8ce536bb61e4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:32.157870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-00299532-baed-411c-b1cb-8ce536bb61e4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:32.204440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-ca46dece-1b05-4291-af6e-6659ec0056ff req-04dc0b08-2366-4122-9d2f-e0b52dca1b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e617ad6d-c91d-4057-afb6-d220eb42ef28", "tag": "f3696efd-758e-4203-88ab-508f85e16b9d"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:32.206052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:51:32.206052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:51:32.212772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-ca46dece-1b05-4291-af6e-6659ec0056ff req-04dc0b08-2366-4122-9d2f-e0b52dca1b7c service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:32.213212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-ca46dece-1b05-4291-af6e-6659ec0056ff req-04dc0b08-2366-4122-9d2f-e0b52dca1b7c service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:32.222804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-00299532-baed-411c-b1cb-8ce536bb61e4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 14 microversion: 2.1 time: 0.085481 Sep 14 19:51:32.223665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 942/1858] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:32 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:51:32.225010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-ca46dece-1b05-4291-af6e-6659ec0056ff req-04dc0b08-2366-4122-9d2f-e0b52dca1b7c service nova] Creating event network-changed:f3696efd-758e-4203-88ab-508f85e16b9d for instance e617ad6d-c91d-4057-afb6-d220eb42ef28 on hv-cinder-80588 Sep 14 19:51:32.230372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-ca46dece-1b05-4291-af6e-6659ec0056ff req-04dc0b08-2366-4122-9d2f-e0b52dca1b7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086270 Sep 14 19:51:32.230976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 917/1859] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:51:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:32.274685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2e8dbc93-903a-46fb-bac1-1a901309e0ca tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:32.275690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2e8dbc93-903a-46fb-bac1-1a901309e0ca tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:32.282435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2e8dbc93-903a-46fb-bac1-1a901309e0ca tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:32.282973 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2e8dbc93-903a-46fb-bac1-1a901309e0ca tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:32.283833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2e8dbc93-903a-46fb-bac1-1a901309e0ca tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:32.284337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2e8dbc93-903a-46fb-bac1-1a901309e0ca tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:32.317246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2e8dbc93-903a-46fb-bac1-1a901309e0ca tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047196 Sep 14 19:51:32.318189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 943/1860] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:32 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:32.808849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-58ba8f1c-f1ce-480c-abad-5362b24d2ca0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:32.820313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-58ba8f1c-f1ce-480c-abad-5362b24d2ca0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:32.820313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58ba8f1c-f1ce-480c-abad-5362b24d2ca0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:32.820313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58ba8f1c-f1ce-480c-abad-5362b24d2ca0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:32.820313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58ba8f1c-f1ce-480c-abad-5362b24d2ca0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:32.820888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58ba8f1c-f1ce-480c-abad-5362b24d2ca0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:32.849442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-58ba8f1c-f1ce-480c-abad-5362b24d2ca0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044695 Sep 14 19:51:32.850777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 918/1861] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:32 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:32.865799 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ef07a359-239f-4c78-92a6-a65d1ad9d9bd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:32.866384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ef07a359-239f-4c78-92a6-a65d1ad9d9bd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:32.872380 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ef07a359-239f-4c78-92a6-a65d1ad9d9bd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:32.873104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ef07a359-239f-4c78-92a6-a65d1ad9d9bd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:32.873606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ef07a359-239f-4c78-92a6-a65d1ad9d9bd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:32.874193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ef07a359-239f-4c78-92a6-a65d1ad9d9bd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:33.006228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ef07a359-239f-4c78-92a6-a65d1ad9d9bd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:33.014670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ef07a359-239f-4c78-92a6-a65d1ad9d9bd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.151904 Sep 14 19:51:33.015317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 944/1862] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:32 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:33.233704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7e895e3c-0e68-4381-b160-4afce6c25426 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:33.234689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7e895e3c-0e68-4381-b160-4afce6c25426 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:33.240495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e895e3c-0e68-4381-b160-4afce6c25426 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:33.240936 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e895e3c-0e68-4381-b160-4afce6c25426 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:33.241768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e895e3c-0e68-4381-b160-4afce6c25426 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:33.242198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7e895e3c-0e68-4381-b160-4afce6c25426 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:33.302951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7e895e3c-0e68-4381-b160-4afce6c25426 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 14 microversion: 2.1 time: 0.072705 Sep 14 19:51:33.306544 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 919/1863] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:33 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:51:33.327978 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-274b1e09-1e1f-4de1-bb4f-833ee5f56c69 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:33.328890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-274b1e09-1e1f-4de1-bb4f-833ee5f56c69 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:33.335164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-274b1e09-1e1f-4de1-bb4f-833ee5f56c69 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:33.335617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-274b1e09-1e1f-4de1-bb4f-833ee5f56c69 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:33.336389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-274b1e09-1e1f-4de1-bb4f-833ee5f56c69 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:33.336826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-274b1e09-1e1f-4de1-bb4f-833ee5f56c69 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:33.365440 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-274b1e09-1e1f-4de1-bb4f-833ee5f56c69 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041176 Sep 14 19:51:33.366018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 945/1864] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:33 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:33.862388 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5a6459a0-02f4-496f-9db1-7ea6c00a14ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:33.863402 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5a6459a0-02f4-496f-9db1-7ea6c00a14ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:33.869845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a6459a0-02f4-496f-9db1-7ea6c00a14ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:33.870291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a6459a0-02f4-496f-9db1-7ea6c00a14ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:33.871052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a6459a0-02f4-496f-9db1-7ea6c00a14ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:33.871482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a6459a0-02f4-496f-9db1-7ea6c00a14ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:33.899501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5a6459a0-02f4-496f-9db1-7ea6c00a14ab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041234 Sep 14 19:51:33.900043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 920/1865] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:33 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:34.032416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6b28aea0-3acc-4fc0-a047-02b6c056271a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:34.036427 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6b28aea0-3acc-4fc0-a047-02b6c056271a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:34.038803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6b28aea0-3acc-4fc0-a047-02b6c056271a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:34.039230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6b28aea0-3acc-4fc0-a047-02b6c056271a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:34.039996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6b28aea0-3acc-4fc0-a047-02b6c056271a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:34.040425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6b28aea0-3acc-4fc0-a047-02b6c056271a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:34.161281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6b28aea0-3acc-4fc0-a047-02b6c056271a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:34.168583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6b28aea0-3acc-4fc0-a047-02b6c056271a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140437 Sep 14 19:51:34.169161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 946/1866] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:34 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:34.314123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ed3cd3c7-91f5-4b95-9533-281fce9a3f77 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:34.315017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ed3cd3c7-91f5-4b95-9533-281fce9a3f77 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:34.320781 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed3cd3c7-91f5-4b95-9533-281fce9a3f77 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:34.321214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed3cd3c7-91f5-4b95-9533-281fce9a3f77 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:34.322000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed3cd3c7-91f5-4b95-9533-281fce9a3f77 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:34.322432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed3cd3c7-91f5-4b95-9533-281fce9a3f77 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:34.375893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-293486a7-ba96-4416-b846-4c53ee771cfc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:34.376792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-293486a7-ba96-4416-b846-4c53ee771cfc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:34.381404 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ed3cd3c7-91f5-4b95-9533-281fce9a3f77 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 14 microversion: 2.1 time: 0.070790 Sep 14 19:51:34.384486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 921/1867] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:34 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 19:51:34.384637 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-293486a7-ba96-4416-b846-4c53ee771cfc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:34.384637 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-293486a7-ba96-4416-b846-4c53ee771cfc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:34.384637 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-293486a7-ba96-4416-b846-4c53ee771cfc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:34.384906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-293486a7-ba96-4416-b846-4c53ee771cfc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:34.414533 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-293486a7-ba96-4416-b846-4c53ee771cfc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042263 Sep 14 19:51:34.415079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 947/1868] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:34 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:34.911331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8c0989dc-ee8a-4a0b-9029-5101a83de7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:34.912332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8c0989dc-ee8a-4a0b-9029-5101a83de7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:34.918840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c0989dc-ee8a-4a0b-9029-5101a83de7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:34.919826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c0989dc-ee8a-4a0b-9029-5101a83de7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:34.920662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c0989dc-ee8a-4a0b-9029-5101a83de7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:34.921093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c0989dc-ee8a-4a0b-9029-5101a83de7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:34.950128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8c0989dc-ee8a-4a0b-9029-5101a83de7f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042696 Sep 14 19:51:34.950704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 922/1869] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:34 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:35.185481 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e8f3c182-c41d-4cb7-bf2d-7b42214bb026 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:35.186141 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e8f3c182-c41d-4cb7-bf2d-7b42214bb026 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:35.191965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8f3c182-c41d-4cb7-bf2d-7b42214bb026 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:35.192442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8f3c182-c41d-4cb7-bf2d-7b42214bb026 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:35.193208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8f3c182-c41d-4cb7-bf2d-7b42214bb026 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:35.193678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8f3c182-c41d-4cb7-bf2d-7b42214bb026 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:35.315983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e8f3c182-c41d-4cb7-bf2d-7b42214bb026 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:35.323444 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e8f3c182-c41d-4cb7-bf2d-7b42214bb026 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141592 Sep 14 19:51:35.324061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 948/1870] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:35 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:35.392294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8174ae7c-f300-4aa9-9f64-0df6bac018bd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:35.393121 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8174ae7c-f300-4aa9-9f64-0df6bac018bd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:35.399055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8174ae7c-f300-4aa9-9f64-0df6bac018bd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:35.399503 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8174ae7c-f300-4aa9-9f64-0df6bac018bd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:35.400268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8174ae7c-f300-4aa9-9f64-0df6bac018bd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:35.400708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8174ae7c-f300-4aa9-9f64-0df6bac018bd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:35.426681 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-67873e74-9151-4aaf-bb82-6b7b157f7823 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:35.428611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-67873e74-9151-4aaf-bb82-6b7b157f7823 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:35.436019 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-67873e74-9151-4aaf-bb82-6b7b157f7823 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:35.436460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-67873e74-9151-4aaf-bb82-6b7b157f7823 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:35.437253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-67873e74-9151-4aaf-bb82-6b7b157f7823 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:35.437723 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-67873e74-9151-4aaf-bb82-6b7b157f7823 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:35.461154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8174ae7c-f300-4aa9-9f64-0df6bac018bd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 14 microversion: 2.1 time: 0.072486 Sep 14 19:51:35.461851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 923/1871] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:35 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:51:35.610884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-67873e74-9151-4aaf-bb82-6b7b157f7823 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188329 Sep 14 19:51:35.611426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 949/1872] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:35 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:35.962044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2b757961-b120-4433-b852-d03fa5029320 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:35.963042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2b757961-b120-4433-b852-d03fa5029320 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:35.970113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b757961-b120-4433-b852-d03fa5029320 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:35.970564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b757961-b120-4433-b852-d03fa5029320 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:35.971336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b757961-b120-4433-b852-d03fa5029320 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:35.971778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b757961-b120-4433-b852-d03fa5029320 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:36.001007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2b757961-b120-4433-b852-d03fa5029320 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043153 Sep 14 19:51:36.001581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 924/1873] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:35 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:36.340624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-65473067-5f27-41bd-9f20-b99f6c371303 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:36.341881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-65473067-5f27-41bd-9f20-b99f6c371303 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:36.347850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65473067-5f27-41bd-9f20-b99f6c371303 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:36.348315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65473067-5f27-41bd-9f20-b99f6c371303 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:36.349078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65473067-5f27-41bd-9f20-b99f6c371303 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:36.349541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-65473067-5f27-41bd-9f20-b99f6c371303 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:36.471243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-65473067-5f27-41bd-9f20-b99f6c371303 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:36.472672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d6a147c5-f955-4cfb-94f6-22841b74befe tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:36.473624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d6a147c5-f955-4cfb-94f6-22841b74befe tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:36.478591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-65473067-5f27-41bd-9f20-b99f6c371303 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141668 Sep 14 19:51:36.479155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 950/1874] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:36 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:36.479315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6a147c5-f955-4cfb-94f6-22841b74befe tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:36.479734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6a147c5-f955-4cfb-94f6-22841b74befe tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:36.480504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6a147c5-f955-4cfb-94f6-22841b74befe tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:36.480945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6a147c5-f955-4cfb-94f6-22841b74befe tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:36.539411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d6a147c5-f955-4cfb-94f6-22841b74befe tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 14 microversion: 2.1 time: 0.070345 Sep 14 19:51:36.540015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 925/1875] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:36 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 19:51:36.622119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-18d54ae0-affe-4ff0-8c57-afe154d6fd94 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:36.623062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-18d54ae0-affe-4ff0-8c57-afe154d6fd94 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:36.628775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18d54ae0-affe-4ff0-8c57-afe154d6fd94 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:36.629227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18d54ae0-affe-4ff0-8c57-afe154d6fd94 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:36.630033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18d54ae0-affe-4ff0-8c57-afe154d6fd94 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:36.630470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18d54ae0-affe-4ff0-8c57-afe154d6fd94 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:36.659881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-18d54ae0-affe-4ff0-8c57-afe154d6fd94 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041424 Sep 14 19:51:36.660453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 951/1876] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:36 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:37.012737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1a5dcf08-d458-41d9-9d02-b47c942c81db tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:37.014438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1a5dcf08-d458-41d9-9d02-b47c942c81db tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:37.021065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a5dcf08-d458-41d9-9d02-b47c942c81db tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:37.021516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a5dcf08-d458-41d9-9d02-b47c942c81db tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:37.022298 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a5dcf08-d458-41d9-9d02-b47c942c81db tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:37.022729 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a5dcf08-d458-41d9-9d02-b47c942c81db tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:37.052734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1a5dcf08-d458-41d9-9d02-b47c942c81db tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044128 Sep 14 19:51:37.053300 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 926/1877] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:37.495866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dfa5a81b-8c13-4eee-b773-e7db1dd2ffa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:37.496504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dfa5a81b-8c13-4eee-b773-e7db1dd2ffa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:37.502438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dfa5a81b-8c13-4eee-b773-e7db1dd2ffa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:37.502893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dfa5a81b-8c13-4eee-b773-e7db1dd2ffa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:37.503661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dfa5a81b-8c13-4eee-b773-e7db1dd2ffa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:37.504096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dfa5a81b-8c13-4eee-b773-e7db1dd2ffa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:37.551412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-427bf237-6354-4acc-9fec-9d87180df281 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:37.552328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-427bf237-6354-4acc-9fec-9d87180df281 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:37.558423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-427bf237-6354-4acc-9fec-9d87180df281 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:37.558874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-427bf237-6354-4acc-9fec-9d87180df281 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:37.559658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-427bf237-6354-4acc-9fec-9d87180df281 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:37.560101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-427bf237-6354-4acc-9fec-9d87180df281 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:37.620482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-427bf237-6354-4acc-9fec-9d87180df281 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 14 microversion: 2.1 time: 0.072958 Sep 14 19:51:37.621132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 927/1878] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:37 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 19:51:37.627969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dfa5a81b-8c13-4eee-b773-e7db1dd2ffa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:37.635378 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dfa5a81b-8c13-4eee-b773-e7db1dd2ffa6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143250 Sep 14 19:51:37.635931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 952/1879] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:37 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:37.672280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-39273afd-7c7d-4e98-b7fc-09dab845fa63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:37.673279 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-39273afd-7c7d-4e98-b7fc-09dab845fa63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:37.680028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-39273afd-7c7d-4e98-b7fc-09dab845fa63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:37.680464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-39273afd-7c7d-4e98-b7fc-09dab845fa63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:37.681226 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-39273afd-7c7d-4e98-b7fc-09dab845fa63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:37.681690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-39273afd-7c7d-4e98-b7fc-09dab845fa63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:37.711395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-39273afd-7c7d-4e98-b7fc-09dab845fa63 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 Sep 14 19:51:37.711958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 928/1880] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:37 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:38.064258 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9c47c8bd-c6bf-42a2-bf16-fd0a917c9d71 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:38.065162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9c47c8bd-c6bf-42a2-bf16-fd0a917c9d71 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:38.071020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c47c8bd-c6bf-42a2-bf16-fd0a917c9d71 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:38.071474 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c47c8bd-c6bf-42a2-bf16-fd0a917c9d71 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:38.072240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c47c8bd-c6bf-42a2-bf16-fd0a917c9d71 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:38.072680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c47c8bd-c6bf-42a2-bf16-fd0a917c9d71 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:38.102368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9c47c8bd-c6bf-42a2-bf16-fd0a917c9d71 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041840 Sep 14 19:51:38.102930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 953/1881] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:38 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:38.631858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-33aec715-12a4-4b71-b590-940a60843429 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:38.632769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-33aec715-12a4-4b71-b590-940a60843429 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:38.638749 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33aec715-12a4-4b71-b590-940a60843429 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:38.639201 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33aec715-12a4-4b71-b590-940a60843429 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:38.639967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33aec715-12a4-4b71-b590-940a60843429 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:38.640404 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33aec715-12a4-4b71-b590-940a60843429 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:38.652046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6b81e9e9-f19e-4a71-99f1-4731be8054aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:38.652651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6b81e9e9-f19e-4a71-99f1-4731be8054aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:38.658501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6b81e9e9-f19e-4a71-99f1-4731be8054aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:38.659014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6b81e9e9-f19e-4a71-99f1-4731be8054aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:38.659806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6b81e9e9-f19e-4a71-99f1-4731be8054aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:38.660236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6b81e9e9-f19e-4a71-99f1-4731be8054aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:38.698390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-33aec715-12a4-4b71-b590-940a60843429 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 14 microversion: 2.1 time: 0.069789 Sep 14 19:51:38.699051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 929/1882] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:38 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:51:38.723959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a9798f7e-e16e-4258-997d-3c09b73b632b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:38.724954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a9798f7e-e16e-4258-997d-3c09b73b632b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:38.731723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a9798f7e-e16e-4258-997d-3c09b73b632b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:38.732241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a9798f7e-e16e-4258-997d-3c09b73b632b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:38.733699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a9798f7e-e16e-4258-997d-3c09b73b632b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:38.734199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a9798f7e-e16e-4258-997d-3c09b73b632b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:38.770129 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a9798f7e-e16e-4258-997d-3c09b73b632b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050649 Sep 14 19:51:38.770723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 930/1883] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:38 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:38.784309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6b81e9e9-f19e-4a71-99f1-4731be8054aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:38.791664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6b81e9e9-f19e-4a71-99f1-4731be8054aa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143426 Sep 14 19:51:38.792258 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 954/1884] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:38 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:39.115789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f274df41-f8ee-484c-b618-40399d78a50c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:39.116692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f274df41-f8ee-484c-b618-40399d78a50c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:39.122657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f274df41-f8ee-484c-b618-40399d78a50c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:39.123189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f274df41-f8ee-484c-b618-40399d78a50c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:39.123951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f274df41-f8ee-484c-b618-40399d78a50c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:39.124378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f274df41-f8ee-484c-b618-40399d78a50c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:39.153195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f274df41-f8ee-484c-b618-40399d78a50c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041111 Sep 14 19:51:39.153776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 931/1885] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:39 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:39.708386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cb2522d2-709e-49ce-a3d7-2610aa2b732d tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:39.709283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cb2522d2-709e-49ce-a3d7-2610aa2b732d tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:39.715627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb2522d2-709e-49ce-a3d7-2610aa2b732d tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:39.716067 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb2522d2-709e-49ce-a3d7-2610aa2b732d tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:39.716880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb2522d2-709e-49ce-a3d7-2610aa2b732d tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:39.717335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cb2522d2-709e-49ce-a3d7-2610aa2b732d tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:39.775815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cb2522d2-709e-49ce-a3d7-2610aa2b732d tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 14 microversion: 2.1 time: 0.070863 Sep 14 19:51:39.776714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 955/1886] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:39 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:51:39.781403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-754fd968-6284-4145-a95e-712e94ad8445 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:39.782403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-754fd968-6284-4145-a95e-712e94ad8445 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:39.789022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-754fd968-6284-4145-a95e-712e94ad8445 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:39.789572 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-754fd968-6284-4145-a95e-712e94ad8445 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:39.790267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-754fd968-6284-4145-a95e-712e94ad8445 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:39.790684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-754fd968-6284-4145-a95e-712e94ad8445 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:39.818309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6841f139-37aa-481e-9bed-567a9698aa0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:39.818309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6841f139-37aa-481e-9bed-567a9698aa0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:39.818309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6841f139-37aa-481e-9bed-567a9698aa0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:39.818309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6841f139-37aa-481e-9bed-567a9698aa0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:39.818695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6841f139-37aa-481e-9bed-567a9698aa0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:39.819075 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6841f139-37aa-481e-9bed-567a9698aa0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:39.822310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-754fd968-6284-4145-a95e-712e94ad8445 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Sep 14 19:51:39.823101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 932/1887] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:39 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:39.943364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6841f139-37aa-481e-9bed-567a9698aa0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:39.950756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6841f139-37aa-481e-9bed-567a9698aa0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.145544 Sep 14 19:51:39.951932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 956/1888] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:39 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:40.164260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-57ebfec2-9da7-47e9-bc4a-85197b7015d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:40.165197 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-57ebfec2-9da7-47e9-bc4a-85197b7015d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:40.171006 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57ebfec2-9da7-47e9-bc4a-85197b7015d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:40.171455 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57ebfec2-9da7-47e9-bc4a-85197b7015d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:40.172218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57ebfec2-9da7-47e9-bc4a-85197b7015d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:40.172651 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57ebfec2-9da7-47e9-bc4a-85197b7015d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:40.201825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-57ebfec2-9da7-47e9-bc4a-85197b7015d9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040741 Sep 14 19:51:40.202384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 933/1889] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:40.792673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5a9631f5-1e76-4259-be6d-deee00808cb5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:40.792673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5a9631f5-1e76-4259-be6d-deee00808cb5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:40.796466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a9631f5-1e76-4259-be6d-deee00808cb5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:40.796956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a9631f5-1e76-4259-be6d-deee00808cb5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:40.798031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a9631f5-1e76-4259-be6d-deee00808cb5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:40.798750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a9631f5-1e76-4259-be6d-deee00808cb5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:40.834699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f2002ac2-5e04-4f42-904a-42779cec004a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:40.835657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f2002ac2-5e04-4f42-904a-42779cec004a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:40.842631 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2002ac2-5e04-4f42-904a-42779cec004a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:40.843244 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2002ac2-5e04-4f42-904a-42779cec004a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:40.844090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2002ac2-5e04-4f42-904a-42779cec004a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:40.844580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2002ac2-5e04-4f42-904a-42779cec004a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:40.870146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5a9631f5-1e76-4259-be6d-deee00808cb5 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 14 microversion: 2.1 time: 0.086027 Sep 14 19:51:40.872582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 957/1890] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:40 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:51:40.876343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f2002ac2-5e04-4f42-904a-42779cec004a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046125 Sep 14 19:51:40.879920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 934/1891] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:40 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:40.968349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-47964e1f-141f-494e-9288-916e82d0855f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:40.969198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-47964e1f-141f-494e-9288-916e82d0855f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:40.975686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47964e1f-141f-494e-9288-916e82d0855f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:40.976139 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47964e1f-141f-494e-9288-916e82d0855f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:40.976901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47964e1f-141f-494e-9288-916e82d0855f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:40.977333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-47964e1f-141f-494e-9288-916e82d0855f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:41.097654 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-47964e1f-141f-494e-9288-916e82d0855f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:41.105043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-47964e1f-141f-494e-9288-916e82d0855f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140653 Sep 14 19:51:41.105632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 958/1892] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:40 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:41.213322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-00757153-117b-4df1-a511-fd47fc540c0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:41.214259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-00757153-117b-4df1-a511-fd47fc540c0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:41.220653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00757153-117b-4df1-a511-fd47fc540c0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:41.221099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00757153-117b-4df1-a511-fd47fc540c0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:41.221902 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00757153-117b-4df1-a511-fd47fc540c0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:41.222335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00757153-117b-4df1-a511-fd47fc540c0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:41.250975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-00757153-117b-4df1-a511-fd47fc540c0a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041482 Sep 14 19:51:41.251531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 935/1893] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:41 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:41.882667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ee31838e-d46c-4ca9-8847-5b24481e3639 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:41.883713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ee31838e-d46c-4ca9-8847-5b24481e3639 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:41.887395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e6b0ddc7-6d83-416b-9dae-4dccfb6a4ee7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:41.888253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e6b0ddc7-6d83-416b-9dae-4dccfb6a4ee7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:41.890390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee31838e-d46c-4ca9-8847-5b24481e3639 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:41.890790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee31838e-d46c-4ca9-8847-5b24481e3639 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:41.891581 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee31838e-d46c-4ca9-8847-5b24481e3639 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:41.892025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee31838e-d46c-4ca9-8847-5b24481e3639 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:41.896215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e6b0ddc7-6d83-416b-9dae-4dccfb6a4ee7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:41.896667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e6b0ddc7-6d83-416b-9dae-4dccfb6a4ee7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:41.897451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e6b0ddc7-6d83-416b-9dae-4dccfb6a4ee7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:41.897910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e6b0ddc7-6d83-416b-9dae-4dccfb6a4ee7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:41.930307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e6b0ddc7-6d83-416b-9dae-4dccfb6a4ee7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046738 Sep 14 19:51:41.930892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 936/1894] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:41 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:41.956184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ee31838e-d46c-4ca9-8847-5b24481e3639 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 6451 microversion: 2.1 time: 0.077254 Sep 14 19:51:41.956855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 959/1895] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:41 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 6451 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:42.121637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d97e762d-6a48-4616-898d-17d8e4af2354 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:42.122244 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d97e762d-6a48-4616-898d-17d8e4af2354 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:42.129210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d97e762d-6a48-4616-898d-17d8e4af2354 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:42.129697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d97e762d-6a48-4616-898d-17d8e4af2354 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:42.130466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d97e762d-6a48-4616-898d-17d8e4af2354 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:42.130896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d97e762d-6a48-4616-898d-17d8e4af2354 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:42.251757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d97e762d-6a48-4616-898d-17d8e4af2354 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:42.259300 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d97e762d-6a48-4616-898d-17d8e4af2354 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141251 Sep 14 19:51:42.259972 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 937/1896] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:42 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:42.268921 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-21233989-77b8-4462-9212-0808cf1219e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:42.269956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-21233989-77b8-4462-9212-0808cf1219e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:42.276493 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21233989-77b8-4462-9212-0808cf1219e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:42.276943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21233989-77b8-4462-9212-0808cf1219e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:42.278473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21233989-77b8-4462-9212-0808cf1219e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:42.278922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21233989-77b8-4462-9212-0808cf1219e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:42.323064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-21233989-77b8-4462-9212-0808cf1219e9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064079 Sep 14 19:51:42.323639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 960/1897] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:42 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:42.971630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f48bded7-ed7a-4019-b1ee-4b8546de5ebd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:42.972545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f48bded7-ed7a-4019-b1ee-4b8546de5ebd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:42.978931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f48bded7-ed7a-4019-b1ee-4b8546de5ebd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:42.979377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f48bded7-ed7a-4019-b1ee-4b8546de5ebd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:42.980160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f48bded7-ed7a-4019-b1ee-4b8546de5ebd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:42.980595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f48bded7-ed7a-4019-b1ee-4b8546de5ebd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:43.016068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c57deb78-8b7d-46ad-85b6-bf81cbc27246 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:43.017057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c57deb78-8b7d-46ad-85b6-bf81cbc27246 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:43.023159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c57deb78-8b7d-46ad-85b6-bf81cbc27246 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:43.023604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c57deb78-8b7d-46ad-85b6-bf81cbc27246 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:43.024428 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c57deb78-8b7d-46ad-85b6-bf81cbc27246 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:43.024861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c57deb78-8b7d-46ad-85b6-bf81cbc27246 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:43.055280 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c57deb78-8b7d-46ad-85b6-bf81cbc27246 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118202 Sep 14 19:51:43.055832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 938/1898] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:42 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:43.075133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f48bded7-ed7a-4019-b1ee-4b8546de5ebd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 15025 microversion: 2.1 time: 0.108601 Sep 14 19:51:43.076847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 961/1899] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:42 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 15025 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:43.276141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-553e1dcb-7083-4840-9da9-67e4c79a66b5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:43.276750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-553e1dcb-7083-4840-9da9-67e4c79a66b5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:43.283813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-553e1dcb-7083-4840-9da9-67e4c79a66b5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:43.284297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-553e1dcb-7083-4840-9da9-67e4c79a66b5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:43.285163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-553e1dcb-7083-4840-9da9-67e4c79a66b5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:43.285635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-553e1dcb-7083-4840-9da9-67e4c79a66b5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:43.335657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2fc6d10b-fcec-4d95-b0d0-c0f851eb9f84 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:43.336650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2fc6d10b-fcec-4d95-b0d0-c0f851eb9f84 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:43.343719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2fc6d10b-fcec-4d95-b0d0-c0f851eb9f84 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:43.344165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2fc6d10b-fcec-4d95-b0d0-c0f851eb9f84 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:43.344938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2fc6d10b-fcec-4d95-b0d0-c0f851eb9f84 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:43.345372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2fc6d10b-fcec-4d95-b0d0-c0f851eb9f84 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:43.375410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2fc6d10b-fcec-4d95-b0d0-c0f851eb9f84 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043888 Sep 14 19:51:43.376191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 962/1900] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:43.409592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-553e1dcb-7083-4840-9da9-67e4c79a66b5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:43.416770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-553e1dcb-7083-4840-9da9-67e4c79a66b5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.144417 Sep 14 19:51:43.417333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 939/1901] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:43 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:44.066250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e08cc29c-59f9-4680-b6d6-68f0767ba5ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:44.067198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e08cc29c-59f9-4680-b6d6-68f0767ba5ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:44.072989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e08cc29c-59f9-4680-b6d6-68f0767ba5ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:44.073441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e08cc29c-59f9-4680-b6d6-68f0767ba5ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:44.074246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e08cc29c-59f9-4680-b6d6-68f0767ba5ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:44.074683 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e08cc29c-59f9-4680-b6d6-68f0767ba5ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:44.086851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-473b85d8-c04e-4e87-88bd-75ddefec238a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:44.087830 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-473b85d8-c04e-4e87-88bd-75ddefec238a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:44.094119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-473b85d8-c04e-4e87-88bd-75ddefec238a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:44.094562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-473b85d8-c04e-4e87-88bd-75ddefec238a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:44.095403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-473b85d8-c04e-4e87-88bd-75ddefec238a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:44.095835 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-473b85d8-c04e-4e87-88bd-75ddefec238a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:44.104695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e08cc29c-59f9-4680-b6d6-68f0767ba5ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042130 Sep 14 19:51:44.105261 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 963/1902] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:44 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:44.165915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-473b85d8-c04e-4e87-88bd-75ddefec238a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 18561 microversion: 2.1 time: 0.082515 Sep 14 19:51:44.166593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 940/1903] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:44 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 18561 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:44.386615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b37d42fb-74db-45ec-acc4-d4565dff2acb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:44.387510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b37d42fb-74db-45ec-acc4-d4565dff2acb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:44.394271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b37d42fb-74db-45ec-acc4-d4565dff2acb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:44.394710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b37d42fb-74db-45ec-acc4-d4565dff2acb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:44.395470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b37d42fb-74db-45ec-acc4-d4565dff2acb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:44.395897 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b37d42fb-74db-45ec-acc4-d4565dff2acb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:44.423876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b37d42fb-74db-45ec-acc4-d4565dff2acb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040781 Sep 14 19:51:44.424412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 964/1904] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:44.435444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1c223951-1547-4087-80a9-4210a9ed910f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:44.436652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1c223951-1547-4087-80a9-4210a9ed910f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:44.443115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c223951-1547-4087-80a9-4210a9ed910f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:44.443562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c223951-1547-4087-80a9-4210a9ed910f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:44.444327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c223951-1547-4087-80a9-4210a9ed910f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:44.444756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c223951-1547-4087-80a9-4210a9ed910f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:44.610563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1c223951-1547-4087-80a9-4210a9ed910f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:44.617790 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1c223951-1547-4087-80a9-4210a9ed910f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.186725 Sep 14 19:51:44.618353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 941/1905] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:44 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:45.116065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3c77ebed-a6d2-44a2-971a-a7621d1aaf00 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:45.117002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3c77ebed-a6d2-44a2-971a-a7621d1aaf00 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:45.122979 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c77ebed-a6d2-44a2-971a-a7621d1aaf00 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:45.123428 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c77ebed-a6d2-44a2-971a-a7621d1aaf00 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:45.124764 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c77ebed-a6d2-44a2-971a-a7621d1aaf00 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:45.125200 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c77ebed-a6d2-44a2-971a-a7621d1aaf00 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:45.155712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3c77ebed-a6d2-44a2-971a-a7621d1aaf00 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042470 Sep 14 19:51:45.155712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 965/1906] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:45 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:45.176999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6014e76b-8f49-4e72-88d9-3fb3de0f20e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:45.177963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6014e76b-8f49-4e72-88d9-3fb3de0f20e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:45.183781 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6014e76b-8f49-4e72-88d9-3fb3de0f20e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:45.184230 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6014e76b-8f49-4e72-88d9-3fb3de0f20e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:45.185001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6014e76b-8f49-4e72-88d9-3fb3de0f20e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:45.185444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6014e76b-8f49-4e72-88d9-3fb3de0f20e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:45.257804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6014e76b-8f49-4e72-88d9-3fb3de0f20e8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 20173 microversion: 2.1 time: 0.084520 Sep 14 19:51:45.258427 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 942/1907] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:45 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 20173 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:45.435387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-071ac2bc-d856-4291-b5a0-be0717981447 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:45.436341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-071ac2bc-d856-4291-b5a0-be0717981447 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:45.442014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-071ac2bc-d856-4291-b5a0-be0717981447 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:45.442456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-071ac2bc-d856-4291-b5a0-be0717981447 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:45.443211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-071ac2bc-d856-4291-b5a0-be0717981447 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:45.443641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-071ac2bc-d856-4291-b5a0-be0717981447 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:45.475771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-071ac2bc-d856-4291-b5a0-be0717981447 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044077 Sep 14 19:51:45.476315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 966/1908] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:45.635657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-18221258-271c-4b6a-bda0-9db3a4688b7e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:45.636266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-18221258-271c-4b6a-bda0-9db3a4688b7e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:45.643708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18221258-271c-4b6a-bda0-9db3a4688b7e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:45.644160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18221258-271c-4b6a-bda0-9db3a4688b7e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:45.644928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18221258-271c-4b6a-bda0-9db3a4688b7e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:45.645365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18221258-271c-4b6a-bda0-9db3a4688b7e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:45.765382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-18221258-271c-4b6a-bda0-9db3a4688b7e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:45.772732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-18221258-271c-4b6a-bda0-9db3a4688b7e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141185 Sep 14 19:51:45.773303 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 943/1909] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:45 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:46.166693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3b3f51d7-eeb3-4924-a350-c54677ca9f7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:46.167606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3b3f51d7-eeb3-4924-a350-c54677ca9f7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:46.174574 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b3f51d7-eeb3-4924-a350-c54677ca9f7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:46.175027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b3f51d7-eeb3-4924-a350-c54677ca9f7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:46.176009 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b3f51d7-eeb3-4924-a350-c54677ca9f7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:46.176246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3b3f51d7-eeb3-4924-a350-c54677ca9f7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:46.206160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3b3f51d7-eeb3-4924-a350-c54677ca9f7d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Sep 14 19:51:46.206713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 967/1910] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:46 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:46.270375 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-33172a27-5fe8-469b-8c35-5a445314f883 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:46.271295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-33172a27-5fe8-469b-8c35-5a445314f883 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:46.277631 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33172a27-5fe8-469b-8c35-5a445314f883 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:46.278205 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33172a27-5fe8-469b-8c35-5a445314f883 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:46.279576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33172a27-5fe8-469b-8c35-5a445314f883 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:46.280354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33172a27-5fe8-469b-8c35-5a445314f883 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:46.373375 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-33172a27-5fe8-469b-8c35-5a445314f883 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 22765 microversion: 2.1 time: 0.107356 Sep 14 19:51:46.374054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 944/1911] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:46 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 22765 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:46.488036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-810c364a-9f7d-4a6c-b016-c5e4203430e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:46.489090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-810c364a-9f7d-4a6c-b016-c5e4203430e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:46.495695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-810c364a-9f7d-4a6c-b016-c5e4203430e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:46.496233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-810c364a-9f7d-4a6c-b016-c5e4203430e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:46.504684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-810c364a-9f7d-4a6c-b016-c5e4203430e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:46.505145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-810c364a-9f7d-4a6c-b016-c5e4203430e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:46.535291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-810c364a-9f7d-4a6c-b016-c5e4203430e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051131 Sep 14 19:51:46.535844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 968/1912] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:46.790123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0d98a285-b8d7-4ac6-a9f7-cc733e9d3648 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:46.790740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0d98a285-b8d7-4ac6-a9f7-cc733e9d3648 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:46.797250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d98a285-b8d7-4ac6-a9f7-cc733e9d3648 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:46.797731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d98a285-b8d7-4ac6-a9f7-cc733e9d3648 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:46.798761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d98a285-b8d7-4ac6-a9f7-cc733e9d3648 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:46.799197 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d98a285-b8d7-4ac6-a9f7-cc733e9d3648 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:46.921008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0d98a285-b8d7-4ac6-a9f7-cc733e9d3648 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:46.928728 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0d98a285-b8d7-4ac6-a9f7-cc733e9d3648 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142692 Sep 14 19:51:46.929301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 945/1913] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:46 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:47.217149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-743360e6-fffe-4d58-a300-92f67d9286c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:47.218082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-743360e6-fffe-4d58-a300-92f67d9286c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:47.223855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-743360e6-fffe-4d58-a300-92f67d9286c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:47.224304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-743360e6-fffe-4d58-a300-92f67d9286c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:47.225087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-743360e6-fffe-4d58-a300-92f67d9286c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:47.225518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-743360e6-fffe-4d58-a300-92f67d9286c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:47.254848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-743360e6-fffe-4d58-a300-92f67d9286c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 Sep 14 19:51:47.255402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 969/1914] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:47 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:47.384825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-388d535a-0224-42ed-901c-6f900ff58c82 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:47.385792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-388d535a-0224-42ed-901c-6f900ff58c82 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:47.392481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-388d535a-0224-42ed-901c-6f900ff58c82 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:47.392963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-388d535a-0224-42ed-901c-6f900ff58c82 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:47.393773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-388d535a-0224-42ed-901c-6f900ff58c82 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:47.394212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-388d535a-0224-42ed-901c-6f900ff58c82 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:47.467042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-388d535a-0224-42ed-901c-6f900ff58c82 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 23955 microversion: 2.1 time: 0.085714 Sep 14 19:51:47.467697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 946/1915] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:47 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 23955 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:47.547379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e949f551-0e5e-46c6-9901-83d1071c5974 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:47.548282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e949f551-0e5e-46c6-9901-83d1071c5974 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:47.554388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e949f551-0e5e-46c6-9901-83d1071c5974 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:47.554840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e949f551-0e5e-46c6-9901-83d1071c5974 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:47.555612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e949f551-0e5e-46c6-9901-83d1071c5974 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:47.556050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e949f551-0e5e-46c6-9901-83d1071c5974 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:47.585335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e949f551-0e5e-46c6-9901-83d1071c5974 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042315 Sep 14 19:51:47.585913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 970/1916] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:47 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:47.946081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e419032f-64d5-4724-a840-807131d6c07c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:47.946785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e419032f-64d5-4724-a840-807131d6c07c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:47.953289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e419032f-64d5-4724-a840-807131d6c07c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:47.953777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e419032f-64d5-4724-a840-807131d6c07c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:47.954557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e419032f-64d5-4724-a840-807131d6c07c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:47.954994 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e419032f-64d5-4724-a840-807131d6c07c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:48.079515 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e419032f-64d5-4724-a840-807131d6c07c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:48.086669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e419032f-64d5-4724-a840-807131d6c07c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.144737 Sep 14 19:51:48.087234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 947/1917] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:47 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:48.268780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-46a36c26-3454-41dd-9f41-d808e25393f2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:48.270537 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-46a36c26-3454-41dd-9f41-d808e25393f2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:48.281563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46a36c26-3454-41dd-9f41-d808e25393f2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:48.282388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46a36c26-3454-41dd-9f41-d808e25393f2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:48.283785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46a36c26-3454-41dd-9f41-d808e25393f2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:48.284587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46a36c26-3454-41dd-9f41-d808e25393f2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:48.317869 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-46a36c26-3454-41dd-9f41-d808e25393f2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055890 Sep 14 19:51:48.318433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 971/1918] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:48 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:48.478812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-379ae8f0-9915-4464-a342-d8f9a8371cf8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:48.481696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-379ae8f0-9915-4464-a342-d8f9a8371cf8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:48.485524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-379ae8f0-9915-4464-a342-d8f9a8371cf8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:48.485984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-379ae8f0-9915-4464-a342-d8f9a8371cf8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:48.486751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-379ae8f0-9915-4464-a342-d8f9a8371cf8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:48.487244 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-379ae8f0-9915-4464-a342-d8f9a8371cf8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:48.560175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-379ae8f0-9915-4464-a342-d8f9a8371cf8 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 25728 microversion: 2.1 time: 0.084941 Sep 14 19:51:48.560835 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 948/1919] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:48 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 25728 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:48.599999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-78f971dd-08b0-45b8-b044-b5e620d5c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:48.600974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-78f971dd-08b0-45b8-b044-b5e620d5c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:48.606981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78f971dd-08b0-45b8-b044-b5e620d5c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:48.607432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78f971dd-08b0-45b8-b044-b5e620d5c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:48.608232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78f971dd-08b0-45b8-b044-b5e620d5c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:48.608669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-78f971dd-08b0-45b8-b044-b5e620d5c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:48.637662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-78f971dd-08b0-45b8-b044-b5e620d5c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041590 Sep 14 19:51:48.638206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 972/1920] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:48 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:49.103289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-43bf8b86-e449-4db1-b671-e81f869501e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:49.103918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-43bf8b86-e449-4db1-b671-e81f869501e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:49.111087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43bf8b86-e449-4db1-b671-e81f869501e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:49.111535 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43bf8b86-e449-4db1-b671-e81f869501e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:49.112304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43bf8b86-e449-4db1-b671-e81f869501e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:49.112736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-43bf8b86-e449-4db1-b671-e81f869501e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:49.235476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-43bf8b86-e449-4db1-b671-e81f869501e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:49.242718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-43bf8b86-e449-4db1-b671-e81f869501e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143458 Sep 14 19:51:49.243274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 949/1921] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:49 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:49.329580 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-de9d113c-bd95-467a-9bfc-0ec72ef3ef5d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:49.330505 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-de9d113c-bd95-467a-9bfc-0ec72ef3ef5d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:49.336207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de9d113c-bd95-467a-9bfc-0ec72ef3ef5d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:49.336658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de9d113c-bd95-467a-9bfc-0ec72ef3ef5d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:49.337436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de9d113c-bd95-467a-9bfc-0ec72ef3ef5d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:49.337905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de9d113c-bd95-467a-9bfc-0ec72ef3ef5d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:49.368096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-de9d113c-bd95-467a-9bfc-0ec72ef3ef5d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041784 Sep 14 19:51:49.368724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 973/1922] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:49 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:49.571793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-de44f8d1-35ea-44f2-a0f1-575de3bb8c2c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:49.572772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-de44f8d1-35ea-44f2-a0f1-575de3bb8c2c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:49.578825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de44f8d1-35ea-44f2-a0f1-575de3bb8c2c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:49.579277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de44f8d1-35ea-44f2-a0f1-575de3bb8c2c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:49.580070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de44f8d1-35ea-44f2-a0f1-575de3bb8c2c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:49.580501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de44f8d1-35ea-44f2-a0f1-575de3bb8c2c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:49.649833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d44f7b96-6494-4aff-bd4a-fe654cab5afa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:49.650736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d44f7b96-6494-4aff-bd4a-fe654cab5afa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:49.656957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d44f7b96-6494-4aff-bd4a-fe654cab5afa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:49.657401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d44f7b96-6494-4aff-bd4a-fe654cab5afa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:49.658196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d44f7b96-6494-4aff-bd4a-fe654cab5afa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:49.658640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d44f7b96-6494-4aff-bd4a-fe654cab5afa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:49.664572 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-de44f8d1-35ea-44f2-a0f1-575de3bb8c2c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 27009 microversion: 2.1 time: 0.096328 Sep 14 19:51:49.668625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 950/1923] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:49 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 27009 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:49.688468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d44f7b96-6494-4aff-bd4a-fe654cab5afa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042284 Sep 14 19:51:49.689043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 974/1924] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:49 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:50.262113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e16d9beb-1a0c-473b-97c3-e5d417cbe93e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:50.262113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e16d9beb-1a0c-473b-97c3-e5d417cbe93e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:50.268855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e16d9beb-1a0c-473b-97c3-e5d417cbe93e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:50.269306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e16d9beb-1a0c-473b-97c3-e5d417cbe93e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:50.270113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e16d9beb-1a0c-473b-97c3-e5d417cbe93e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:50.270558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e16d9beb-1a0c-473b-97c3-e5d417cbe93e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:50.380305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dce5a780-3aca-4568-829f-a04b61934bd4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:50.381224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dce5a780-3aca-4568-829f-a04b61934bd4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:50.389126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dce5a780-3aca-4568-829f-a04b61934bd4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:50.389126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dce5a780-3aca-4568-829f-a04b61934bd4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:50.389126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dce5a780-3aca-4568-829f-a04b61934bd4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:50.389938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dce5a780-3aca-4568-829f-a04b61934bd4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:50.400500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e16d9beb-1a0c-473b-97c3-e5d417cbe93e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:50.416954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e16d9beb-1a0c-473b-97c3-e5d417cbe93e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.160255 Sep 14 19:51:50.417723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 951/1925] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:50 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:50.420073 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dce5a780-3aca-4568-829f-a04b61934bd4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Sep 14 19:51:50.420671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 975/1926] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:50 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:50.677159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a4c5ce03-31f1-4a0e-a74e-2e435298cc2a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:50.678204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a4c5ce03-31f1-4a0e-a74e-2e435298cc2a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:50.684074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4c5ce03-31f1-4a0e-a74e-2e435298cc2a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:50.686960 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4c5ce03-31f1-4a0e-a74e-2e435298cc2a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:50.686960 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4c5ce03-31f1-4a0e-a74e-2e435298cc2a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:50.686960 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4c5ce03-31f1-4a0e-a74e-2e435298cc2a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:50.699816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8575465b-c715-42af-810c-4298b4c42846 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:50.700834 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8575465b-c715-42af-810c-4298b4c42846 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:50.706993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8575465b-c715-42af-810c-4298b4c42846 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:50.707423 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8575465b-c715-42af-810c-4298b4c42846 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:50.708201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8575465b-c715-42af-810c-4298b4c42846 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:50.708640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8575465b-c715-42af-810c-4298b4c42846 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:50.740180 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8575465b-c715-42af-810c-4298b4c42846 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044135 Sep 14 19:51:50.740760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 976/1927] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:50 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:50.767680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a4c5ce03-31f1-4a0e-a74e-2e435298cc2a tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 27782 microversion: 2.1 time: 0.094203 Sep 14 19:51:50.768441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 952/1928] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:50 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 27782 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:51.431744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-602b6b13-b247-443c-8821-993b2316c728 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:51.432887 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-602b6b13-b247-443c-8821-993b2316c728 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:51.434281 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-48a3bcc4-7cdc-4504-a839-1e1157944ce0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:51.434981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-48a3bcc4-7cdc-4504-a839-1e1157944ce0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:51.439007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-602b6b13-b247-443c-8821-993b2316c728 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:51.439469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-602b6b13-b247-443c-8821-993b2316c728 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:51.440250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-602b6b13-b247-443c-8821-993b2316c728 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:51.440692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-602b6b13-b247-443c-8821-993b2316c728 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:51.441444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48a3bcc4-7cdc-4504-a839-1e1157944ce0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:51.441925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48a3bcc4-7cdc-4504-a839-1e1157944ce0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:51.442701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48a3bcc4-7cdc-4504-a839-1e1157944ce0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:51.443236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48a3bcc4-7cdc-4504-a839-1e1157944ce0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:51.471295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-602b6b13-b247-443c-8821-993b2316c728 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Sep 14 19:51:51.471858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 977/1929] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:51 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:51.564962 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-48a3bcc4-7cdc-4504-a839-1e1157944ce0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:51.572242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-48a3bcc4-7cdc-4504-a839-1e1157944ce0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141974 Sep 14 19:51:51.572804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 953/1930] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:51 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:51.751574 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8c4046b3-0d23-44f5-9f5a-f9339a79f494 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:51.752783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8c4046b3-0d23-44f5-9f5a-f9339a79f494 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:51.758673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c4046b3-0d23-44f5-9f5a-f9339a79f494 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:51.759122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c4046b3-0d23-44f5-9f5a-f9339a79f494 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:51.759896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c4046b3-0d23-44f5-9f5a-f9339a79f494 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:51.760334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c4046b3-0d23-44f5-9f5a-f9339a79f494 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:51.778972 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7ee47f51-7ccc-4a00-bd92-59b5d95b89cd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:51.779867 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7ee47f51-7ccc-4a00-bd92-59b5d95b89cd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:51.790013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8c4046b3-0d23-44f5-9f5a-f9339a79f494 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042176 Sep 14 19:51:51.790589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 978/1931] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:51 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:51.795655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ee47f51-7ccc-4a00-bd92-59b5d95b89cd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:51.796212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ee47f51-7ccc-4a00-bd92-59b5d95b89cd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:51.797689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ee47f51-7ccc-4a00-bd92-59b5d95b89cd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:51.798125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7ee47f51-7ccc-4a00-bd92-59b5d95b89cd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:51.872705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7ee47f51-7ccc-4a00-bd92-59b5d95b89cd tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 28211 microversion: 2.1 time: 0.097057 Sep 14 19:51:51.873380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 954/1932] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:51 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 28211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:52.493976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0e13e875-74ca-48f4-844d-9aee88e059fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:52.493976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0e13e875-74ca-48f4-844d-9aee88e059fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:52.493976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e13e875-74ca-48f4-844d-9aee88e059fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:52.493976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e13e875-74ca-48f4-844d-9aee88e059fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:52.494749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e13e875-74ca-48f4-844d-9aee88e059fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:52.494749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0e13e875-74ca-48f4-844d-9aee88e059fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:52.520894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0e13e875-74ca-48f4-844d-9aee88e059fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042167 Sep 14 19:51:52.521462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 979/1933] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:52 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:52.590054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f401184b-4bcb-4ae2-8749-5e772eb71c03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:52.590760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f401184b-4bcb-4ae2-8749-5e772eb71c03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:52.597372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f401184b-4bcb-4ae2-8749-5e772eb71c03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:52.597854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f401184b-4bcb-4ae2-8749-5e772eb71c03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:52.598636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f401184b-4bcb-4ae2-8749-5e772eb71c03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:52.599073 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f401184b-4bcb-4ae2-8749-5e772eb71c03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:52.717966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f401184b-4bcb-4ae2-8749-5e772eb71c03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:52.725279 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f401184b-4bcb-4ae2-8749-5e772eb71c03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139367 Sep 14 19:51:52.725883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 955/1934] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:52 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:52.802002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-230d53f6-df30-4741-b0af-f6335e20a91f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:52.802917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-230d53f6-df30-4741-b0af-f6335e20a91f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:52.808722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-230d53f6-df30-4741-b0af-f6335e20a91f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:52.809170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-230d53f6-df30-4741-b0af-f6335e20a91f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:52.809966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-230d53f6-df30-4741-b0af-f6335e20a91f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:52.810397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-230d53f6-df30-4741-b0af-f6335e20a91f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:52.839967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-230d53f6-df30-4741-b0af-f6335e20a91f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042064 Sep 14 19:51:52.840524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 980/1935] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:52.884400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a01ad255-8ba2-4218-b4cf-e3736679a871 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:52.885396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a01ad255-8ba2-4218-b4cf-e3736679a871 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:52.891329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a01ad255-8ba2-4218-b4cf-e3736679a871 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:52.891750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a01ad255-8ba2-4218-b4cf-e3736679a871 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:52.892505 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a01ad255-8ba2-4218-b4cf-e3736679a871 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:52.892996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a01ad255-8ba2-4218-b4cf-e3736679a871 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:52.954697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a01ad255-8ba2-4218-b4cf-e3736679a871 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 28211 microversion: 2.1 time: 0.073779 Sep 14 19:51:52.955315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 956/1936] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:52 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 28211 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:53.532200 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a17a3c52-08b4-4df6-a363-2047122d2b2c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:53.533689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a17a3c52-08b4-4df6-a363-2047122d2b2c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:53.539575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a17a3c52-08b4-4df6-a363-2047122d2b2c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:53.540013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a17a3c52-08b4-4df6-a363-2047122d2b2c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:53.540775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a17a3c52-08b4-4df6-a363-2047122d2b2c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:53.541260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a17a3c52-08b4-4df6-a363-2047122d2b2c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:53.570020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a17a3c52-08b4-4df6-a363-2047122d2b2c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 Sep 14 19:51:53.570579 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 981/1937] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:53 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:53.743308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a821313d-10a8-446a-adb1-74b054c708ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:53.744006 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a821313d-10a8-446a-adb1-74b054c708ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:53.750711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a821313d-10a8-446a-adb1-74b054c708ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:53.751164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a821313d-10a8-446a-adb1-74b054c708ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:53.751995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a821313d-10a8-446a-adb1-74b054c708ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:53.752434 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a821313d-10a8-446a-adb1-74b054c708ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:53.880120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a821313d-10a8-446a-adb1-74b054c708ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:53.887760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a821313d-10a8-446a-adb1-74b054c708ce tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.148495 Sep 14 19:51:53.888365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 957/1938] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:53 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:53.915883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5e9d3abe-1bdb-43cc-b128-ac6286afa3e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:53.916861 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5e9d3abe-1bdb-43cc-b128-ac6286afa3e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:53.922641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e9d3abe-1bdb-43cc-b128-ac6286afa3e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:53.932418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e9d3abe-1bdb-43cc-b128-ac6286afa3e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:53.932418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e9d3abe-1bdb-43cc-b128-ac6286afa3e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:53.932418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5e9d3abe-1bdb-43cc-b128-ac6286afa3e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:53.952986 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5e9d3abe-1bdb-43cc-b128-ac6286afa3e3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105216 Sep 14 19:51:53.953573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 982/1939] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:53 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:53.965938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d552c5a1-b21e-433d-8848-fb194fe580b9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:53.966847 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d552c5a1-b21e-433d-8848-fb194fe580b9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:53.972645 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d552c5a1-b21e-433d-8848-fb194fe580b9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:53.973097 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d552c5a1-b21e-433d-8848-fb194fe580b9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:53.973895 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d552c5a1-b21e-433d-8848-fb194fe580b9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:53.974336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d552c5a1-b21e-433d-8848-fb194fe580b9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:54.047819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d552c5a1-b21e-433d-8848-fb194fe580b9 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 28502 microversion: 2.1 time: 0.085264 Sep 14 19:51:54.048405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 958/1940] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:53 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 28502 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:54.580782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fa24d258-0265-4129-8991-3b433f4c824d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:54.581659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fa24d258-0265-4129-8991-3b433f4c824d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:54.587721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa24d258-0265-4129-8991-3b433f4c824d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:54.588166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa24d258-0265-4129-8991-3b433f4c824d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:54.588936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa24d258-0265-4129-8991-3b433f4c824d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:54.589415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa24d258-0265-4129-8991-3b433f4c824d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:54.620076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fa24d258-0265-4129-8991-3b433f4c824d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043158 Sep 14 19:51:54.620639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 983/1941] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:54 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:54.905904 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-48f9ac11-aa12-4d8b-81e1-591ae547ac15 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:54.906607 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-48f9ac11-aa12-4d8b-81e1-591ae547ac15 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:54.913978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48f9ac11-aa12-4d8b-81e1-591ae547ac15 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:54.914362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48f9ac11-aa12-4d8b-81e1-591ae547ac15 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:54.915137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48f9ac11-aa12-4d8b-81e1-591ae547ac15 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:54.915572 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48f9ac11-aa12-4d8b-81e1-591ae547ac15 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:54.964212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-018ab2c1-9ee8-4f18-b74e-db5cf78b74b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:54.965229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-018ab2c1-9ee8-4f18-b74e-db5cf78b74b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:54.971578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-018ab2c1-9ee8-4f18-b74e-db5cf78b74b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:54.972027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-018ab2c1-9ee8-4f18-b74e-db5cf78b74b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:54.972796 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-018ab2c1-9ee8-4f18-b74e-db5cf78b74b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:54.973232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-018ab2c1-9ee8-4f18-b74e-db5cf78b74b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:55.002232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-018ab2c1-9ee8-4f18-b74e-db5cf78b74b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041821 Sep 14 19:51:55.002805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 984/1942] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:55.036360 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-48f9ac11-aa12-4d8b-81e1-591ae547ac15 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:55.043778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-48f9ac11-aa12-4d8b-81e1-591ae547ac15 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142057 Sep 14 19:51:55.044340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 959/1943] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:54 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:55.059391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-588e417d-ce46-4922-88cc-6f00ceb6cfee tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:55.060294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-588e417d-ce46-4922-88cc-6f00ceb6cfee tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:55.066162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-588e417d-ce46-4922-88cc-6f00ceb6cfee tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:55.066611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-588e417d-ce46-4922-88cc-6f00ceb6cfee tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:55.067377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-588e417d-ce46-4922-88cc-6f00ceb6cfee tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:55.067819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-588e417d-ce46-4922-88cc-6f00ceb6cfee tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:55.140854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-588e417d-ce46-4922-88cc-6f00ceb6cfee tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 28670 microversion: 2.1 time: 0.084926 Sep 14 19:51:55.142070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 985/1944] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:55 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 28670 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:55.632390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-15093aeb-57ec-4c04-8be3-9df9c203edaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:55.633288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-15093aeb-57ec-4c04-8be3-9df9c203edaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:55.639232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15093aeb-57ec-4c04-8be3-9df9c203edaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:55.639673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15093aeb-57ec-4c04-8be3-9df9c203edaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:55.640426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15093aeb-57ec-4c04-8be3-9df9c203edaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:55.640854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15093aeb-57ec-4c04-8be3-9df9c203edaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:55.670418 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-15093aeb-57ec-4c04-8be3-9df9c203edaa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041812 Sep 14 19:51:55.671019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 960/1945] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:55 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:56.014088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dceb3b23-314e-49a2-9fd5-d8fd23e97c6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:56.015076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dceb3b23-314e-49a2-9fd5-d8fd23e97c6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:56.021621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dceb3b23-314e-49a2-9fd5-d8fd23e97c6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:56.022078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dceb3b23-314e-49a2-9fd5-d8fd23e97c6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:56.022896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dceb3b23-314e-49a2-9fd5-d8fd23e97c6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:56.023339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dceb3b23-314e-49a2-9fd5-d8fd23e97c6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:56.054086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dceb3b23-314e-49a2-9fd5-d8fd23e97c6b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044148 Sep 14 19:51:56.054717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 986/1946] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:56 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:56.060622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bffd5598-8e84-44fa-b217-93ea43a29495 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:56.061230 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bffd5598-8e84-44fa-b217-93ea43a29495 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:56.067508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bffd5598-8e84-44fa-b217-93ea43a29495 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:56.067954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bffd5598-8e84-44fa-b217-93ea43a29495 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:56.068718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bffd5598-8e84-44fa-b217-93ea43a29495 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:56.069153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bffd5598-8e84-44fa-b217-93ea43a29495 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:56.152593 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4f1577f2-a6c6-4ea6-a3bc-d7541dcc0a94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:56.153518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4f1577f2-a6c6-4ea6-a3bc-d7541dcc0a94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:56.160091 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f1577f2-a6c6-4ea6-a3bc-d7541dcc0a94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:56.160542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f1577f2-a6c6-4ea6-a3bc-d7541dcc0a94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:56.161331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f1577f2-a6c6-4ea6-a3bc-d7541dcc0a94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:56.161828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f1577f2-a6c6-4ea6-a3bc-d7541dcc0a94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:56.198427 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bffd5598-8e84-44fa-b217-93ea43a29495 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:56.201098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bffd5598-8e84-44fa-b217-93ea43a29495 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.144107 Sep 14 19:51:56.201721 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 961/1947] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:56 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:56.225033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4f1577f2-a6c6-4ea6-a3bc-d7541dcc0a94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 28670 microversion: 2.1 time: 0.076041 Sep 14 19:51:56.225829 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 987/1948] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:56 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 28670 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:56.682908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b26cca18-a03a-4058-8d40-601a9f0929ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:56.683819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b26cca18-a03a-4058-8d40-601a9f0929ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:56.690447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b26cca18-a03a-4058-8d40-601a9f0929ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:56.690953 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b26cca18-a03a-4058-8d40-601a9f0929ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:56.691889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b26cca18-a03a-4058-8d40-601a9f0929ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:56.692567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b26cca18-a03a-4058-8d40-601a9f0929ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:56.723668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b26cca18-a03a-4058-8d40-601a9f0929ea tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044516 Sep 14 19:51:56.724228 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 962/1949] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:56 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:51:57.066811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9752f832-b71f-456c-bf96-62ecb9fb83af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:57.067869 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9752f832-b71f-456c-bf96-62ecb9fb83af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:57.074232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9752f832-b71f-456c-bf96-62ecb9fb83af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:57.074679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9752f832-b71f-456c-bf96-62ecb9fb83af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:57.075437 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9752f832-b71f-456c-bf96-62ecb9fb83af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:57.075864 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9752f832-b71f-456c-bf96-62ecb9fb83af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:57.104655 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9752f832-b71f-456c-bf96-62ecb9fb83af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042399 Sep 14 19:51:57.105233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 988/1950] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:57 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:57.217889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f2014141-910b-4b1b-b396-bd474bbc4fb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:57.218421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f2014141-910b-4b1b-b396-bd474bbc4fb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:57.224282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2014141-910b-4b1b-b396-bd474bbc4fb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:57.224726 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2014141-910b-4b1b-b396-bd474bbc4fb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:57.225511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2014141-910b-4b1b-b396-bd474bbc4fb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:57.225955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f2014141-910b-4b1b-b396-bd474bbc4fb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:57.239669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-63205686-ac20-4111-b076-f301e5be2522 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:57.241221 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-63205686-ac20-4111-b076-f301e5be2522 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:57.253094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-63205686-ac20-4111-b076-f301e5be2522 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:57.253870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-63205686-ac20-4111-b076-f301e5be2522 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:57.255045 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-63205686-ac20-4111-b076-f301e5be2522 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:57.255763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-63205686-ac20-4111-b076-f301e5be2522 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:57.321261 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-63205686-ac20-4111-b076-f301e5be2522 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 28670 microversion: 2.1 time: 0.088387 Sep 14 19:51:57.325394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 989/1951] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:57 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 28670 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:51:57.361593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f2014141-910b-4b1b-b396-bd474bbc4fb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:57.368805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f2014141-910b-4b1b-b396-bd474bbc4fb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.154636 Sep 14 19:51:57.369371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 963/1952] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:57 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:57.736291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-31a6266b-48ec-48da-9cec-a7ef75e08a88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:57.737288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-31a6266b-48ec-48da-9cec-a7ef75e08a88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:57.743792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-31a6266b-48ec-48da-9cec-a7ef75e08a88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:57.744271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-31a6266b-48ec-48da-9cec-a7ef75e08a88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:57.745037 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-31a6266b-48ec-48da-9cec-a7ef75e08a88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:57.745471 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-31a6266b-48ec-48da-9cec-a7ef75e08a88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:57.777953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-31a6266b-48ec-48da-9cec-a7ef75e08a88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046337 Sep 14 19:51:57.778423 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 990/1953] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:57 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:58.116421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c4908cac-c84a-4a9d-b77b-24780c55cecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:58.117365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c4908cac-c84a-4a9d-b77b-24780c55cecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:58.123623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c4908cac-c84a-4a9d-b77b-24780c55cecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:58.124077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c4908cac-c84a-4a9d-b77b-24780c55cecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:58.124847 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c4908cac-c84a-4a9d-b77b-24780c55cecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:58.125329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c4908cac-c84a-4a9d-b77b-24780c55cecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:58.155102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c4908cac-c84a-4a9d-b77b-24780c55cecd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042623 Sep 14 19:51:58.155660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 964/1954] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:58 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:58.333555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-29b5ed41-d960-458b-baa9-c297e502df68 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:58.334374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-29b5ed41-d960-458b-baa9-c297e502df68 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:58.340148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29b5ed41-d960-458b-baa9-c297e502df68 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:58.340602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29b5ed41-d960-458b-baa9-c297e502df68 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:58.341379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29b5ed41-d960-458b-baa9-c297e502df68 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:58.341846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29b5ed41-d960-458b-baa9-c297e502df68 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:58.386478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9be440ca-84bd-4754-b43d-eeb5fb55f1fd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:58.387081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9be440ca-84bd-4754-b43d-eeb5fb55f1fd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:58.393803 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9be440ca-84bd-4754-b43d-eeb5fb55f1fd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:58.394243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9be440ca-84bd-4754-b43d-eeb5fb55f1fd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:58.394997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9be440ca-84bd-4754-b43d-eeb5fb55f1fd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:58.395428 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9be440ca-84bd-4754-b43d-eeb5fb55f1fd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:58.427655 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-29b5ed41-d960-458b-baa9-c297e502df68 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 29119 microversion: 2.1 time: 0.098345 Sep 14 19:51:58.428608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 991/1955] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:58 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 29119 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:58.515666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9be440ca-84bd-4754-b43d-eeb5fb55f1fd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:58.523621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9be440ca-84bd-4754-b43d-eeb5fb55f1fd tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140826 Sep 14 19:51:58.524180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 965/1956] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:58 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:51:58.789838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6ddcd52d-a2d8-4ebf-8f48-cf3d3ae2d1b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:58.790836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6ddcd52d-a2d8-4ebf-8f48-cf3d3ae2d1b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:58.797385 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ddcd52d-a2d8-4ebf-8f48-cf3d3ae2d1b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:58.798369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ddcd52d-a2d8-4ebf-8f48-cf3d3ae2d1b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:58.799397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ddcd52d-a2d8-4ebf-8f48-cf3d3ae2d1b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:58.799828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6ddcd52d-a2d8-4ebf-8f48-cf3d3ae2d1b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:58.828740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6ddcd52d-a2d8-4ebf-8f48-cf3d3ae2d1b0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Sep 14 19:51:58.829276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 992/1957] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:58 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:51:59.167277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e7deae7e-beec-4f37-9ad3-b141087a35aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:59.168171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e7deae7e-beec-4f37-9ad3-b141087a35aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:59.174234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7deae7e-beec-4f37-9ad3-b141087a35aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:59.175205 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7deae7e-beec-4f37-9ad3-b141087a35aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:59.175969 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7deae7e-beec-4f37-9ad3-b141087a35aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:59.176403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e7deae7e-beec-4f37-9ad3-b141087a35aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:59.204577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e7deae7e-beec-4f37-9ad3-b141087a35aa tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041101 Sep 14 19:51:59.205124 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 966/1958] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:51:59 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:59.438612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c77cfa54-9a02-4097-ba84-3cf8af950b36 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:51:59.439522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c77cfa54-9a02-4097-ba84-3cf8af950b36 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:59.445439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c77cfa54-9a02-4097-ba84-3cf8af950b36 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:59.445908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c77cfa54-9a02-4097-ba84-3cf8af950b36 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:59.446773 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c77cfa54-9a02-4097-ba84-3cf8af950b36 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:59.447228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c77cfa54-9a02-4097-ba84-3cf8af950b36 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:59.523933 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c77cfa54-9a02-4097-ba84-3cf8af950b36 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 31289 microversion: 2.1 time: 0.088924 Sep 14 19:51:59.524576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 993/1959] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:51:59 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 31289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:51:59.540487 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9822e1e5-00a6-4397-b4e6-9053ca0cb136 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:59.541100 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9822e1e5-00a6-4397-b4e6-9053ca0cb136 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:59.546999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9822e1e5-00a6-4397-b4e6-9053ca0cb136 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:59.547439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9822e1e5-00a6-4397-b4e6-9053ca0cb136 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:59.548208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9822e1e5-00a6-4397-b4e6-9053ca0cb136 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:59.548898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9822e1e5-00a6-4397-b4e6-9053ca0cb136 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:59.669851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9822e1e5-00a6-4397-b4e6-9053ca0cb136 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:51:59.677684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9822e1e5-00a6-4397-b4e6-9053ca0cb136 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140864 Sep 14 19:51:59.678264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 967/1960] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:51:59 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:51:59.840725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-86eddee6-6df3-4d98-a8f0-2d3df8bb322c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:51:59.841747 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-86eddee6-6df3-4d98-a8f0-2d3df8bb322c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:51:59.848404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86eddee6-6df3-4d98-a8f0-2d3df8bb322c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:59.848841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86eddee6-6df3-4d98-a8f0-2d3df8bb322c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:59.849686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86eddee6-6df3-4d98-a8f0-2d3df8bb322c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:51:59.850122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86eddee6-6df3-4d98-a8f0-2d3df8bb322c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:51:59.880057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-86eddee6-6df3-4d98-a8f0-2d3df8bb322c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043400 Sep 14 19:51:59.880615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 994/1961] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:51:59 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:52:00.216454 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5ff2b5c8-74cd-4260-8de2-8219c5895f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:00.217285 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5ff2b5c8-74cd-4260-8de2-8219c5895f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:00.223227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ff2b5c8-74cd-4260-8de2-8219c5895f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:00.223666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ff2b5c8-74cd-4260-8de2-8219c5895f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:00.224500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ff2b5c8-74cd-4260-8de2-8219c5895f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:00.224930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ff2b5c8-74cd-4260-8de2-8219c5895f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:00.254493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5ff2b5c8-74cd-4260-8de2-8219c5895f79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042002 Sep 14 19:52:00.255053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 968/1962] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:00 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:00.536171 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fdf76ab7-36a8-4db3-9623-dad0519486a4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:00.537119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fdf76ab7-36a8-4db3-9623-dad0519486a4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:00.543020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdf76ab7-36a8-4db3-9623-dad0519486a4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:00.543475 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdf76ab7-36a8-4db3-9623-dad0519486a4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:00.544240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdf76ab7-36a8-4db3-9623-dad0519486a4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:00.544728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdf76ab7-36a8-4db3-9623-dad0519486a4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:00.618872 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fdf76ab7-36a8-4db3-9623-dad0519486a4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 33046 microversion: 2.1 time: 0.086765 Sep 14 19:52:00.619508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 995/1963] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:00 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 33046 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:00.694315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-22cf4ca0-70ec-4c98-8770-b2e1b09c9213 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:00.694933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-22cf4ca0-70ec-4c98-8770-b2e1b09c9213 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:00.700737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22cf4ca0-70ec-4c98-8770-b2e1b09c9213 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:00.701189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22cf4ca0-70ec-4c98-8770-b2e1b09c9213 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:00.702038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22cf4ca0-70ec-4c98-8770-b2e1b09c9213 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:00.702478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22cf4ca0-70ec-4c98-8770-b2e1b09c9213 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:00.826595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-22cf4ca0-70ec-4c98-8770-b2e1b09c9213 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:00.833952 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-22cf4ca0-70ec-4c98-8770-b2e1b09c9213 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143173 Sep 14 19:52:00.834525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 969/1964] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:00 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:00.891771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ce23aaea-176a-4357-b5ee-809e689b1437 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:00.893299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ce23aaea-176a-4357-b5ee-809e689b1437 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:00.899774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce23aaea-176a-4357-b5ee-809e689b1437 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:00.900219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce23aaea-176a-4357-b5ee-809e689b1437 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:00.900990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce23aaea-176a-4357-b5ee-809e689b1437 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:00.901425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce23aaea-176a-4357-b5ee-809e689b1437 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:00.930360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ce23aaea-176a-4357-b5ee-809e689b1437 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042723 Sep 14 19:52:00.930901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 996/1965] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Sep 14 19:52:00 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:52:01.266876 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5101eaf4-20b0-4109-8281-bc59615ac74d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:01.268793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5101eaf4-20b0-4109-8281-bc59615ac74d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:01.275800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5101eaf4-20b0-4109-8281-bc59615ac74d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:01.276395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5101eaf4-20b0-4109-8281-bc59615ac74d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:01.277423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5101eaf4-20b0-4109-8281-bc59615ac74d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:01.278123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5101eaf4-20b0-4109-8281-bc59615ac74d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:01.311647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5101eaf4-20b0-4109-8281-bc59615ac74d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049024 Sep 14 19:52:01.312182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 970/1966] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:01 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:01.631238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-97b53048-80f6-48af-a5e1-e4d5521df06b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:01.632189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-97b53048-80f6-48af-a5e1-e4d5521df06b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:01.643124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-97b53048-80f6-48af-a5e1-e4d5521df06b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:01.643124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-97b53048-80f6-48af-a5e1-e4d5521df06b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:01.643124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-97b53048-80f6-48af-a5e1-e4d5521df06b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:01.643124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-97b53048-80f6-48af-a5e1-e4d5521df06b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:01.713340 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-97b53048-80f6-48af-a5e1-e4d5521df06b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 33947 microversion: 2.1 time: 0.086163 Sep 14 19:52:01.714184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 997/1967] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:01 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 33947 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:01.850660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-61825388-fbf8-4069-8f40-2381fae9114a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:01.851262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-61825388-fbf8-4069-8f40-2381fae9114a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:01.857137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61825388-fbf8-4069-8f40-2381fae9114a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:01.860710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61825388-fbf8-4069-8f40-2381fae9114a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:01.860710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61825388-fbf8-4069-8f40-2381fae9114a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:01.860710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61825388-fbf8-4069-8f40-2381fae9114a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:01.942774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c05d2991-c571-4ca1-9a5b-7eca06953ad5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:01.943778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c05d2991-c571-4ca1-9a5b-7eca06953ad5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:01.950540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c05d2991-c571-4ca1-9a5b-7eca06953ad5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:01.952631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c05d2991-c571-4ca1-9a5b-7eca06953ad5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:01.952631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c05d2991-c571-4ca1-9a5b-7eca06953ad5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:01.952631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c05d2991-c571-4ca1-9a5b-7eca06953ad5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:01.980697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-61825388-fbf8-4069-8f40-2381fae9114a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:01.989001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-61825388-fbf8-4069-8f40-2381fae9114a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142134 Sep 14 19:52:01.989590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 971/1968] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:01 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:02.033355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c05d2991-c571-4ca1-9a5b-7eca06953ad5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "POST /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/action" status: 200 len: 40546 microversion: 2.1 time: 0.095001 Sep 14 19:52:02.034550 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 998/1969] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:01 2021] POST /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6/action => generated 40546 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:52:02.323359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-953ae666-278b-49a9-a88e-7525b457ccfb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:02.324260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-953ae666-278b-49a9-a88e-7525b457ccfb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:02.330503 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-953ae666-278b-49a9-a88e-7525b457ccfb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:02.330955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-953ae666-278b-49a9-a88e-7525b457ccfb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:02.331719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-953ae666-278b-49a9-a88e-7525b457ccfb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:02.332147 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-953ae666-278b-49a9-a88e-7525b457ccfb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:02.360780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-953ae666-278b-49a9-a88e-7525b457ccfb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041246 Sep 14 19:52:02.361329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 972/1970] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:02 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:02.726737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-86892320-9abd-4912-8d4f-e37840deb361 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:02.727654 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-86892320-9abd-4912-8d4f-e37840deb361 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:02.734137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86892320-9abd-4912-8d4f-e37840deb361 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:02.734590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86892320-9abd-4912-8d4f-e37840deb361 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:02.735366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86892320-9abd-4912-8d4f-e37840deb361 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:02.735806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86892320-9abd-4912-8d4f-e37840deb361 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:02.814310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-86892320-9abd-4912-8d4f-e37840deb361 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 35002 microversion: 2.1 time: 0.091566 Sep 14 19:52:02.819056 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 999/1971] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:02 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 35002 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:03.006378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-78667a91-3323-4b6e-a7b8-8938573da964 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:03.009920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-78667a91-3323-4b6e-a7b8-8938573da964 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:03.013546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-78667a91-3323-4b6e-a7b8-8938573da964 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:03.013994 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-78667a91-3323-4b6e-a7b8-8938573da964 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:03.014775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-78667a91-3323-4b6e-a7b8-8938573da964 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:03.015688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-78667a91-3323-4b6e-a7b8-8938573da964 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:03.137766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-78667a91-3323-4b6e-a7b8-8938573da964 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:03.145694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-78667a91-3323-4b6e-a7b8-8938573da964 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143619 Sep 14 19:52:03.146269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 973/1972] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:03 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:52:03.372628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9693a7e2-f58f-4b6e-aa9d-2429940eacc7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:03.373657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9693a7e2-f58f-4b6e-aa9d-2429940eacc7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:03.380702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9693a7e2-f58f-4b6e-aa9d-2429940eacc7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:03.381152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9693a7e2-f58f-4b6e-aa9d-2429940eacc7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:03.381967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9693a7e2-f58f-4b6e-aa9d-2429940eacc7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:03.382411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9693a7e2-f58f-4b6e-aa9d-2429940eacc7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:03.410458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9693a7e2-f58f-4b6e-aa9d-2429940eacc7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041940 Sep 14 19:52:03.411003 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1000/1973] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:03.826772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b039f41e-4ca5-4e73-9199-00c63456b1c7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:03.827681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b039f41e-4ca5-4e73-9199-00c63456b1c7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:03.833611 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b039f41e-4ca5-4e73-9199-00c63456b1c7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:03.834065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b039f41e-4ca5-4e73-9199-00c63456b1c7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:03.834845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b039f41e-4ca5-4e73-9199-00c63456b1c7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:03.835282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b039f41e-4ca5-4e73-9199-00c63456b1c7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:03.914958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b039f41e-4ca5-4e73-9199-00c63456b1c7 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 36266 microversion: 2.1 time: 0.091673 Sep 14 19:52:03.915606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 974/1974] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:03 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 36266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:04.163192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-16c92264-f06d-4bb7-ab69-b0b5cdfa28a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:04.163678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-16c92264-f06d-4bb7-ab69-b0b5cdfa28a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:04.169650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16c92264-f06d-4bb7-ab69-b0b5cdfa28a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:04.170098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16c92264-f06d-4bb7-ab69-b0b5cdfa28a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:04.170879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16c92264-f06d-4bb7-ab69-b0b5cdfa28a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:04.171315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16c92264-f06d-4bb7-ab69-b0b5cdfa28a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:04.346028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-16c92264-f06d-4bb7-ab69-b0b5cdfa28a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:04.353655 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-16c92264-f06d-4bb7-ab69-b0b5cdfa28a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.194784 Sep 14 19:52:04.354220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1001/1975] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:04 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:04.421536 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-74591cfa-4ad3-491d-ade5-7d0110de4a8c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:04.422464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-74591cfa-4ad3-491d-ade5-7d0110de4a8c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:04.429312 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74591cfa-4ad3-491d-ade5-7d0110de4a8c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:04.429823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74591cfa-4ad3-491d-ade5-7d0110de4a8c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:04.430579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74591cfa-4ad3-491d-ade5-7d0110de4a8c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:04.431018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74591cfa-4ad3-491d-ade5-7d0110de4a8c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:04.460294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-74591cfa-4ad3-491d-ade5-7d0110de4a8c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043031 Sep 14 19:52:04.460840 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 975/1976] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:04 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:04.927250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-067fe5c8-2862-4f46-a9fc-7e63d5fc9cad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:04.928156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-067fe5c8-2862-4f46-a9fc-7e63d5fc9cad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:04.934247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-067fe5c8-2862-4f46-a9fc-7e63d5fc9cad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:04.934693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-067fe5c8-2862-4f46-a9fc-7e63d5fc9cad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:04.935463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-067fe5c8-2862-4f46-a9fc-7e63d5fc9cad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:04.935902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-067fe5c8-2862-4f46-a9fc-7e63d5fc9cad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:05.007605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-067fe5c8-2862-4f46-a9fc-7e63d5fc9cad tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 37840 microversion: 2.1 time: 0.084691 Sep 14 19:52:05.008249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1002/1977] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:04 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 37840 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:05.373712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2865608d-0492-45e9-8c56-3cd0513e8d8c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:05.374745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2865608d-0492-45e9-8c56-3cd0513e8d8c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:05.381442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2865608d-0492-45e9-8c56-3cd0513e8d8c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:05.381920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2865608d-0492-45e9-8c56-3cd0513e8d8c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:05.382693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2865608d-0492-45e9-8c56-3cd0513e8d8c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:05.383128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2865608d-0492-45e9-8c56-3cd0513e8d8c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:05.472917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3d991689-03c5-43f0-b08d-30c18e69838c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:05.473878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3d991689-03c5-43f0-b08d-30c18e69838c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:05.480456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d991689-03c5-43f0-b08d-30c18e69838c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:05.480909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d991689-03c5-43f0-b08d-30c18e69838c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:05.481733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d991689-03c5-43f0-b08d-30c18e69838c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:05.482167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3d991689-03c5-43f0-b08d-30c18e69838c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:05.506200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2865608d-0492-45e9-8c56-3cd0513e8d8c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:05.511675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3d991689-03c5-43f0-b08d-30c18e69838c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043597 Sep 14 19:52:05.512260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1003/1978] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:05 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:52:05.513547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2865608d-0492-45e9-8c56-3cd0513e8d8c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.146132 Sep 14 19:52:05.514091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 976/1979] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:05 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:06.020031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e94140fb-2082-4bbf-a726-720400f836dc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:06.020985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e94140fb-2082-4bbf-a726-720400f836dc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:06.026848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e94140fb-2082-4bbf-a726-720400f836dc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:06.027293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e94140fb-2082-4bbf-a726-720400f836dc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:06.028055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e94140fb-2082-4bbf-a726-720400f836dc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:06.028488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e94140fb-2082-4bbf-a726-720400f836dc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:06.099615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e94140fb-2082-4bbf-a726-720400f836dc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 38196 microversion: 2.1 time: 0.083698 Sep 14 19:52:06.100157 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1004/1980] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:06 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 38196 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:06.523475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bc92d14b-1d8c-4ece-996d-1a2ec1b4394b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:06.524412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bc92d14b-1d8c-4ece-996d-1a2ec1b4394b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:06.530442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc92d14b-1d8c-4ece-996d-1a2ec1b4394b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:06.530938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc92d14b-1d8c-4ece-996d-1a2ec1b4394b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:06.531182 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-de587983-7b66-4288-9252-79a19d9a2f0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:06.531711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc92d14b-1d8c-4ece-996d-1a2ec1b4394b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:06.531884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-de587983-7b66-4288-9252-79a19d9a2f0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:06.532149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bc92d14b-1d8c-4ece-996d-1a2ec1b4394b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:06.539033 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de587983-7b66-4288-9252-79a19d9a2f0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:06.539479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de587983-7b66-4288-9252-79a19d9a2f0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:06.540274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de587983-7b66-4288-9252-79a19d9a2f0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:06.540734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de587983-7b66-4288-9252-79a19d9a2f0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:06.562559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bc92d14b-1d8c-4ece-996d-1a2ec1b4394b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042943 Sep 14 19:52:06.563120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 977/1981] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:06 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:06.664516 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-de587983-7b66-4288-9252-79a19d9a2f0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:06.671987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-de587983-7b66-4288-9252-79a19d9a2f0b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.144736 Sep 14 19:52:06.672539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1005/1982] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:06 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:52:07.111245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6bea9180-e6b8-4221-9957-8c45fa59255c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:07.112201 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6bea9180-e6b8-4221-9957-8c45fa59255c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:07.118018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6bea9180-e6b8-4221-9957-8c45fa59255c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:07.118466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6bea9180-e6b8-4221-9957-8c45fa59255c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:07.119232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6bea9180-e6b8-4221-9957-8c45fa59255c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:07.119671 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6bea9180-e6b8-4221-9957-8c45fa59255c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:07.179428 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6bea9180-e6b8-4221-9957-8c45fa59255c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 38196 microversion: 2.1 time: 0.071664 Sep 14 19:52:07.180058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 978/1983] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:07 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 38196 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:07.574375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-24968f4b-8223-441f-8118-cd2d2f9c1c45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:07.575268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-24968f4b-8223-441f-8118-cd2d2f9c1c45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:07.581985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-24968f4b-8223-441f-8118-cd2d2f9c1c45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:07.582430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-24968f4b-8223-441f-8118-cd2d2f9c1c45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:07.583313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-24968f4b-8223-441f-8118-cd2d2f9c1c45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:07.583740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-24968f4b-8223-441f-8118-cd2d2f9c1c45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:07.611944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-24968f4b-8223-441f-8118-cd2d2f9c1c45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041322 Sep 14 19:52:07.612499 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1006/1984] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:07 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:07.690083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0d54743e-a9d6-442a-87e7-e6764d8e2d19 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:07.690768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0d54743e-a9d6-442a-87e7-e6764d8e2d19 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:07.697173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d54743e-a9d6-442a-87e7-e6764d8e2d19 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:07.697653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d54743e-a9d6-442a-87e7-e6764d8e2d19 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:07.698437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d54743e-a9d6-442a-87e7-e6764d8e2d19 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:07.698844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0d54743e-a9d6-442a-87e7-e6764d8e2d19 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:07.818229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0d54743e-a9d6-442a-87e7-e6764d8e2d19 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:07.825437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0d54743e-a9d6-442a-87e7-e6764d8e2d19 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139367 Sep 14 19:52:07.826021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 979/1985] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:07 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:08.191953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7e7015aa-bd3b-4c91-a301-1c538d463534 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:08.192865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7e7015aa-bd3b-4c91-a301-1c538d463534 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:08.198887 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e7015aa-bd3b-4c91-a301-1c538d463534 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:08.199361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e7015aa-bd3b-4c91-a301-1c538d463534 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:08.200101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e7015aa-bd3b-4c91-a301-1c538d463534 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:08.200576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7e7015aa-bd3b-4c91-a301-1c538d463534 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:08.262309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7e7015aa-bd3b-4c91-a301-1c538d463534 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 38196 microversion: 2.1 time: 0.074447 Sep 14 19:52:08.262970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1007/1986] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:08 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 38196 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:08.624311 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-52f01c7b-c53b-4cf8-982b-bba5a68b15de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:08.625172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-52f01c7b-c53b-4cf8-982b-bba5a68b15de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:08.632021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-52f01c7b-c53b-4cf8-982b-bba5a68b15de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:08.632470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-52f01c7b-c53b-4cf8-982b-bba5a68b15de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:08.633264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-52f01c7b-c53b-4cf8-982b-bba5a68b15de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:08.633742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-52f01c7b-c53b-4cf8-982b-bba5a68b15de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:08.663452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-52f01c7b-c53b-4cf8-982b-bba5a68b15de tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042992 Sep 14 19:52:08.663927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 980/1987] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:08 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:08.843370 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b249b133-fe14-4465-a328-e27fa38409c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:08.844070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b249b133-fe14-4465-a328-e27fa38409c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:08.851383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b249b133-fe14-4465-a328-e27fa38409c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:08.851839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b249b133-fe14-4465-a328-e27fa38409c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:08.852620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b249b133-fe14-4465-a328-e27fa38409c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:08.853090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b249b133-fe14-4465-a328-e27fa38409c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:08.972853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b249b133-fe14-4465-a328-e27fa38409c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:08.980080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b249b133-fe14-4465-a328-e27fa38409c0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140737 Sep 14 19:52:08.980674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1008/1988] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:08 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:09.274818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-18f14f07-a3d1-4821-b46d-8013c3249c94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:09.275637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-18f14f07-a3d1-4821-b46d-8013c3249c94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:09.281955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18f14f07-a3d1-4821-b46d-8013c3249c94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:09.282398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18f14f07-a3d1-4821-b46d-8013c3249c94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:09.283178 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18f14f07-a3d1-4821-b46d-8013c3249c94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:09.283613 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-18f14f07-a3d1-4821-b46d-8013c3249c94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:09.362764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-18f14f07-a3d1-4821-b46d-8013c3249c94 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 38262 microversion: 2.1 time: 0.091503 Sep 14 19:52:09.363463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 981/1989] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:09 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 38262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:09.676238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8399a9fa-f176-414c-985c-d780813eb4fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:09.677160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8399a9fa-f176-414c-985c-d780813eb4fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:09.683137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8399a9fa-f176-414c-985c-d780813eb4fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:09.683588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8399a9fa-f176-414c-985c-d780813eb4fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:09.684515 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8399a9fa-f176-414c-985c-d780813eb4fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:09.684969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8399a9fa-f176-414c-985c-d780813eb4fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:09.716009 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8399a9fa-f176-414c-985c-d780813eb4fe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043723 Sep 14 19:52:09.716593 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1009/1990] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:09.998005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fc61a59f-751b-47ef-a6e0-a3a78355db03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:09.998709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fc61a59f-751b-47ef-a6e0-a3a78355db03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:10.006144 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc61a59f-751b-47ef-a6e0-a3a78355db03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:10.006624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc61a59f-751b-47ef-a6e0-a3a78355db03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:10.007431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc61a59f-751b-47ef-a6e0-a3a78355db03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:10.007865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc61a59f-751b-47ef-a6e0-a3a78355db03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:10.131866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fc61a59f-751b-47ef-a6e0-a3a78355db03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:10.139388 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fc61a59f-751b-47ef-a6e0-a3a78355db03 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.145440 Sep 14 19:52:10.139962 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 982/1991] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:09 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:10.373908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9774b0df-1992-4e66-88dd-fa4a5dd473cc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:10.374828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9774b0df-1992-4e66-88dd-fa4a5dd473cc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:10.381098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9774b0df-1992-4e66-88dd-fa4a5dd473cc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:10.381578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9774b0df-1992-4e66-88dd-fa4a5dd473cc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:10.382361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9774b0df-1992-4e66-88dd-fa4a5dd473cc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:10.382797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9774b0df-1992-4e66-88dd-fa4a5dd473cc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:10.453482 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9774b0df-1992-4e66-88dd-fa4a5dd473cc tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action" status: 200 len: 38323 microversion: 2.1 time: 0.083031 Sep 14 19:52:10.454190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1010/1992] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Sep 14 19:52:10 2021] POST /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/action => generated 38323 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:10.465990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5895a16b-27c0-4115-862f-4f918c834c81 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:10.466664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5895a16b-27c0-4115-862f-4f918c834c81 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:10.473093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5895a16b-27c0-4115-862f-4f918c834c81 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:10.473566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5895a16b-27c0-4115-862f-4f918c834c81 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:10.474363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5895a16b-27c0-4115-862f-4f918c834c81 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:10.474794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5895a16b-27c0-4115-862f-4f918c834c81 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:10.507355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5895a16b-27c0-4115-862f-4f918c834c81 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/ips" status: 200 len: 145 microversion: 2.1 time: 0.045085 Sep 14 19:52:10.507945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 983/1993] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Sep 14 19:52:10 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:52:10.728013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-039fd449-ae22-44d6-9d8a-aec25bdd5924 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:10.729062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-039fd449-ae22-44d6-9d8a-aec25bdd5924 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:10.736212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-039fd449-ae22-44d6-9d8a-aec25bdd5924 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:10.736664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-039fd449-ae22-44d6-9d8a-aec25bdd5924 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:10.737459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-039fd449-ae22-44d6-9d8a-aec25bdd5924 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:10.739106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-039fd449-ae22-44d6-9d8a-aec25bdd5924 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:10.771565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-039fd449-ae22-44d6-9d8a-aec25bdd5924 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047620 Sep 14 19:52:10.772309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1011/1994] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:11.156251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cd17dbc4-c842-4e13-8a2f-9510931b631f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:11.156874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cd17dbc4-c842-4e13-8a2f-9510931b631f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:11.163451 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd17dbc4-c842-4e13-8a2f-9510931b631f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:11.163945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd17dbc4-c842-4e13-8a2f-9510931b631f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:11.164678 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd17dbc4-c842-4e13-8a2f-9510931b631f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:11.165111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cd17dbc4-c842-4e13-8a2f-9510931b631f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:11.498350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cd17dbc4-c842-4e13-8a2f-9510931b631f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:11.508864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cd17dbc4-c842-4e13-8a2f-9510931b631f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.356011 Sep 14 19:52:11.509825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 984/1995] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:11 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:11.783712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a1acdaff-0c7f-4921-9834-3b7d4a20246a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:11.784541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a1acdaff-0c7f-4921-9834-3b7d4a20246a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:11.790925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1acdaff-0c7f-4921-9834-3b7d4a20246a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:11.791399 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1acdaff-0c7f-4921-9834-3b7d4a20246a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:11.792164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1acdaff-0c7f-4921-9834-3b7d4a20246a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:11.792602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1acdaff-0c7f-4921-9834-3b7d4a20246a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:11.822944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a1acdaff-0c7f-4921-9834-3b7d4a20246a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043211 Sep 14 19:52:11.823512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1012/1996] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:11 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:12.526780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3a605923-a3d8-4630-b252-5ebe9c772aff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:12.527392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3a605923-a3d8-4630-b252-5ebe9c772aff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:12.533271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a605923-a3d8-4630-b252-5ebe9c772aff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:12.533744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a605923-a3d8-4630-b252-5ebe9c772aff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:12.534573 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a605923-a3d8-4630-b252-5ebe9c772aff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:12.535115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3a605923-a3d8-4630-b252-5ebe9c772aff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:12.655888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3a605923-a3d8-4630-b252-5ebe9c772aff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:12.663476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3a605923-a3d8-4630-b252-5ebe9c772aff tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140754 Sep 14 19:52:12.664139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 985/1997] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:12 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:12.835144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3c16f3f3-62bb-4802-b351-171cd13e0664 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:12.836092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3c16f3f3-62bb-4802-b351-171cd13e0664 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:12.842183 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c16f3f3-62bb-4802-b351-171cd13e0664 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:12.842632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c16f3f3-62bb-4802-b351-171cd13e0664 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:12.843445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c16f3f3-62bb-4802-b351-171cd13e0664 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:12.843885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c16f3f3-62bb-4802-b351-171cd13e0664 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:12.873291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3c16f3f3-62bb-4802-b351-171cd13e0664 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042379 Sep 14 19:52:12.873795 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1013/1998] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:12 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:13.680600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-91a6476c-eef9-4c85-bf5c-73a9943779e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:13.681179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-91a6476c-eef9-4c85-bf5c-73a9943779e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:13.687685 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-91a6476c-eef9-4c85-bf5c-73a9943779e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:13.688029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-91a6476c-eef9-4c85-bf5c-73a9943779e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:13.689189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-91a6476c-eef9-4c85-bf5c-73a9943779e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:13.689313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-91a6476c-eef9-4c85-bf5c-73a9943779e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:13.812684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-91a6476c-eef9-4c85-bf5c-73a9943779e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:13.821151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-91a6476c-eef9-4c85-bf5c-73a9943779e5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.144297 Sep 14 19:52:13.821768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 986/1999] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:13 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:13.885316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3c349762-6f1e-425f-a7dc-04289cccf5dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:13.886283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3c349762-6f1e-425f-a7dc-04289cccf5dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:13.892390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c349762-6f1e-425f-a7dc-04289cccf5dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:13.892839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c349762-6f1e-425f-a7dc-04289cccf5dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:13.894165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c349762-6f1e-425f-a7dc-04289cccf5dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:13.894604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c349762-6f1e-425f-a7dc-04289cccf5dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:13.925147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3c349762-6f1e-425f-a7dc-04289cccf5dd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044127 Sep 14 19:52:13.925726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1014/2000] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:14.838269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-804c30a0-d5e1-4546-929a-e9f4b071aa75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:14.839078 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-804c30a0-d5e1-4546-929a-e9f4b071aa75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:14.844691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-804c30a0-d5e1-4546-929a-e9f4b071aa75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:14.845138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-804c30a0-d5e1-4546-929a-e9f4b071aa75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:14.845945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-804c30a0-d5e1-4546-929a-e9f4b071aa75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:14.846379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-804c30a0-d5e1-4546-929a-e9f4b071aa75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:14.936090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9d1df81a-e79f-403b-9749-cd3a186c369d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:14.937135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9d1df81a-e79f-403b-9749-cd3a186c369d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:14.943909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9d1df81a-e79f-403b-9749-cd3a186c369d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:14.944363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9d1df81a-e79f-403b-9749-cd3a186c369d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:14.945152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9d1df81a-e79f-403b-9749-cd3a186c369d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:14.945623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9d1df81a-e79f-403b-9749-cd3a186c369d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:14.970813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-804c30a0-d5e1-4546-929a-e9f4b071aa75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:14.975663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9d1df81a-e79f-403b-9749-cd3a186c369d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043311 Sep 14 19:52:14.976234 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1015/2001] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:14 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:52:14.978353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-804c30a0-d5e1-4546-929a-e9f4b071aa75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143722 Sep 14 19:52:14.978930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 987/2002] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:14 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:15.987549 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e0814173-c457-40f2-8bcb-a9cccfbcb537 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:15.988454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e0814173-c457-40f2-8bcb-a9cccfbcb537 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:15.994547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0814173-c457-40f2-8bcb-a9cccfbcb537 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:15.994737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f655952a-eb61-4227-9326-183cb18fcc83 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:15.995167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0814173-c457-40f2-8bcb-a9cccfbcb537 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:15.995482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f655952a-eb61-4227-9326-183cb18fcc83 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:15.995932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0814173-c457-40f2-8bcb-a9cccfbcb537 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:15.996379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0814173-c457-40f2-8bcb-a9cccfbcb537 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:16.001295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f655952a-eb61-4227-9326-183cb18fcc83 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:16.001767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f655952a-eb61-4227-9326-183cb18fcc83 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:16.002990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f655952a-eb61-4227-9326-183cb18fcc83 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:16.002990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f655952a-eb61-4227-9326-183cb18fcc83 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:16.027063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e0814173-c457-40f2-8bcb-a9cccfbcb537 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043214 Sep 14 19:52:16.027635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1016/2003] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:15 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:16.130741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f655952a-eb61-4227-9326-183cb18fcc83 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:16.138596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f655952a-eb61-4227-9326-183cb18fcc83 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.147344 Sep 14 19:52:16.139191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 988/2004] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:15 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:17.039296 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-80ac683a-966b-4334-a0e4-4a969a8863a9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:17.040263 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-80ac683a-966b-4334-a0e4-4a969a8863a9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:17.046172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-80ac683a-966b-4334-a0e4-4a969a8863a9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:17.046619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-80ac683a-966b-4334-a0e4-4a969a8863a9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:17.047394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-80ac683a-966b-4334-a0e4-4a969a8863a9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:17.047997 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-80ac683a-966b-4334-a0e4-4a969a8863a9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:17.079967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-80ac683a-966b-4334-a0e4-4a969a8863a9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044107 Sep 14 19:52:17.080961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1017/2005] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:17 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:17.158091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-125a0557-04d6-42cb-b838-94775d7d61e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:17.158633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-125a0557-04d6-42cb-b838-94775d7d61e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:17.164993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-125a0557-04d6-42cb-b838-94775d7d61e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:17.165436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-125a0557-04d6-42cb-b838-94775d7d61e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:17.166249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-125a0557-04d6-42cb-b838-94775d7d61e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:17.166684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-125a0557-04d6-42cb-b838-94775d7d61e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:17.295431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-125a0557-04d6-42cb-b838-94775d7d61e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:17.304194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-125a0557-04d6-42cb-b838-94775d7d61e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.150099 Sep 14 19:52:17.304788 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 989/2006] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:17 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:18.091145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c870a71d-57b8-4d0d-b094-8f33702cdac5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:18.092098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c870a71d-57b8-4d0d-b094-8f33702cdac5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:18.099217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c870a71d-57b8-4d0d-b094-8f33702cdac5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:18.099676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c870a71d-57b8-4d0d-b094-8f33702cdac5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:18.100467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c870a71d-57b8-4d0d-b094-8f33702cdac5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:18.100905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c870a71d-57b8-4d0d-b094-8f33702cdac5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:18.133584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c870a71d-57b8-4d0d-b094-8f33702cdac5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045946 Sep 14 19:52:18.134173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1018/2007] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:18 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:18.322006 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-32994b94-e66c-454b-87e0-e0006687bf73 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:18.322586 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-32994b94-e66c-454b-87e0-e0006687bf73 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:18.329130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32994b94-e66c-454b-87e0-e0006687bf73 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:18.329618 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32994b94-e66c-454b-87e0-e0006687bf73 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:18.330416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32994b94-e66c-454b-87e0-e0006687bf73 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:18.330934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32994b94-e66c-454b-87e0-e0006687bf73 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:18.462262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-32994b94-e66c-454b-87e0-e0006687bf73 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:18.470787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-32994b94-e66c-454b-87e0-e0006687bf73 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.151793 Sep 14 19:52:18.472017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 990/2008] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:18 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:52:19.145743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2f96d485-6e5c-41b2-894c-633e55856c7a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:19.146680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2f96d485-6e5c-41b2-894c-633e55856c7a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:19.152496 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f96d485-6e5c-41b2-894c-633e55856c7a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:19.152942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f96d485-6e5c-41b2-894c-633e55856c7a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:19.153738 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f96d485-6e5c-41b2-894c-633e55856c7a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:19.154185 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f96d485-6e5c-41b2-894c-633e55856c7a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:19.184317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2f96d485-6e5c-41b2-894c-633e55856c7a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042854 Sep 14 19:52:19.184899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1019/2009] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:19.491290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b14c9122-b94d-4baf-9657-1f85bb6818cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:19.492116 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b14c9122-b94d-4baf-9657-1f85bb6818cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:19.497926 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b14c9122-b94d-4baf-9657-1f85bb6818cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:19.498389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b14c9122-b94d-4baf-9657-1f85bb6818cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:19.499205 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b14c9122-b94d-4baf-9657-1f85bb6818cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:19.499630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b14c9122-b94d-4baf-9657-1f85bb6818cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:19.641223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b14c9122-b94d-4baf-9657-1f85bb6818cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:19.648560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b14c9122-b94d-4baf-9657-1f85bb6818cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.161828 Sep 14 19:52:19.649120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 991/2010] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:19 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:20.196979 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2380436e-d609-4e2f-be9c-4a634f119d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:20.198134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2380436e-d609-4e2f-be9c-4a634f119d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:20.204215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2380436e-d609-4e2f-be9c-4a634f119d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:20.204660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2380436e-d609-4e2f-be9c-4a634f119d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:20.205436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2380436e-d609-4e2f-be9c-4a634f119d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:20.206537 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2380436e-d609-4e2f-be9c-4a634f119d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:20.238944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2380436e-d609-4e2f-be9c-4a634f119d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045784 Sep 14 19:52:20.239684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1020/2011] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:20.665799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2f976260-2012-4efd-a030-6626ae395182 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:20.666407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2f976260-2012-4efd-a030-6626ae395182 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:20.672057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f976260-2012-4efd-a030-6626ae395182 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:20.672492 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f976260-2012-4efd-a030-6626ae395182 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:20.673254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f976260-2012-4efd-a030-6626ae395182 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:20.673976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f976260-2012-4efd-a030-6626ae395182 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:20.795503 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2f976260-2012-4efd-a030-6626ae395182 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:20.803264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2f976260-2012-4efd-a030-6626ae395182 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141127 Sep 14 19:52:20.803844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 992/2012] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:20 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:21.251183 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-303cf525-d61d-4a61-b1ec-5afee7af51b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:21.252090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-303cf525-d61d-4a61-b1ec-5afee7af51b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:21.258063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-303cf525-d61d-4a61-b1ec-5afee7af51b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:21.258518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-303cf525-d61d-4a61-b1ec-5afee7af51b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:21.259304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-303cf525-d61d-4a61-b1ec-5afee7af51b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:21.259746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-303cf525-d61d-4a61-b1ec-5afee7af51b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:21.291853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-303cf525-d61d-4a61-b1ec-5afee7af51b6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044443 Sep 14 19:52:21.292424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1021/2013] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:21 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:21.820268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0a105aa9-29db-474b-81b1-424a6c35d65f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:21.820913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0a105aa9-29db-474b-81b1-424a6c35d65f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:21.827245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0a105aa9-29db-474b-81b1-424a6c35d65f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:21.827692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0a105aa9-29db-474b-81b1-424a6c35d65f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:21.828496 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0a105aa9-29db-474b-81b1-424a6c35d65f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:21.828940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0a105aa9-29db-474b-81b1-424a6c35d65f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:21.995165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0a105aa9-29db-474b-81b1-424a6c35d65f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:22.003673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0a105aa9-29db-474b-81b1-424a6c35d65f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.186664 Sep 14 19:52:22.004267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 993/2014] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:21 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:22.304553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-477d6860-055c-4ac4-92c3-7a05635aaf25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:22.305332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-477d6860-055c-4ac4-92c3-7a05635aaf25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:22.311357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-477d6860-055c-4ac4-92c3-7a05635aaf25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:22.311803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-477d6860-055c-4ac4-92c3-7a05635aaf25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:22.312587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-477d6860-055c-4ac4-92c3-7a05635aaf25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:22.313019 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-477d6860-055c-4ac4-92c3-7a05635aaf25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:22.342408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-477d6860-055c-4ac4-92c3-7a05635aaf25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042475 Sep 14 19:52:22.342975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1022/2015] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:22 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:23.022429 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c39faf13-9642-423a-99fc-676cc8f6fa76 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:23.023174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c39faf13-9642-423a-99fc-676cc8f6fa76 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:23.029299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c39faf13-9642-423a-99fc-676cc8f6fa76 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:23.029771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c39faf13-9642-423a-99fc-676cc8f6fa76 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:23.030553 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c39faf13-9642-423a-99fc-676cc8f6fa76 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:23.030981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c39faf13-9642-423a-99fc-676cc8f6fa76 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:23.160442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c39faf13-9642-423a-99fc-676cc8f6fa76 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:23.168029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c39faf13-9642-423a-99fc-676cc8f6fa76 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.150265 Sep 14 19:52:23.168616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 994/2016] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:23 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:23.354470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ca8bc50f-3abb-45e8-a79c-86f62e6b1198 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:23.355379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ca8bc50f-3abb-45e8-a79c-86f62e6b1198 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:23.361319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca8bc50f-3abb-45e8-a79c-86f62e6b1198 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:23.362280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca8bc50f-3abb-45e8-a79c-86f62e6b1198 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:23.363054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca8bc50f-3abb-45e8-a79c-86f62e6b1198 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:23.363479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca8bc50f-3abb-45e8-a79c-86f62e6b1198 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:23.393560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ca8bc50f-3abb-45e8-a79c-86f62e6b1198 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042770 Sep 14 19:52:23.394131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1023/2017] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:24.185392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ecf25e24-1dc6-4827-b375-502d1d95a28e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:24.186169 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ecf25e24-1dc6-4827-b375-502d1d95a28e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:24.192134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecf25e24-1dc6-4827-b375-502d1d95a28e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:24.192578 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecf25e24-1dc6-4827-b375-502d1d95a28e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:24.193361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecf25e24-1dc6-4827-b375-502d1d95a28e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:24.193822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecf25e24-1dc6-4827-b375-502d1d95a28e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:24.329905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ecf25e24-1dc6-4827-b375-502d1d95a28e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:24.343887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ecf25e24-1dc6-4827-b375-502d1d95a28e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.161914 Sep 14 19:52:24.344947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 995/2018] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:24 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:24.405123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f6b90eff-b14a-4566-831b-183b34141cc8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:24.406042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f6b90eff-b14a-4566-831b-183b34141cc8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:24.412909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6b90eff-b14a-4566-831b-183b34141cc8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:24.413349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6b90eff-b14a-4566-831b-183b34141cc8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:24.414169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6b90eff-b14a-4566-831b-183b34141cc8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:24.414602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6b90eff-b14a-4566-831b-183b34141cc8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:24.448330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f6b90eff-b14a-4566-831b-183b34141cc8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046886 Sep 14 19:52:24.448921 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1024/2019] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:25.363479 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6d780aec-b696-4aa6-bc12-9a98d28fdc4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:25.364166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6d780aec-b696-4aa6-bc12-9a98d28fdc4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:25.370486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d780aec-b696-4aa6-bc12-9a98d28fdc4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:25.370939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d780aec-b696-4aa6-bc12-9a98d28fdc4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:25.371725 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d780aec-b696-4aa6-bc12-9a98d28fdc4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:25.372161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d780aec-b696-4aa6-bc12-9a98d28fdc4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:25.464899 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-492a4b1e-41c0-4ade-9847-79b324446639 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:25.466609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-492a4b1e-41c0-4ade-9847-79b324446639 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:25.473674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-492a4b1e-41c0-4ade-9847-79b324446639 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:25.474388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-492a4b1e-41c0-4ade-9847-79b324446639 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:25.475176 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-492a4b1e-41c0-4ade-9847-79b324446639 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:25.475607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-492a4b1e-41c0-4ade-9847-79b324446639 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:25.507331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-492a4b1e-41c0-4ade-9847-79b324446639 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049687 Sep 14 19:52:25.507924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1025/2020] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:25.514135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6d780aec-b696-4aa6-bc12-9a98d28fdc4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:25.522748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6d780aec-b696-4aa6-bc12-9a98d28fdc4e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.162843 Sep 14 19:52:25.523342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 996/2021] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:25 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:26.520441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c1a9bd4c-aa0f-4a5e-a410-ad6e55cdc5ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:26.521353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c1a9bd4c-aa0f-4a5e-a410-ad6e55cdc5ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:26.527797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1a9bd4c-aa0f-4a5e-a410-ad6e55cdc5ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:26.528242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1a9bd4c-aa0f-4a5e-a410-ad6e55cdc5ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:26.529022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1a9bd4c-aa0f-4a5e-a410-ad6e55cdc5ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:26.529458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1a9bd4c-aa0f-4a5e-a410-ad6e55cdc5ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:26.540519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4b79d9b2-1b4c-41ad-80ee-689d1a5622d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:26.541158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4b79d9b2-1b4c-41ad-80ee-689d1a5622d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:26.547470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b79d9b2-1b4c-41ad-80ee-689d1a5622d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:26.547913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b79d9b2-1b4c-41ad-80ee-689d1a5622d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:26.548934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b79d9b2-1b4c-41ad-80ee-689d1a5622d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:26.549406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b79d9b2-1b4c-41ad-80ee-689d1a5622d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:26.561004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c1a9bd4c-aa0f-4a5e-a410-ad6e55cdc5ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044793 Sep 14 19:52:26.561599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1026/2022] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:26.668804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4b79d9b2-1b4c-41ad-80ee-689d1a5622d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:26.676300 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4b79d9b2-1b4c-41ad-80ee-689d1a5622d3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139404 Sep 14 19:52:26.676858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 997/2023] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:26 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:52:27.572669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c8761407-7143-4c8d-ad8f-071107e46d9d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:27.573598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c8761407-7143-4c8d-ad8f-071107e46d9d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:27.580041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8761407-7143-4c8d-ad8f-071107e46d9d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:27.580487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8761407-7143-4c8d-ad8f-071107e46d9d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:27.581300 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8761407-7143-4c8d-ad8f-071107e46d9d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:27.581776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c8761407-7143-4c8d-ad8f-071107e46d9d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:27.614001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c8761407-7143-4c8d-ad8f-071107e46d9d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044958 Sep 14 19:52:27.614585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1027/2024] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:27 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:27.692537 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3897c698-4131-4f06-ba5d-bd4f5ef31784 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:27.693157 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3897c698-4131-4f06-ba5d-bd4f5ef31784 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:27.699183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3897c698-4131-4f06-ba5d-bd4f5ef31784 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:27.699631 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3897c698-4131-4f06-ba5d-bd4f5ef31784 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:27.700409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3897c698-4131-4f06-ba5d-bd4f5ef31784 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:27.700843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3897c698-4131-4f06-ba5d-bd4f5ef31784 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:27.821437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3897c698-4131-4f06-ba5d-bd4f5ef31784 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:27.828872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3897c698-4131-4f06-ba5d-bd4f5ef31784 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139994 Sep 14 19:52:27.829448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 998/2025] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:27 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:28.625715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3bb9fda4-ab77-43b7-b0ea-66cb589ea3ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:28.626608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3bb9fda4-ab77-43b7-b0ea-66cb589ea3ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:28.632954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3bb9fda4-ab77-43b7-b0ea-66cb589ea3ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:28.633406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3bb9fda4-ab77-43b7-b0ea-66cb589ea3ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:28.634191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3bb9fda4-ab77-43b7-b0ea-66cb589ea3ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:28.634620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3bb9fda4-ab77-43b7-b0ea-66cb589ea3ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:28.663725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3bb9fda4-ab77-43b7-b0ea-66cb589ea3ed tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041826 Sep 14 19:52:28.664308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1028/2026] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:28 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:28.846122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-25a23e40-4c37-43e5-aa5b-f17c6d18e5af tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:28.846795 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-25a23e40-4c37-43e5-aa5b-f17c6d18e5af tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:28.852665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25a23e40-4c37-43e5-aa5b-f17c6d18e5af tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:28.853113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25a23e40-4c37-43e5-aa5b-f17c6d18e5af tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:28.853910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25a23e40-4c37-43e5-aa5b-f17c6d18e5af tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:28.854356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-25a23e40-4c37-43e5-aa5b-f17c6d18e5af tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:28.987644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-25a23e40-4c37-43e5-aa5b-f17c6d18e5af tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:28.995403 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-25a23e40-4c37-43e5-aa5b-f17c6d18e5af tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.152924 Sep 14 19:52:28.995967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 999/2027] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:28 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:29.675101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2a562cfd-f2ee-45a1-98a8-c01d625b21f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:29.676038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2a562cfd-f2ee-45a1-98a8-c01d625b21f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:29.682075 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a562cfd-f2ee-45a1-98a8-c01d625b21f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:29.682524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a562cfd-f2ee-45a1-98a8-c01d625b21f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:29.683299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a562cfd-f2ee-45a1-98a8-c01d625b21f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:29.683731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a562cfd-f2ee-45a1-98a8-c01d625b21f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:29.713012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2a562cfd-f2ee-45a1-98a8-c01d625b21f8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042032 Sep 14 19:52:29.713589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1029/2028] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:29 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:30.012255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6eaf4e98-8153-4f58-8b1e-ae5c15746ca9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:30.012933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6eaf4e98-8153-4f58-8b1e-ae5c15746ca9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:30.019633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6eaf4e98-8153-4f58-8b1e-ae5c15746ca9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:30.020084 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6eaf4e98-8153-4f58-8b1e-ae5c15746ca9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:30.020879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6eaf4e98-8153-4f58-8b1e-ae5c15746ca9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:30.021316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6eaf4e98-8153-4f58-8b1e-ae5c15746ca9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:30.155094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6eaf4e98-8153-4f58-8b1e-ae5c15746ca9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:30.162977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6eaf4e98-8153-4f58-8b1e-ae5c15746ca9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.154454 Sep 14 19:52:30.163569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1000/2029] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:30 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:30.724820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-05255cad-0727-48b9-8ed9-dcd58f667b2c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:30.725699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-05255cad-0727-48b9-8ed9-dcd58f667b2c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:30.731500 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-05255cad-0727-48b9-8ed9-dcd58f667b2c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:30.731951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-05255cad-0727-48b9-8ed9-dcd58f667b2c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:30.732707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-05255cad-0727-48b9-8ed9-dcd58f667b2c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:30.733140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-05255cad-0727-48b9-8ed9-dcd58f667b2c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:30.762459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-05255cad-0727-48b9-8ed9-dcd58f667b2c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042125 Sep 14 19:52:30.763006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1030/2030] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:30 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:31.180392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5cea5272-f861-4f3c-9a2c-d2ad03368366 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:31.181093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5cea5272-f861-4f3c-9a2c-d2ad03368366 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:31.187356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cea5272-f861-4f3c-9a2c-d2ad03368366 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:31.187806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cea5272-f861-4f3c-9a2c-d2ad03368366 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:31.188624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cea5272-f861-4f3c-9a2c-d2ad03368366 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:31.189242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5cea5272-f861-4f3c-9a2c-d2ad03368366 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:31.319572 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5cea5272-f861-4f3c-9a2c-d2ad03368366 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:31.327199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5cea5272-f861-4f3c-9a2c-d2ad03368366 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.150598 Sep 14 19:52:31.327773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1001/2031] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:31 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:31.773828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f01e97b3-8c99-452d-8b44-36dd89b60144 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:31.774722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f01e97b3-8c99-452d-8b44-36dd89b60144 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:31.780659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f01e97b3-8c99-452d-8b44-36dd89b60144 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:31.781101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f01e97b3-8c99-452d-8b44-36dd89b60144 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:31.781895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f01e97b3-8c99-452d-8b44-36dd89b60144 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:31.782323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f01e97b3-8c99-452d-8b44-36dd89b60144 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:31.812868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f01e97b3-8c99-452d-8b44-36dd89b60144 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042735 Sep 14 19:52:31.813451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1031/2032] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:31 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:32.347085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-83f85eb6-0de1-48c5-aab9-fd36344a921b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:32.347696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-83f85eb6-0de1-48c5-aab9-fd36344a921b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:32.353836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83f85eb6-0de1-48c5-aab9-fd36344a921b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:32.354287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83f85eb6-0de1-48c5-aab9-fd36344a921b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:32.355060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83f85eb6-0de1-48c5-aab9-fd36344a921b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:32.355525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83f85eb6-0de1-48c5-aab9-fd36344a921b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:32.482641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-83f85eb6-0de1-48c5-aab9-fd36344a921b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:32.490505 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-83f85eb6-0de1-48c5-aab9-fd36344a921b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.147719 Sep 14 19:52:32.491269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1002/2033] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:32 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:32.824053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-393b42e7-79d1-43ec-90ce-5158d1babda2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:32.824958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-393b42e7-79d1-43ec-90ce-5158d1babda2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:32.831604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-393b42e7-79d1-43ec-90ce-5158d1babda2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:32.832048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-393b42e7-79d1-43ec-90ce-5158d1babda2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:32.832849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-393b42e7-79d1-43ec-90ce-5158d1babda2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:32.833281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-393b42e7-79d1-43ec-90ce-5158d1babda2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:32.861937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-393b42e7-79d1-43ec-90ce-5158d1babda2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041646 Sep 14 19:52:32.862510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1032/2034] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:32 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:33.507485 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-81db1c13-9aa3-47f9-9a4c-79db203fe13d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:33.508051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-81db1c13-9aa3-47f9-9a4c-79db203fe13d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:33.513830 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81db1c13-9aa3-47f9-9a4c-79db203fe13d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:33.514284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81db1c13-9aa3-47f9-9a4c-79db203fe13d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:33.515047 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81db1c13-9aa3-47f9-9a4c-79db203fe13d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:33.515478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81db1c13-9aa3-47f9-9a4c-79db203fe13d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:33.639819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-81db1c13-9aa3-47f9-9a4c-79db203fe13d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:33.647442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-81db1c13-9aa3-47f9-9a4c-79db203fe13d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143742 Sep 14 19:52:33.648013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1003/2035] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:33 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:33.873667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-adbdeaa4-8d10-4213-835d-9bc3308c194a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:33.874583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-adbdeaa4-8d10-4213-835d-9bc3308c194a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:33.880653 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adbdeaa4-8d10-4213-835d-9bc3308c194a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:33.881101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adbdeaa4-8d10-4213-835d-9bc3308c194a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:33.881918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adbdeaa4-8d10-4213-835d-9bc3308c194a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:33.882357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adbdeaa4-8d10-4213-835d-9bc3308c194a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:33.912280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-adbdeaa4-8d10-4213-835d-9bc3308c194a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042552 Sep 14 19:52:33.912843 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1033/2036] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:33 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:34.663901 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eb51f97f-4689-4362-9828-d40a571af7f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:34.664543 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eb51f97f-4689-4362-9828-d40a571af7f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:34.670586 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb51f97f-4689-4362-9828-d40a571af7f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:34.671029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb51f97f-4689-4362-9828-d40a571af7f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:34.671815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb51f97f-4689-4362-9828-d40a571af7f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:34.672246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb51f97f-4689-4362-9828-d40a571af7f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:34.792805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eb51f97f-4689-4362-9828-d40a571af7f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:34.801179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eb51f97f-4689-4362-9828-d40a571af7f1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140875 Sep 14 19:52:34.801798 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1004/2037] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:34 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:34.923479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7218eb63-bb6e-4e50-80f9-40193c88d005 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:34.925161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7218eb63-bb6e-4e50-80f9-40193c88d005 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:34.931149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7218eb63-bb6e-4e50-80f9-40193c88d005 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:34.931499 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7218eb63-bb6e-4e50-80f9-40193c88d005 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:34.932282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7218eb63-bb6e-4e50-80f9-40193c88d005 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:34.932719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7218eb63-bb6e-4e50-80f9-40193c88d005 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:34.962031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7218eb63-bb6e-4e50-80f9-40193c88d005 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042280 Sep 14 19:52:34.962589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1034/2038] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:34 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:35.817995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c5c36a0b-b244-4a31-9aa5-5c6ee27ef83f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:35.818606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c5c36a0b-b244-4a31-9aa5-5c6ee27ef83f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:35.824610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5c36a0b-b244-4a31-9aa5-5c6ee27ef83f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:35.825053 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5c36a0b-b244-4a31-9aa5-5c6ee27ef83f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:35.825851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5c36a0b-b244-4a31-9aa5-5c6ee27ef83f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:35.826279 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c5c36a0b-b244-4a31-9aa5-5c6ee27ef83f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:35.949595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c5c36a0b-b244-4a31-9aa5-5c6ee27ef83f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:35.958152 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c5c36a0b-b244-4a31-9aa5-5c6ee27ef83f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.144344 Sep 14 19:52:35.958740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1005/2039] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:35 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:35.973390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4488eda0-52fe-4242-9534-bbb08dae3d83 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:35.974381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4488eda0-52fe-4242-9534-bbb08dae3d83 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:35.980320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4488eda0-52fe-4242-9534-bbb08dae3d83 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:35.980766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4488eda0-52fe-4242-9534-bbb08dae3d83 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:35.981588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4488eda0-52fe-4242-9534-bbb08dae3d83 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:35.982026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4488eda0-52fe-4242-9534-bbb08dae3d83 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:36.011710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4488eda0-52fe-4242-9534-bbb08dae3d83 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042089 Sep 14 19:52:36.012250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1035/2040] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:35 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:36.976070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b58648c8-4698-4fa7-9189-2c8be1d1c547 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:36.976679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b58648c8-4698-4fa7-9189-2c8be1d1c547 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:36.982551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b58648c8-4698-4fa7-9189-2c8be1d1c547 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:36.983004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b58648c8-4698-4fa7-9189-2c8be1d1c547 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:36.983773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b58648c8-4698-4fa7-9189-2c8be1d1c547 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:36.984209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b58648c8-4698-4fa7-9189-2c8be1d1c547 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:37.023582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-45aa25dc-c932-4bd7-9760-9aad520800f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:37.024517 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-45aa25dc-c932-4bd7-9760-9aad520800f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:37.030804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45aa25dc-c932-4bd7-9760-9aad520800f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:37.031255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45aa25dc-c932-4bd7-9760-9aad520800f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:37.032126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45aa25dc-c932-4bd7-9760-9aad520800f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:37.032573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45aa25dc-c932-4bd7-9760-9aad520800f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:37.064011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-45aa25dc-c932-4bd7-9760-9aad520800f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044110 Sep 14 19:52:37.064610 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1036/2041] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:52:37.112123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b58648c8-4698-4fa7-9189-2c8be1d1c547 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:37.119494 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b58648c8-4698-4fa7-9189-2c8be1d1c547 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.147127 Sep 14 19:52:37.120072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1006/2042] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:36 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:38.075400 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-acdddef7-7918-4cf9-80a9-0af9b9c4f365 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:38.076321 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-acdddef7-7918-4cf9-80a9-0af9b9c4f365 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:38.082182 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-acdddef7-7918-4cf9-80a9-0af9b9c4f365 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:38.082632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-acdddef7-7918-4cf9-80a9-0af9b9c4f365 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:38.083410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-acdddef7-7918-4cf9-80a9-0af9b9c4f365 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:38.083841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-acdddef7-7918-4cf9-80a9-0af9b9c4f365 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:38.114582 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-acdddef7-7918-4cf9-80a9-0af9b9c4f365 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042817 Sep 14 19:52:38.115152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1037/2043] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:38 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:38.136587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-16f322d1-e41a-4b6d-b870-e911f1ba0fab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:38.137208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-16f322d1-e41a-4b6d-b870-e911f1ba0fab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:38.143038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16f322d1-e41a-4b6d-b870-e911f1ba0fab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:38.143488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16f322d1-e41a-4b6d-b870-e911f1ba0fab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:38.144257 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16f322d1-e41a-4b6d-b870-e911f1ba0fab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:38.144723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16f322d1-e41a-4b6d-b870-e911f1ba0fab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:38.264686 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16f322d1-e41a-4b6d-b870-e911f1ba0fab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:38.272401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-16f322d1-e41a-4b6d-b870-e911f1ba0fab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.139860 Sep 14 19:52:38.273021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1007/2044] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:38 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:39.139702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-58eed92a-830c-4284-885f-b2284d88200e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:39.140610 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-58eed92a-830c-4284-885f-b2284d88200e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:39.146353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-58eed92a-830c-4284-885f-b2284d88200e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:39.146926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-58eed92a-830c-4284-885f-b2284d88200e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:39.147563 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-58eed92a-830c-4284-885f-b2284d88200e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:39.148183 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-58eed92a-830c-4284-885f-b2284d88200e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:39.177715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-58eed92a-830c-4284-885f-b2284d88200e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042004 Sep 14 19:52:39.178263 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1038/2045] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:39 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:39.288774 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-11f3c84c-e5d3-4925-93fd-8641ab30876b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:39.289376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-11f3c84c-e5d3-4925-93fd-8641ab30876b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:39.295567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11f3c84c-e5d3-4925-93fd-8641ab30876b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:39.296018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11f3c84c-e5d3-4925-93fd-8641ab30876b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:39.296800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11f3c84c-e5d3-4925-93fd-8641ab30876b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:39.297239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11f3c84c-e5d3-4925-93fd-8641ab30876b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:39.422736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-11f3c84c-e5d3-4925-93fd-8641ab30876b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:39.431092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-11f3c84c-e5d3-4925-93fd-8641ab30876b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.146207 Sep 14 19:52:39.431666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1008/2046] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:39 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:40.189061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-aa743044-4cef-4fdd-afcf-3069acd825be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:40.189991 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-aa743044-4cef-4fdd-afcf-3069acd825be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:40.195865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa743044-4cef-4fdd-afcf-3069acd825be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:40.196346 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa743044-4cef-4fdd-afcf-3069acd825be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:40.197155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa743044-4cef-4fdd-afcf-3069acd825be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:40.197626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aa743044-4cef-4fdd-afcf-3069acd825be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:40.229716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-aa743044-4cef-4fdd-afcf-3069acd825be tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044354 Sep 14 19:52:40.230303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1039/2047] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:40.448888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-55179a19-46ba-457e-94b8-0aff40c44fa7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:40.449417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-55179a19-46ba-457e-94b8-0aff40c44fa7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:40.456133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-55179a19-46ba-457e-94b8-0aff40c44fa7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:40.456584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-55179a19-46ba-457e-94b8-0aff40c44fa7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:40.457370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-55179a19-46ba-457e-94b8-0aff40c44fa7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:40.457896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-55179a19-46ba-457e-94b8-0aff40c44fa7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:40.578714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-55179a19-46ba-457e-94b8-0aff40c44fa7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:40.586705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-55179a19-46ba-457e-94b8-0aff40c44fa7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141625 Sep 14 19:52:40.587202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1009/2048] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:40 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:41.241534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e9184b87-09a8-4a60-922d-6cd295f26819 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:41.242463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e9184b87-09a8-4a60-922d-6cd295f26819 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:41.248100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9184b87-09a8-4a60-922d-6cd295f26819 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:41.248544 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9184b87-09a8-4a60-922d-6cd295f26819 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:41.249305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9184b87-09a8-4a60-922d-6cd295f26819 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:41.249757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9184b87-09a8-4a60-922d-6cd295f26819 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:41.279335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e9184b87-09a8-4a60-922d-6cd295f26819 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041445 Sep 14 19:52:41.279910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1040/2049] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:41 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:41.604184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-66439459-885f-4591-bcf0-62b584a86d3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:41.604714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-66439459-885f-4591-bcf0-62b584a86d3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:41.610735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66439459-885f-4591-bcf0-62b584a86d3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:41.611185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66439459-885f-4591-bcf0-62b584a86d3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:41.612018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66439459-885f-4591-bcf0-62b584a86d3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:41.612439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66439459-885f-4591-bcf0-62b584a86d3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:41.733077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-66439459-885f-4591-bcf0-62b584a86d3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:41.740491 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-66439459-885f-4591-bcf0-62b584a86d3c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140116 Sep 14 19:52:41.741074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1010/2050] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:41 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:42.291961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7510c5d3-e66b-472e-b923-ccf1e700f19e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:42.292790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7510c5d3-e66b-472e-b923-ccf1e700f19e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:42.299764 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7510c5d3-e66b-472e-b923-ccf1e700f19e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:42.300263 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7510c5d3-e66b-472e-b923-ccf1e700f19e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:42.301175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7510c5d3-e66b-472e-b923-ccf1e700f19e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:42.301795 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7510c5d3-e66b-472e-b923-ccf1e700f19e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:42.337716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7510c5d3-e66b-472e-b923-ccf1e700f19e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049685 Sep 14 19:52:42.338293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1041/2051] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Sep 14 19:52:42 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:52:42.756799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b0fe3aee-f0ab-40e2-a6b3-b728da576b5e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:42.757393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b0fe3aee-f0ab-40e2-a6b3-b728da576b5e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:42.763666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b0fe3aee-f0ab-40e2-a6b3-b728da576b5e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:42.764139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b0fe3aee-f0ab-40e2-a6b3-b728da576b5e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:42.764901 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b0fe3aee-f0ab-40e2-a6b3-b728da576b5e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:42.765331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b0fe3aee-f0ab-40e2-a6b3-b728da576b5e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:42.896571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b0fe3aee-f0ab-40e2-a6b3-b728da576b5e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:42.904167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b0fe3aee-f0ab-40e2-a6b3-b728da576b5e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.151045 Sep 14 19:52:42.904750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1011/2052] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:42 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:43.349312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-26bb8ed3-a741-4dfe-9146-735ab683d46c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:52:43.350182 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-26bb8ed3-a741-4dfe-9146-735ab683d46c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:43.356609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26bb8ed3-a741-4dfe-9146-735ab683d46c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:43.357052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26bb8ed3-a741-4dfe-9146-735ab683d46c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:43.357860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26bb8ed3-a741-4dfe-9146-735ab683d46c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:43.358287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26bb8ed3-a741-4dfe-9146-735ab683d46c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:43.435456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-26bb8ed3-a741-4dfe-9146-735ab683d46c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action" status: 200 len: 38543 microversion: 2.20 time: 0.090411 Sep 14 19:52:43.436350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1042/2053] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 19:52:43 2021] POST /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34/action => generated 38543 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:52:43.921872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e12a5f67-7d27-47cd-8268-039a9faf6a58 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:43.922445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e12a5f67-7d27-47cd-8268-039a9faf6a58 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:43.930027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e12a5f67-7d27-47cd-8268-039a9faf6a58 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:43.930800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e12a5f67-7d27-47cd-8268-039a9faf6a58 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:43.931465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e12a5f67-7d27-47cd-8268-039a9faf6a58 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:43.931903 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e12a5f67-7d27-47cd-8268-039a9faf6a58 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:44.056714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e12a5f67-7d27-47cd-8268-039a9faf6a58 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:44.064854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e12a5f67-7d27-47cd-8268-039a9faf6a58 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.146234 Sep 14 19:52:44.065419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1012/2054] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:43 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:45.082755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-68874ba1-8f94-4e91-a432-de0b101e774f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:45.083490 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-68874ba1-8f94-4e91-a432-de0b101e774f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:45.090638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68874ba1-8f94-4e91-a432-de0b101e774f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:45.091029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68874ba1-8f94-4e91-a432-de0b101e774f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:45.091817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68874ba1-8f94-4e91-a432-de0b101e774f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:45.092256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68874ba1-8f94-4e91-a432-de0b101e774f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:45.218775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-68874ba1-8f94-4e91-a432-de0b101e774f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:45.226913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-68874ba1-8f94-4e91-a432-de0b101e774f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.148712 Sep 14 19:52:45.237932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1043/2055] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:45 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:46.245203 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e87326fb-1a77-4f13-a20f-bc3500be1a9a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:46.245822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e87326fb-1a77-4f13-a20f-bc3500be1a9a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:46.252064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e87326fb-1a77-4f13-a20f-bc3500be1a9a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:46.252957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e87326fb-1a77-4f13-a20f-bc3500be1a9a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:46.253330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e87326fb-1a77-4f13-a20f-bc3500be1a9a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:46.253795 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e87326fb-1a77-4f13-a20f-bc3500be1a9a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:46.392611 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e87326fb-1a77-4f13-a20f-bc3500be1a9a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:46.400211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e87326fb-1a77-4f13-a20f-bc3500be1a9a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.158716 Sep 14 19:52:46.400794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1013/2056] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:46 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:47.417131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-25e97510-8c55-44de-a4b8-28ba85de05fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:47.417760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-25e97510-8c55-44de-a4b8-28ba85de05fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:47.424622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-25e97510-8c55-44de-a4b8-28ba85de05fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:47.425112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-25e97510-8c55-44de-a4b8-28ba85de05fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:47.425884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-25e97510-8c55-44de-a4b8-28ba85de05fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:47.426320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-25e97510-8c55-44de-a4b8-28ba85de05fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:47.552565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-25e97510-8c55-44de-a4b8-28ba85de05fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:47.559928 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-25e97510-8c55-44de-a4b8-28ba85de05fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.146565 Sep 14 19:52:47.560575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1044/2057] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:47 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:48.577324 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4663ef34-241c-40ec-a810-18816b5fd228 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:48.578016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4663ef34-241c-40ec-a810-18816b5fd228 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:48.585215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4663ef34-241c-40ec-a810-18816b5fd228 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:48.593111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4663ef34-241c-40ec-a810-18816b5fd228 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:48.593111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4663ef34-241c-40ec-a810-18816b5fd228 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:48.593111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4663ef34-241c-40ec-a810-18816b5fd228 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:48.714918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4663ef34-241c-40ec-a810-18816b5fd228 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:48.722442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4663ef34-241c-40ec-a810-18816b5fd228 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.148790 Sep 14 19:52:48.723025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1014/2058] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:48 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:49.741058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-49c04613-00a1-41c9-b530-6abad4609c10 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:49.741058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-49c04613-00a1-41c9-b530-6abad4609c10 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:49.746602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49c04613-00a1-41c9-b530-6abad4609c10 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:49.747061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49c04613-00a1-41c9-b530-6abad4609c10 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:49.747851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49c04613-00a1-41c9-b530-6abad4609c10 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:49.748289 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49c04613-00a1-41c9-b530-6abad4609c10 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:49.871588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-49c04613-00a1-41c9-b530-6abad4609c10 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:49.878867 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-49c04613-00a1-41c9-b530-6abad4609c10 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.143396 Sep 14 19:52:49.879431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1045/2059] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:49 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:50.894844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-11b06e40-8b8e-49ee-a09b-1453ce7bbb06 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:50.895452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-11b06e40-8b8e-49ee-a09b-1453ce7bbb06 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:50.901239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11b06e40-8b8e-49ee-a09b-1453ce7bbb06 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:50.901698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11b06e40-8b8e-49ee-a09b-1453ce7bbb06 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:50.902499 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11b06e40-8b8e-49ee-a09b-1453ce7bbb06 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:50.902934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-11b06e40-8b8e-49ee-a09b-1453ce7bbb06 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:51.021034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-11b06e40-8b8e-49ee-a09b-1453ce7bbb06 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:51.028373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-11b06e40-8b8e-49ee-a09b-1453ce7bbb06 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.137178 Sep 14 19:52:51.028968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1015/2060] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:50 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:52.046065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6417a66f-9441-4e55-a3bb-f42256595268 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:52.046668 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6417a66f-9441-4e55-a3bb-f42256595268 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:52.053481 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6417a66f-9441-4e55-a3bb-f42256595268 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:52.053956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6417a66f-9441-4e55-a3bb-f42256595268 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:52.054742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6417a66f-9441-4e55-a3bb-f42256595268 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:52.055175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6417a66f-9441-4e55-a3bb-f42256595268 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:52.176896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6417a66f-9441-4e55-a3bb-f42256595268 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:52.184361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6417a66f-9441-4e55-a3bb-f42256595268 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.142030 Sep 14 19:52:52.184931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1046/2061] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:52 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:53.202204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c3fb2533-755d-443a-91ac-ace8d27704f8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:53.202747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c3fb2533-755d-443a-91ac-ace8d27704f8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:53.209328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3fb2533-755d-443a-91ac-ace8d27704f8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:53.209960 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3fb2533-755d-443a-91ac-ace8d27704f8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:53.210577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3fb2533-755d-443a-91ac-ace8d27704f8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:53.211008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3fb2533-755d-443a-91ac-ace8d27704f8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:53.331881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c3fb2533-755d-443a-91ac-ace8d27704f8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:53.339189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c3fb2533-755d-443a-91ac-ace8d27704f8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140784 Sep 14 19:52:53.339753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1016/2062] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:53 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:54.356074 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9c749526-7733-42c4-9bd9-c2cf495dfb89 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:54.356618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9c749526-7733-42c4-9bd9-c2cf495dfb89 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:54.363027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c749526-7733-42c4-9bd9-c2cf495dfb89 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:54.363503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c749526-7733-42c4-9bd9-c2cf495dfb89 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:54.364282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c749526-7733-42c4-9bd9-c2cf495dfb89 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:54.364716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9c749526-7733-42c4-9bd9-c2cf495dfb89 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:54.496664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9c749526-7733-42c4-9bd9-c2cf495dfb89 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:54.504663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9c749526-7733-42c4-9bd9-c2cf495dfb89 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.152228 Sep 14 19:52:54.505241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1047/2063] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:54 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:55.522817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-66594ffa-63e9-4b1d-8c4b-cea30a541720 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:55.523442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-66594ffa-63e9-4b1d-8c4b-cea30a541720 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:55.529141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66594ffa-63e9-4b1d-8c4b-cea30a541720 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:55.529677 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66594ffa-63e9-4b1d-8c4b-cea30a541720 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:55.530450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66594ffa-63e9-4b1d-8c4b-cea30a541720 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:55.530884 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-66594ffa-63e9-4b1d-8c4b-cea30a541720 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:55.661666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-66594ffa-63e9-4b1d-8c4b-cea30a541720 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:55.669250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-66594ffa-63e9-4b1d-8c4b-cea30a541720 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.151293 Sep 14 19:52:55.669880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1017/2064] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:55 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:56.686993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fced08a1-e048-467b-a64c-bc5edd13c33c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:56.687602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fced08a1-e048-467b-a64c-bc5edd13c33c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:56.693521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fced08a1-e048-467b-a64c-bc5edd13c33c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:56.693987 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fced08a1-e048-467b-a64c-bc5edd13c33c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:56.694759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fced08a1-e048-467b-a64c-bc5edd13c33c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:56.695191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fced08a1-e048-467b-a64c-bc5edd13c33c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:56.816261 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-fced08a1-e048-467b-a64c-bc5edd13c33c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:56.823427 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fced08a1-e048-467b-a64c-bc5edd13c33c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.140191 Sep 14 19:52:56.823992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1048/2065] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:56 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:57.842512 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d0b9b73a-f0a0-41ea-81ff-beb17761e31f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:57.843126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d0b9b73a-f0a0-41ea-81ff-beb17761e31f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:57.848925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d0b9b73a-f0a0-41ea-81ff-beb17761e31f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:57.849372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d0b9b73a-f0a0-41ea-81ff-beb17761e31f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:57.850178 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d0b9b73a-f0a0-41ea-81ff-beb17761e31f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:57.850617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d0b9b73a-f0a0-41ea-81ff-beb17761e31f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:57.972810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d0b9b73a-f0a0-41ea-81ff-beb17761e31f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:57.980235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d0b9b73a-f0a0-41ea-81ff-beb17761e31f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.141362 Sep 14 19:52:57.980802 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1018/2066] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:57 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:52:58.997552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-33f13f98-3c6b-4ec2-8a1f-9fdcfe6cccc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:52:58.998019 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-33f13f98-3c6b-4ec2-8a1f-9fdcfe6cccc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:52:59.004365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-33f13f98-3c6b-4ec2-8a1f-9fdcfe6cccc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:59.004804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-33f13f98-3c6b-4ec2-8a1f-9fdcfe6cccc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:59.005596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-33f13f98-3c6b-4ec2-8a1f-9fdcfe6cccc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:52:59.006026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-33f13f98-3c6b-4ec2-8a1f-9fdcfe6cccc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:52:59.131381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-33f13f98-3c6b-4ec2-8a1f-9fdcfe6cccc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:52:59.138807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-33f13f98-3c6b-4ec2-8a1f-9fdcfe6cccc2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1562 microversion: 2.1 time: 0.145108 Sep 14 19:52:59.139367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1049/2067] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:52:58 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:00.412979 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-81321602-082c-48ba-8b00-34f57d109c78 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:00.415392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-9d2c75b6-e1be-485e-9e1b-bc3c100accba req-68af3b5e-f52f-401c-966b-b0061b35476c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7745385c-e705-4e0e-8fc7-c96f398b93d9", "tag": "ffccccb6-d608-41f3-af2c-a06ebc5fa625"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:53:00.420241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:53:00.420241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:53:00.421099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-81321602-082c-48ba-8b00-34f57d109c78 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:00.443574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81321602-082c-48ba-8b00-34f57d109c78 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:00.444430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81321602-082c-48ba-8b00-34f57d109c78 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:00.445899 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81321602-082c-48ba-8b00-34f57d109c78 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:00.446690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-81321602-082c-48ba-8b00-34f57d109c78 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:00.452776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-9d2c75b6-e1be-485e-9e1b-bc3c100accba req-68af3b5e-f52f-401c-966b-b0061b35476c service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:00.453480 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-9d2c75b6-e1be-485e-9e1b-bc3c100accba req-68af3b5e-f52f-401c-966b-b0061b35476c service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:00.476007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-9d2c75b6-e1be-485e-9e1b-bc3c100accba req-68af3b5e-f52f-401c-966b-b0061b35476c service nova] Creating event network-changed:ffccccb6-d608-41f3-af2c-a06ebc5fa625 for instance 7745385c-e705-4e0e-8fc7-c96f398b93d9 on hv-cinder-80588 Sep 14 19:53:00.485968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-9d2c75b6-e1be-485e-9e1b-bc3c100accba req-68af3b5e-f52f-401c-966b-b0061b35476c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085256 Sep 14 19:53:00.487879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1050/2068] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:53:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:53:00.492328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-81321602-082c-48ba-8b00-34f57d109c78 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Going to try to terminate instance {{(pid=115679) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 19:53:00.791193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-81321602-082c-48ba-8b00-34f57d109c78 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 204 len: 0 microversion: 2.1 time: 0.392707 Sep 14 19:53:00.795274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1019/2069] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 19:53:00 2021] DELETE /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:53:00.803964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8c38a274-3fe8-4091-a005-f9bf6d44ca75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:00.804673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8c38a274-3fe8-4091-a005-f9bf6d44ca75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:00.811058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c38a274-3fe8-4091-a005-f9bf6d44ca75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:00.811724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c38a274-3fe8-4091-a005-f9bf6d44ca75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:00.812705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c38a274-3fe8-4091-a005-f9bf6d44ca75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:00.813295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8c38a274-3fe8-4091-a005-f9bf6d44ca75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:01.262516 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8c38a274-3fe8-4091-a005-f9bf6d44ca75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:01.271161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8c38a274-3fe8-4091-a005-f9bf6d44ca75 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1568 microversion: 2.1 time: 0.474209 Sep 14 19:53:01.271739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1051/2070] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:00 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1568 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:53:01.863917 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-f8c9f29f-8e35-431d-bdbd-938c1ddef963 req-cde2a49f-1515-488c-8d46-25686bafc6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7745385c-e705-4e0e-8fc7-c96f398b93d9", "name": "network-vif-deleted", "tag": "ffccccb6-d608-41f3-af2c-a06ebc5fa625"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:53:01.865471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:53:01.865471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:53:01.881753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-f8c9f29f-8e35-431d-bdbd-938c1ddef963 req-cde2a49f-1515-488c-8d46-25686bafc6a4 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:01.882354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-f8c9f29f-8e35-431d-bdbd-938c1ddef963 req-cde2a49f-1515-488c-8d46-25686bafc6a4 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:01.896023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-f8c9f29f-8e35-431d-bdbd-938c1ddef963 req-cde2a49f-1515-488c-8d46-25686bafc6a4 service nova] Creating event network-vif-deleted:ffccccb6-d608-41f3-af2c-a06ebc5fa625 for instance 7745385c-e705-4e0e-8fc7-c96f398b93d9 on hv-cinder-80588 Sep 14 19:53:01.901718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-f8c9f29f-8e35-431d-bdbd-938c1ddef963 req-cde2a49f-1515-488c-8d46-25686bafc6a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041835 Sep 14 19:53:01.902742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1020/2071] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:53:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:53:02.287968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9facc881-948b-4847-9356-638b950b5063 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:02.288578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9facc881-948b-4847-9356-638b950b5063 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:02.294506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9facc881-948b-4847-9356-638b950b5063 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:02.294958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9facc881-948b-4847-9356-638b950b5063 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:02.295725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9facc881-948b-4847-9356-638b950b5063 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:02.296166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9facc881-948b-4847-9356-638b950b5063 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:02.355260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9facc881-948b-4847-9356-638b950b5063 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:02.363518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9facc881-948b-4847-9356-638b950b5063 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078736 Sep 14 19:53:02.364087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1052/2072] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:02 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:03.381179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a65d279b-ac16-44db-9566-936d0a708706 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:03.381966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a65d279b-ac16-44db-9566-936d0a708706 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:03.388033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a65d279b-ac16-44db-9566-936d0a708706 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:03.388472 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a65d279b-ac16-44db-9566-936d0a708706 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:03.389241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a65d279b-ac16-44db-9566-936d0a708706 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:03.389707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a65d279b-ac16-44db-9566-936d0a708706 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:03.450131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a65d279b-ac16-44db-9566-936d0a708706 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:03.458182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a65d279b-ac16-44db-9566-936d0a708706 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081459 Sep 14 19:53:03.458749 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1021/2073] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:03 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:04.475465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-308fbf9c-2b28-4cd2-9a08-7b07977f3569 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:04.476080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-308fbf9c-2b28-4cd2-9a08-7b07977f3569 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:04.481969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-308fbf9c-2b28-4cd2-9a08-7b07977f3569 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:04.482417 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-308fbf9c-2b28-4cd2-9a08-7b07977f3569 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:04.483175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-308fbf9c-2b28-4cd2-9a08-7b07977f3569 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:04.483614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-308fbf9c-2b28-4cd2-9a08-7b07977f3569 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:04.548410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-308fbf9c-2b28-4cd2-9a08-7b07977f3569 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:04.556220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-308fbf9c-2b28-4cd2-9a08-7b07977f3569 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.084860 Sep 14 19:53:04.556813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1053/2074] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:04 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:05.572575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-170637c3-ebbc-4600-95f6-a11c620a223a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:05.573188 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-170637c3-ebbc-4600-95f6-a11c620a223a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:05.579127 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-170637c3-ebbc-4600-95f6-a11c620a223a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:05.579579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-170637c3-ebbc-4600-95f6-a11c620a223a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:05.580374 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-170637c3-ebbc-4600-95f6-a11c620a223a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:05.580812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-170637c3-ebbc-4600-95f6-a11c620a223a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:05.640232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-170637c3-ebbc-4600-95f6-a11c620a223a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:05.648286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-170637c3-ebbc-4600-95f6-a11c620a223a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079397 Sep 14 19:53:05.648852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1022/2075] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:05 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:06.665916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-49d46332-2d8a-456b-bc25-1c5ccfe2d9db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:06.666526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-49d46332-2d8a-456b-bc25-1c5ccfe2d9db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:06.672552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49d46332-2d8a-456b-bc25-1c5ccfe2d9db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:06.673002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49d46332-2d8a-456b-bc25-1c5ccfe2d9db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:06.674040 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49d46332-2d8a-456b-bc25-1c5ccfe2d9db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:06.674488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49d46332-2d8a-456b-bc25-1c5ccfe2d9db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:06.733706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-49d46332-2d8a-456b-bc25-1c5ccfe2d9db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:06.741746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-49d46332-2d8a-456b-bc25-1c5ccfe2d9db tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079439 Sep 14 19:53:06.742306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1054/2076] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:06 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:07.759252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2016b6a6-1060-4818-89ac-6f374be22c3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:07.759863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2016b6a6-1060-4818-89ac-6f374be22c3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:07.765983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2016b6a6-1060-4818-89ac-6f374be22c3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:07.766439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2016b6a6-1060-4818-89ac-6f374be22c3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:07.767214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2016b6a6-1060-4818-89ac-6f374be22c3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:07.767648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2016b6a6-1060-4818-89ac-6f374be22c3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:07.836229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2016b6a6-1060-4818-89ac-6f374be22c3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:07.843909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2016b6a6-1060-4818-89ac-6f374be22c3f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.089114 Sep 14 19:53:07.844481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1023/2077] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:07 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:08.861161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ae8c3e40-d7d8-48eb-af44-36c5005a2b7f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:08.861816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ae8c3e40-d7d8-48eb-af44-36c5005a2b7f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:08.867915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae8c3e40-d7d8-48eb-af44-36c5005a2b7f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:08.868363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae8c3e40-d7d8-48eb-af44-36c5005a2b7f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:08.869146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae8c3e40-d7d8-48eb-af44-36c5005a2b7f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:08.869613 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae8c3e40-d7d8-48eb-af44-36c5005a2b7f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:08.930871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ae8c3e40-d7d8-48eb-af44-36c5005a2b7f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:08.938355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ae8c3e40-d7d8-48eb-af44-36c5005a2b7f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080841 Sep 14 19:53:08.938939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1055/2078] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:08 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:09.956652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-faa8f0a4-4d7b-4d5e-9df6-045cd6808e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:09.957262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-faa8f0a4-4d7b-4d5e-9df6-045cd6808e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:09.963162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faa8f0a4-4d7b-4d5e-9df6-045cd6808e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:09.963598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faa8f0a4-4d7b-4d5e-9df6-045cd6808e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:09.964361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faa8f0a4-4d7b-4d5e-9df6-045cd6808e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:09.964784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-faa8f0a4-4d7b-4d5e-9df6-045cd6808e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:10.026288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-faa8f0a4-4d7b-4d5e-9df6-045cd6808e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:10.033651 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-faa8f0a4-4d7b-4d5e-9df6-045cd6808e42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080677 Sep 14 19:53:10.034216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1024/2079] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:09 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:11.050395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-88f36bc9-649d-4913-8ff3-1358f7e0e9a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:11.051000 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-88f36bc9-649d-4913-8ff3-1358f7e0e9a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:11.056819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88f36bc9-649d-4913-8ff3-1358f7e0e9a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:11.057265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88f36bc9-649d-4913-8ff3-1358f7e0e9a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:11.058057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88f36bc9-649d-4913-8ff3-1358f7e0e9a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:11.058489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-88f36bc9-649d-4913-8ff3-1358f7e0e9a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:11.117772 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-88f36bc9-649d-4913-8ff3-1358f7e0e9a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:11.125140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-88f36bc9-649d-4913-8ff3-1358f7e0e9a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078695 Sep 14 19:53:11.125733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1056/2080] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:11 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:12.143117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-934bd198-749f-417c-b5c1-fcce4584db1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:12.143723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-934bd198-749f-417c-b5c1-fcce4584db1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:12.150255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-934bd198-749f-417c-b5c1-fcce4584db1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:12.150692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-934bd198-749f-417c-b5c1-fcce4584db1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:12.151459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-934bd198-749f-417c-b5c1-fcce4584db1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:12.151886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-934bd198-749f-417c-b5c1-fcce4584db1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:12.215063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-934bd198-749f-417c-b5c1-fcce4584db1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:12.222452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-934bd198-749f-417c-b5c1-fcce4584db1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.083016 Sep 14 19:53:12.223019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1025/2081] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:12 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:13.239679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-632621f0-c3de-4379-9b7d-985f65541812 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:13.240969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-632621f0-c3de-4379-9b7d-985f65541812 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:13.247149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-632621f0-c3de-4379-9b7d-985f65541812 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:13.247605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-632621f0-c3de-4379-9b7d-985f65541812 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:13.248394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-632621f0-c3de-4379-9b7d-985f65541812 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:13.248831 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-632621f0-c3de-4379-9b7d-985f65541812 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:13.314967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-632621f0-c3de-4379-9b7d-985f65541812 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:13.322521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-632621f0-c3de-4379-9b7d-985f65541812 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.086589 Sep 14 19:53:13.323089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1057/2082] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:13 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:14.339146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-adf4511d-530a-4357-9682-1e964a5e4ae0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:14.339782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-adf4511d-530a-4357-9682-1e964a5e4ae0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:14.345750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-adf4511d-530a-4357-9682-1e964a5e4ae0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:14.346201 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-adf4511d-530a-4357-9682-1e964a5e4ae0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:14.347000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-adf4511d-530a-4357-9682-1e964a5e4ae0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:14.347434 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-adf4511d-530a-4357-9682-1e964a5e4ae0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:14.408094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-adf4511d-530a-4357-9682-1e964a5e4ae0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:14.415490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-adf4511d-530a-4357-9682-1e964a5e4ae0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080049 Sep 14 19:53:14.416059 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1026/2083] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:14 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:15.433783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6624a0ff-7ce6-4f11-b157-442c0f6fa403 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:15.434376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6624a0ff-7ce6-4f11-b157-442c0f6fa403 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:15.440293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6624a0ff-7ce6-4f11-b157-442c0f6fa403 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:15.440744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6624a0ff-7ce6-4f11-b157-442c0f6fa403 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:15.441556 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6624a0ff-7ce6-4f11-b157-442c0f6fa403 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:15.441998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6624a0ff-7ce6-4f11-b157-442c0f6fa403 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:15.501603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6624a0ff-7ce6-4f11-b157-442c0f6fa403 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:15.509698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6624a0ff-7ce6-4f11-b157-442c0f6fa403 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079718 Sep 14 19:53:15.510285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1058/2084] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:15 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:16.526874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-15cf4e53-50b2-43af-b8ee-3e16d8a27d0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:16.527476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-15cf4e53-50b2-43af-b8ee-3e16d8a27d0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:16.533735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15cf4e53-50b2-43af-b8ee-3e16d8a27d0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:16.534184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15cf4e53-50b2-43af-b8ee-3e16d8a27d0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:16.534964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15cf4e53-50b2-43af-b8ee-3e16d8a27d0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:16.535397 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15cf4e53-50b2-43af-b8ee-3e16d8a27d0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:16.595371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-15cf4e53-50b2-43af-b8ee-3e16d8a27d0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:16.603495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-15cf4e53-50b2-43af-b8ee-3e16d8a27d0e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080275 Sep 14 19:53:16.604076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1027/2085] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:16 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:17.620560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9acfd9ae-bb78-4c0d-9fba-787ca958807a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:17.621197 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9acfd9ae-bb78-4c0d-9fba-787ca958807a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:17.627327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9acfd9ae-bb78-4c0d-9fba-787ca958807a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:17.627778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9acfd9ae-bb78-4c0d-9fba-787ca958807a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:17.628564 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9acfd9ae-bb78-4c0d-9fba-787ca958807a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:17.629001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9acfd9ae-bb78-4c0d-9fba-787ca958807a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:17.692011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9acfd9ae-bb78-4c0d-9fba-787ca958807a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:17.699813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9acfd9ae-bb78-4c0d-9fba-787ca958807a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.082856 Sep 14 19:53:17.700395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1059/2086] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:17 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:18.716052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4fd9bfbe-d2df-4069-b4bb-4ea38dc21d99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:18.716645 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4fd9bfbe-d2df-4069-b4bb-4ea38dc21d99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:18.722650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfbe-d2df-4069-b4bb-4ea38dc21d99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:18.723136 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfbe-d2df-4069-b4bb-4ea38dc21d99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:18.723947 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfbe-d2df-4069-b4bb-4ea38dc21d99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:18.724401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fd9bfbe-d2df-4069-b4bb-4ea38dc21d99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:18.783789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4fd9bfbe-d2df-4069-b4bb-4ea38dc21d99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:18.791106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4fd9bfbe-d2df-4069-b4bb-4ea38dc21d99 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078758 Sep 14 19:53:18.791879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1028/2087] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:18 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:53:19.807973 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e8e885ac-2519-42ac-8e88-9a73a8eae282 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:19.808588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e8e885ac-2519-42ac-8e88-9a73a8eae282 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:19.814931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8e885ac-2519-42ac-8e88-9a73a8eae282 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:19.815477 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8e885ac-2519-42ac-8e88-9a73a8eae282 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:19.816176 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8e885ac-2519-42ac-8e88-9a73a8eae282 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:19.816614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8e885ac-2519-42ac-8e88-9a73a8eae282 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:19.876443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e8e885ac-2519-42ac-8e88-9a73a8eae282 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:19.883830 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e8e885ac-2519-42ac-8e88-9a73a8eae282 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079492 Sep 14 19:53:19.884389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1060/2088] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:19 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:20.900466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b0ba6962-18d2-4433-aa03-57388c6d5081 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:20.901074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b0ba6962-18d2-4433-aa03-57388c6d5081 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:20.907020 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b0ba6962-18d2-4433-aa03-57388c6d5081 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:20.907468 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b0ba6962-18d2-4433-aa03-57388c6d5081 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:20.908253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b0ba6962-18d2-4433-aa03-57388c6d5081 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:20.908692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b0ba6962-18d2-4433-aa03-57388c6d5081 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:20.967621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b0ba6962-18d2-4433-aa03-57388c6d5081 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:20.975383 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b0ba6962-18d2-4433-aa03-57388c6d5081 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078785 Sep 14 19:53:20.975938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1029/2089] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:20 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:21.991934 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e28d25c6-5a6e-4274-81f3-7602b6de6ae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:21.992532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e28d25c6-5a6e-4274-81f3-7602b6de6ae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:21.998465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e28d25c6-5a6e-4274-81f3-7602b6de6ae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:21.998906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e28d25c6-5a6e-4274-81f3-7602b6de6ae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:21.999664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e28d25c6-5a6e-4274-81f3-7602b6de6ae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:22.000091 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e28d25c6-5a6e-4274-81f3-7602b6de6ae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:22.060053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e28d25c6-5a6e-4274-81f3-7602b6de6ae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:22.067424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e28d25c6-5a6e-4274-81f3-7602b6de6ae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079669 Sep 14 19:53:22.068610 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1061/2090] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:21 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:23.085091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-239ef70b-8f44-4202-826f-2c626ac34013 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:23.085772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-239ef70b-8f44-4202-826f-2c626ac34013 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:23.091633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-239ef70b-8f44-4202-826f-2c626ac34013 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:23.092007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-239ef70b-8f44-4202-826f-2c626ac34013 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:23.092772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-239ef70b-8f44-4202-826f-2c626ac34013 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:23.093199 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-239ef70b-8f44-4202-826f-2c626ac34013 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:23.164779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-239ef70b-8f44-4202-826f-2c626ac34013 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:23.172191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-239ef70b-8f44-4202-826f-2c626ac34013 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.091305 Sep 14 19:53:23.172765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1030/2091] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:23 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:24.189415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c4453ec0-d987-495c-add9-b8aa84a7362b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:24.190057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c4453ec0-d987-495c-add9-b8aa84a7362b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:24.196177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4453ec0-d987-495c-add9-b8aa84a7362b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:24.196626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4453ec0-d987-495c-add9-b8aa84a7362b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:24.197431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4453ec0-d987-495c-add9-b8aa84a7362b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:24.197904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4453ec0-d987-495c-add9-b8aa84a7362b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:24.257786 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c4453ec0-d987-495c-add9-b8aa84a7362b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:24.265601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c4453ec0-d987-495c-add9-b8aa84a7362b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079878 Sep 14 19:53:24.266178 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1062/2092] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:24 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:24.627419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:53:24.627656 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 19:53:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:53:25.283178 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-441b014f-323f-454c-8146-f1d6a4c05ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:25.283811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-441b014f-323f-454c-8146-f1d6a4c05ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:25.290079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-441b014f-323f-454c-8146-f1d6a4c05ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:25.290520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-441b014f-323f-454c-8146-f1d6a4c05ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:25.291288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-441b014f-323f-454c-8146-f1d6a4c05ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:25.291707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-441b014f-323f-454c-8146-f1d6a4c05ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:25.352804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-441b014f-323f-454c-8146-f1d6a4c05ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:25.360069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-441b014f-323f-454c-8146-f1d6a4c05ab9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080558 Sep 14 19:53:25.360633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1031/2093] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:25 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:26.377520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-44f89d8f-b53c-4f5d-8edb-6b14bcbaa950 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:26.378144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-44f89d8f-b53c-4f5d-8edb-6b14bcbaa950 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:26.384745 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-44f89d8f-b53c-4f5d-8edb-6b14bcbaa950 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:26.385191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-44f89d8f-b53c-4f5d-8edb-6b14bcbaa950 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:26.385991 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-44f89d8f-b53c-4f5d-8edb-6b14bcbaa950 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:26.386478 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-44f89d8f-b53c-4f5d-8edb-6b14bcbaa950 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:26.446705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-44f89d8f-b53c-4f5d-8edb-6b14bcbaa950 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:26.454179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-44f89d8f-b53c-4f5d-8edb-6b14bcbaa950 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080441 Sep 14 19:53:26.454732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1063/2094] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:26 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:27.471486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e38040fd-eeea-4fad-8d8e-d54ce13f1aa4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:27.472152 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e38040fd-eeea-4fad-8d8e-d54ce13f1aa4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:27.478028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e38040fd-eeea-4fad-8d8e-d54ce13f1aa4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:27.478475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e38040fd-eeea-4fad-8d8e-d54ce13f1aa4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:27.479245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e38040fd-eeea-4fad-8d8e-d54ce13f1aa4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:27.479681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e38040fd-eeea-4fad-8d8e-d54ce13f1aa4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:27.540290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e38040fd-eeea-4fad-8d8e-d54ce13f1aa4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:27.548038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e38040fd-eeea-4fad-8d8e-d54ce13f1aa4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080157 Sep 14 19:53:27.548609 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1032/2095] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:27 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:28.564107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6cb30793-c498-4dba-b2cb-11b70c2a3a30 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:28.564719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6cb30793-c498-4dba-b2cb-11b70c2a3a30 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:28.570590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cb30793-c498-4dba-b2cb-11b70c2a3a30 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:28.571042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cb30793-c498-4dba-b2cb-11b70c2a3a30 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:28.571809 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cb30793-c498-4dba-b2cb-11b70c2a3a30 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:28.572249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cb30793-c498-4dba-b2cb-11b70c2a3a30 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:28.630194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6cb30793-c498-4dba-b2cb-11b70c2a3a30 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:28.637541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6cb30793-c498-4dba-b2cb-11b70c2a3a30 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.077216 Sep 14 19:53:28.638109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1064/2096] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:28 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:29.654855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-709d225b-00eb-4f6d-91d9-4e3346ce2306 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:29.656132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-709d225b-00eb-4f6d-91d9-4e3346ce2306 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:29.662825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-709d225b-00eb-4f6d-91d9-4e3346ce2306 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:29.663276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-709d225b-00eb-4f6d-91d9-4e3346ce2306 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:29.664085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-709d225b-00eb-4f6d-91d9-4e3346ce2306 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:29.664540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-709d225b-00eb-4f6d-91d9-4e3346ce2306 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:29.724086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-709d225b-00eb-4f6d-91d9-4e3346ce2306 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:29.731631 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-709d225b-00eb-4f6d-91d9-4e3346ce2306 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080748 Sep 14 19:53:29.732445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1033/2097] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:29 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:30.755926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2210c812-7117-4268-8319-7ca22d28ff37 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:30.756536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2210c812-7117-4268-8319-7ca22d28ff37 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:30.762555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2210c812-7117-4268-8319-7ca22d28ff37 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:30.762994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2210c812-7117-4268-8319-7ca22d28ff37 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:30.763760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2210c812-7117-4268-8319-7ca22d28ff37 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:30.764196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2210c812-7117-4268-8319-7ca22d28ff37 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:30.826205 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2210c812-7117-4268-8319-7ca22d28ff37 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:30.833358 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2210c812-7117-4268-8319-7ca22d28ff37 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081789 Sep 14 19:53:30.833943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1065/2098] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:30 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:31.850578 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d3dd6844-1677-4156-87c1-b54bf7d1a635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:31.851177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d3dd6844-1677-4156-87c1-b54bf7d1a635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:31.856981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3dd6844-1677-4156-87c1-b54bf7d1a635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:31.857423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3dd6844-1677-4156-87c1-b54bf7d1a635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:31.858204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3dd6844-1677-4156-87c1-b54bf7d1a635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:31.858627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3dd6844-1677-4156-87c1-b54bf7d1a635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:31.916330 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d3dd6844-1677-4156-87c1-b54bf7d1a635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:31.923643 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d3dd6844-1677-4156-87c1-b54bf7d1a635 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.077338 Sep 14 19:53:31.924462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1034/2099] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:31 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:32.940632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-195aab2e-d218-440b-bda0-97efad3c81ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:32.941243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-195aab2e-d218-440b-bda0-97efad3c81ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:32.947079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-195aab2e-d218-440b-bda0-97efad3c81ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:32.947519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-195aab2e-d218-440b-bda0-97efad3c81ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:32.948268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-195aab2e-d218-440b-bda0-97efad3c81ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:32.948693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-195aab2e-d218-440b-bda0-97efad3c81ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:33.006641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-195aab2e-d218-440b-bda0-97efad3c81ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:33.014740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-195aab2e-d218-440b-bda0-97efad3c81ca tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.076877 Sep 14 19:53:33.014740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1066/2100] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:32 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:34.031438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-103d2783-2c09-4b5f-99c8-4a3cad55dcb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:34.032095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-103d2783-2c09-4b5f-99c8-4a3cad55dcb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:34.037975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-103d2783-2c09-4b5f-99c8-4a3cad55dcb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:34.038423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-103d2783-2c09-4b5f-99c8-4a3cad55dcb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:34.039286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-103d2783-2c09-4b5f-99c8-4a3cad55dcb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:34.039722 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-103d2783-2c09-4b5f-99c8-4a3cad55dcb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:34.099466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-103d2783-2c09-4b5f-99c8-4a3cad55dcb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:34.106747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-103d2783-2c09-4b5f-99c8-4a3cad55dcb9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079153 Sep 14 19:53:34.107299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1035/2101] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:34 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:34.322424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:53:34.322992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 19:53:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:53:35.124150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c7cd49f0-8319-4d1d-8306-d5df6ba57570 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:35.124791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c7cd49f0-8319-4d1d-8306-d5df6ba57570 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:35.130671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7cd49f0-8319-4d1d-8306-d5df6ba57570 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:35.131127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7cd49f0-8319-4d1d-8306-d5df6ba57570 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:35.131900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7cd49f0-8319-4d1d-8306-d5df6ba57570 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:35.132337 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c7cd49f0-8319-4d1d-8306-d5df6ba57570 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:35.192316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c7cd49f0-8319-4d1d-8306-d5df6ba57570 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:35.199774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c7cd49f0-8319-4d1d-8306-d5df6ba57570 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079294 Sep 14 19:53:35.200334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1067/2102] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:35 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:36.217101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-14574bee-b526-4244-974c-8a14e4f8f2df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:36.217747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-14574bee-b526-4244-974c-8a14e4f8f2df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:36.224260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14574bee-b526-4244-974c-8a14e4f8f2df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:36.224704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14574bee-b526-4244-974c-8a14e4f8f2df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:36.225474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14574bee-b526-4244-974c-8a14e4f8f2df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:36.226018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14574bee-b526-4244-974c-8a14e4f8f2df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:36.287963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-14574bee-b526-4244-974c-8a14e4f8f2df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:36.296192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-14574bee-b526-4244-974c-8a14e4f8f2df tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.082904 Sep 14 19:53:36.296797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1036/2103] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:36 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:37.313123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-708ddb77-37cd-424f-a6c9-f2d08e08f914 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:37.313762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-708ddb77-37cd-424f-a6c9-f2d08e08f914 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:37.319770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-708ddb77-37cd-424f-a6c9-f2d08e08f914 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:37.320218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-708ddb77-37cd-424f-a6c9-f2d08e08f914 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:37.320981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-708ddb77-37cd-424f-a6c9-f2d08e08f914 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:37.321416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-708ddb77-37cd-424f-a6c9-f2d08e08f914 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:37.380013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-708ddb77-37cd-424f-a6c9-f2d08e08f914 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:37.387272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-708ddb77-37cd-424f-a6c9-f2d08e08f914 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.077785 Sep 14 19:53:37.387845 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1068/2104] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:37 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:38.466470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-337e3bd0-1ad2-4740-82d7-fb0e636c5b55 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:38.470285 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-337e3bd0-1ad2-4740-82d7-fb0e636c5b55 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:38.472984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-337e3bd0-1ad2-4740-82d7-fb0e636c5b55 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:38.473588 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-337e3bd0-1ad2-4740-82d7-fb0e636c5b55 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:38.474371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-337e3bd0-1ad2-4740-82d7-fb0e636c5b55 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:38.474809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-337e3bd0-1ad2-4740-82d7-fb0e636c5b55 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:38.537329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-337e3bd0-1ad2-4740-82d7-fb0e636c5b55 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:38.544619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-337e3bd0-1ad2-4740-82d7-fb0e636c5b55 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.144388 Sep 14 19:53:38.545179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1037/2105] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:38 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:39.561412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2736acab-ed04-4091-872d-029f3bbe56e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:39.562050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2736acab-ed04-4091-872d-029f3bbe56e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:39.568248 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2736acab-ed04-4091-872d-029f3bbe56e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:39.568689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2736acab-ed04-4091-872d-029f3bbe56e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:39.569449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2736acab-ed04-4091-872d-029f3bbe56e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:39.569911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2736acab-ed04-4091-872d-029f3bbe56e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:39.628507 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2736acab-ed04-4091-872d-029f3bbe56e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:39.636549 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2736acab-ed04-4091-872d-029f3bbe56e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078802 Sep 14 19:53:39.637092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1069/2106] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:39 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:40.653699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2925ec3e-6ab1-4c0e-9a73-de5b18181ec9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:40.654383 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2925ec3e-6ab1-4c0e-9a73-de5b18181ec9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:40.660284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2925ec3e-6ab1-4c0e-9a73-de5b18181ec9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:40.660818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2925ec3e-6ab1-4c0e-9a73-de5b18181ec9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:40.662273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2925ec3e-6ab1-4c0e-9a73-de5b18181ec9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:40.662722 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2925ec3e-6ab1-4c0e-9a73-de5b18181ec9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:40.720681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2925ec3e-6ab1-4c0e-9a73-de5b18181ec9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:40.728697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2925ec3e-6ab1-4c0e-9a73-de5b18181ec9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078637 Sep 14 19:53:40.729265 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1038/2107] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:40 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:41.745269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8ab9970d-5cb0-4554-8e87-67614d204bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:41.745920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8ab9970d-5cb0-4554-8e87-67614d204bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:41.752199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ab9970d-5cb0-4554-8e87-67614d204bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:41.752647 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ab9970d-5cb0-4554-8e87-67614d204bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:41.753449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ab9970d-5cb0-4554-8e87-67614d204bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:41.753922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8ab9970d-5cb0-4554-8e87-67614d204bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:41.818079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8ab9970d-5cb0-4554-8e87-67614d204bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:41.825961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8ab9970d-5cb0-4554-8e87-67614d204bb4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.084181 Sep 14 19:53:41.826555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1070/2108] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:41 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:42.843072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2aa833ec-bbdb-4928-8d1f-6fd1412be636 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:42.843675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2aa833ec-bbdb-4928-8d1f-6fd1412be636 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:42.849454 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2aa833ec-bbdb-4928-8d1f-6fd1412be636 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:42.849919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2aa833ec-bbdb-4928-8d1f-6fd1412be636 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:42.850669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2aa833ec-bbdb-4928-8d1f-6fd1412be636 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:42.851095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2aa833ec-bbdb-4928-8d1f-6fd1412be636 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:42.909386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2aa833ec-bbdb-4928-8d1f-6fd1412be636 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:42.916695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2aa833ec-bbdb-4928-8d1f-6fd1412be636 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.077344 Sep 14 19:53:42.917252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1039/2109] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:42 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:43.934152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-68b3f810-567a-4da9-882e-d476f6da1654 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:43.934905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-68b3f810-567a-4da9-882e-d476f6da1654 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:43.940863 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68b3f810-567a-4da9-882e-d476f6da1654 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:43.941297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68b3f810-567a-4da9-882e-d476f6da1654 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:43.942093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68b3f810-567a-4da9-882e-d476f6da1654 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:43.942527 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68b3f810-567a-4da9-882e-d476f6da1654 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:44.004981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-68b3f810-567a-4da9-882e-d476f6da1654 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:44.012966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-68b3f810-567a-4da9-882e-d476f6da1654 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.082486 Sep 14 19:53:44.013540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1071/2110] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:43 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:45.029601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-97c579c9-c93d-48af-ab51-0416f5eff93f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:45.030187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-97c579c9-c93d-48af-ab51-0416f5eff93f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:45.036223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97c579c9-c93d-48af-ab51-0416f5eff93f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:45.036702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97c579c9-c93d-48af-ab51-0416f5eff93f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:45.037528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97c579c9-c93d-48af-ab51-0416f5eff93f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:45.037967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97c579c9-c93d-48af-ab51-0416f5eff93f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:45.096220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-97c579c9-c93d-48af-ab51-0416f5eff93f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:45.105268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-97c579c9-c93d-48af-ab51-0416f5eff93f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079313 Sep 14 19:53:45.105870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1040/2111] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:45 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:46.123351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0a142ef3-8520-441a-919f-f22f225bd8be tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:46.123960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0a142ef3-8520-441a-919f-f22f225bd8be tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:46.130086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a142ef3-8520-441a-919f-f22f225bd8be tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:46.130527 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a142ef3-8520-441a-919f-f22f225bd8be tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:46.131294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a142ef3-8520-441a-919f-f22f225bd8be tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:46.131729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a142ef3-8520-441a-919f-f22f225bd8be tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:46.192148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0a142ef3-8520-441a-919f-f22f225bd8be tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:46.199654 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0a142ef3-8520-441a-919f-f22f225bd8be tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080262 Sep 14 19:53:46.201748 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1072/2112] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:46 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:47.216272 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fa7189da-5e07-44b8-b0d5-ea98a1da6711 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:47.216883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fa7189da-5e07-44b8-b0d5-ea98a1da6711 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:47.222870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa7189da-5e07-44b8-b0d5-ea98a1da6711 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:47.223319 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa7189da-5e07-44b8-b0d5-ea98a1da6711 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:47.224078 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa7189da-5e07-44b8-b0d5-ea98a1da6711 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:47.224515 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa7189da-5e07-44b8-b0d5-ea98a1da6711 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:47.284173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fa7189da-5e07-44b8-b0d5-ea98a1da6711 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:47.291621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fa7189da-5e07-44b8-b0d5-ea98a1da6711 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078957 Sep 14 19:53:47.292183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1041/2113] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:47 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:48.308457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cfeebbc3-362a-48d0-b9a5-cef26051d9d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:48.309059 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cfeebbc3-362a-48d0-b9a5-cef26051d9d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:48.315424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfeebbc3-362a-48d0-b9a5-cef26051d9d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:48.315874 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfeebbc3-362a-48d0-b9a5-cef26051d9d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:48.316787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfeebbc3-362a-48d0-b9a5-cef26051d9d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:48.317233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cfeebbc3-362a-48d0-b9a5-cef26051d9d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:48.376169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cfeebbc3-362a-48d0-b9a5-cef26051d9d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:48.383804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cfeebbc3-362a-48d0-b9a5-cef26051d9d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079063 Sep 14 19:53:48.384360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1073/2114] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:48 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:49.400956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eb52bb18-339f-4327-9042-0a47b924a0d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:49.401559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eb52bb18-339f-4327-9042-0a47b924a0d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:49.407398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb52bb18-339f-4327-9042-0a47b924a0d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:49.407833 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb52bb18-339f-4327-9042-0a47b924a0d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:49.408593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb52bb18-339f-4327-9042-0a47b924a0d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:49.409022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eb52bb18-339f-4327-9042-0a47b924a0d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:49.468880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eb52bb18-339f-4327-9042-0a47b924a0d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:49.477040 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eb52bb18-339f-4327-9042-0a47b924a0d1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079712 Sep 14 19:53:49.477654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1042/2115] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:49 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:50.493860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-93562111-8a11-4ab9-be33-c6e12d827160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:50.494465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-93562111-8a11-4ab9-be33-c6e12d827160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:50.500235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93562111-8a11-4ab9-be33-c6e12d827160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:50.502430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93562111-8a11-4ab9-be33-c6e12d827160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:50.503209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93562111-8a11-4ab9-be33-c6e12d827160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:50.503662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93562111-8a11-4ab9-be33-c6e12d827160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:50.562696 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-93562111-8a11-4ab9-be33-c6e12d827160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:50.570962 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-93562111-8a11-4ab9-be33-c6e12d827160 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081268 Sep 14 19:53:50.571528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1074/2116] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:50 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:51.587891 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2b2c7e5f-ec9d-4202-a8ce-255af923b576 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:51.588483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2b2c7e5f-ec9d-4202-a8ce-255af923b576 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:51.594321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b2c7e5f-ec9d-4202-a8ce-255af923b576 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:51.594754 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b2c7e5f-ec9d-4202-a8ce-255af923b576 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:51.595514 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b2c7e5f-ec9d-4202-a8ce-255af923b576 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:51.597564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b2c7e5f-ec9d-4202-a8ce-255af923b576 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:51.658182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2b2c7e5f-ec9d-4202-a8ce-255af923b576 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:51.665620 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2b2c7e5f-ec9d-4202-a8ce-255af923b576 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.082082 Sep 14 19:53:51.666196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1043/2117] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:51 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:52.682312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b38de325-aede-4ca5-a1e2-f4b99d815510 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:52.682924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b38de325-aede-4ca5-a1e2-f4b99d815510 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:52.688774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b38de325-aede-4ca5-a1e2-f4b99d815510 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:52.689223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b38de325-aede-4ca5-a1e2-f4b99d815510 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:52.692147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b38de325-aede-4ca5-a1e2-f4b99d815510 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:52.692147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b38de325-aede-4ca5-a1e2-f4b99d815510 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:52.749083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b38de325-aede-4ca5-a1e2-f4b99d815510 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:52.756450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b38de325-aede-4ca5-a1e2-f4b99d815510 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.077872 Sep 14 19:53:52.757054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1075/2118] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:52 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:53.773180 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a2ca8074-c152-4d6e-bb14-019c5ac2c9f0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:53.773810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a2ca8074-c152-4d6e-bb14-019c5ac2c9f0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:53.779691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2ca8074-c152-4d6e-bb14-019c5ac2c9f0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:53.780128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2ca8074-c152-4d6e-bb14-019c5ac2c9f0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:53.780879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2ca8074-c152-4d6e-bb14-019c5ac2c9f0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:53.781301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2ca8074-c152-4d6e-bb14-019c5ac2c9f0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:53.841253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a2ca8074-c152-4d6e-bb14-019c5ac2c9f0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:53.848615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a2ca8074-c152-4d6e-bb14-019c5ac2c9f0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079249 Sep 14 19:53:53.849210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1044/2119] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:53 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:54.866514 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-176d1878-30f2-4bde-8ded-63405dac1361 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:54.867116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-176d1878-30f2-4bde-8ded-63405dac1361 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:54.875016 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-176d1878-30f2-4bde-8ded-63405dac1361 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:54.875462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-176d1878-30f2-4bde-8ded-63405dac1361 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:54.876241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-176d1878-30f2-4bde-8ded-63405dac1361 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:54.876676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-176d1878-30f2-4bde-8ded-63405dac1361 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:54.937454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-176d1878-30f2-4bde-8ded-63405dac1361 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:54.945439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-176d1878-30f2-4bde-8ded-63405dac1361 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.083115 Sep 14 19:53:54.946028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1076/2120] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:54 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:55.962856 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-494139c9-b087-4b00-bbf4-775223254d5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:55.963478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-494139c9-b087-4b00-bbf4-775223254d5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:55.969217 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-494139c9-b087-4b00-bbf4-775223254d5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:55.969690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-494139c9-b087-4b00-bbf4-775223254d5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:55.970445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-494139c9-b087-4b00-bbf4-775223254d5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:55.970871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-494139c9-b087-4b00-bbf4-775223254d5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:56.028927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-494139c9-b087-4b00-bbf4-775223254d5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:56.036344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-494139c9-b087-4b00-bbf4-775223254d5c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.077768 Sep 14 19:53:56.037286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1045/2121] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:55 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:57.053841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5a462e1f-7905-4277-b69d-5fafdd5cde81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:57.054491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5a462e1f-7905-4277-b69d-5fafdd5cde81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:57.060445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a462e1f-7905-4277-b69d-5fafdd5cde81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:57.060932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a462e1f-7905-4277-b69d-5fafdd5cde81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:57.061748 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a462e1f-7905-4277-b69d-5fafdd5cde81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:57.062189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a462e1f-7905-4277-b69d-5fafdd5cde81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:57.127381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5a462e1f-7905-4277-b69d-5fafdd5cde81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:57.139391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5a462e1f-7905-4277-b69d-5fafdd5cde81 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.088844 Sep 14 19:53:57.140428 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1077/2122] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:57 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:58.163548 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b4221974-58d0-47c8-9726-8bd58fa847fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:58.164158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b4221974-58d0-47c8-9726-8bd58fa847fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:58.169905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4221974-58d0-47c8-9726-8bd58fa847fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:58.170351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4221974-58d0-47c8-9726-8bd58fa847fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:58.171111 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4221974-58d0-47c8-9726-8bd58fa847fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:58.171540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b4221974-58d0-47c8-9726-8bd58fa847fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:58.232684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b4221974-58d0-47c8-9726-8bd58fa847fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:58.240032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b4221974-58d0-47c8-9726-8bd58fa847fb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080259 Sep 14 19:53:58.240592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1046/2123] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:58 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:59.256820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-960bbc50-feb3-493f-9151-4d979b5e09fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:59.257450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-960bbc50-feb3-493f-9151-4d979b5e09fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:53:59.263554 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-960bbc50-feb3-493f-9151-4d979b5e09fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:59.264000 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-960bbc50-feb3-493f-9151-4d979b5e09fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:59.264775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-960bbc50-feb3-493f-9151-4d979b5e09fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:53:59.265212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-960bbc50-feb3-493f-9151-4d979b5e09fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:53:59.327153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-960bbc50-feb3-493f-9151-4d979b5e09fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:53:59.335066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-960bbc50-feb3-493f-9151-4d979b5e09fe tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081940 Sep 14 19:53:59.335622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1078/2124] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:53:59 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:00.352132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5ba1f942-7d12-42db-bff3-c18e2662f78c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:00.352767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5ba1f942-7d12-42db-bff3-c18e2662f78c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:00.358758 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ba1f942-7d12-42db-bff3-c18e2662f78c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:00.359198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ba1f942-7d12-42db-bff3-c18e2662f78c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:00.359950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ba1f942-7d12-42db-bff3-c18e2662f78c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:00.360379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5ba1f942-7d12-42db-bff3-c18e2662f78c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:00.419406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5ba1f942-7d12-42db-bff3-c18e2662f78c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:00.429247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5ba1f942-7d12-42db-bff3-c18e2662f78c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081216 Sep 14 19:54:00.429888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1047/2125] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:00 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:01.446771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-93196513-ca74-4758-83b1-4cfd3a1d69b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:01.447404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-93196513-ca74-4758-83b1-4cfd3a1d69b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:01.453513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93196513-ca74-4758-83b1-4cfd3a1d69b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:01.453980 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93196513-ca74-4758-83b1-4cfd3a1d69b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:01.454752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93196513-ca74-4758-83b1-4cfd3a1d69b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:01.455190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93196513-ca74-4758-83b1-4cfd3a1d69b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:01.514723 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-93196513-ca74-4758-83b1-4cfd3a1d69b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:01.521974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-93196513-ca74-4758-83b1-4cfd3a1d69b8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079401 Sep 14 19:54:01.522527 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1079/2126] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:01 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:02.539076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e2399268-ffe0-4ab8-97bb-8d980b23e1cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:02.539779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e2399268-ffe0-4ab8-97bb-8d980b23e1cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:02.546764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e2399268-ffe0-4ab8-97bb-8d980b23e1cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:02.547255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e2399268-ffe0-4ab8-97bb-8d980b23e1cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:02.548013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e2399268-ffe0-4ab8-97bb-8d980b23e1cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:02.548787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e2399268-ffe0-4ab8-97bb-8d980b23e1cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:02.639978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e2399268-ffe0-4ab8-97bb-8d980b23e1cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:02.648285 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e2399268-ffe0-4ab8-97bb-8d980b23e1cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.113389 Sep 14 19:54:02.648980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1048/2127] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:02 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:03.667966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cf3028dc-9ed9-4a2b-8894-21317420442d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:03.668698 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cf3028dc-9ed9-4a2b-8894-21317420442d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:03.675078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cf3028dc-9ed9-4a2b-8894-21317420442d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:03.675530 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cf3028dc-9ed9-4a2b-8894-21317420442d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:03.676308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cf3028dc-9ed9-4a2b-8894-21317420442d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:03.676743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cf3028dc-9ed9-4a2b-8894-21317420442d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:03.737759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cf3028dc-9ed9-4a2b-8894-21317420442d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:03.745177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cf3028dc-9ed9-4a2b-8894-21317420442d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.083831 Sep 14 19:54:03.745783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1080/2128] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:03 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:04.762313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-56e973a7-9894-4213-8030-81f1085a3c32 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:04.762930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-56e973a7-9894-4213-8030-81f1085a3c32 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:04.769051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-56e973a7-9894-4213-8030-81f1085a3c32 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:04.769520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-56e973a7-9894-4213-8030-81f1085a3c32 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:04.770306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-56e973a7-9894-4213-8030-81f1085a3c32 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:04.770753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-56e973a7-9894-4213-8030-81f1085a3c32 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:04.837711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-56e973a7-9894-4213-8030-81f1085a3c32 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:04.845490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-56e973a7-9894-4213-8030-81f1085a3c32 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.086759 Sep 14 19:54:04.846061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1049/2129] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:04 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:05.862006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-79489128-efc4-4792-8b73-1a1449c24fb2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:05.862607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-79489128-efc4-4792-8b73-1a1449c24fb2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:05.868483 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79489128-efc4-4792-8b73-1a1449c24fb2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:05.868922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79489128-efc4-4792-8b73-1a1449c24fb2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:05.869702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79489128-efc4-4792-8b73-1a1449c24fb2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:05.870131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-79489128-efc4-4792-8b73-1a1449c24fb2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:05.930664 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-79489128-efc4-4792-8b73-1a1449c24fb2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:05.938197 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-79489128-efc4-4792-8b73-1a1449c24fb2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079834 Sep 14 19:54:05.938744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1081/2130] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:05 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:54:06.955766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2886bb7b-a352-4222-b37d-7be9fadb3a70 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:06.956348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2886bb7b-a352-4222-b37d-7be9fadb3a70 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:06.963085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2886bb7b-a352-4222-b37d-7be9fadb3a70 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:06.963538 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2886bb7b-a352-4222-b37d-7be9fadb3a70 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:06.964318 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2886bb7b-a352-4222-b37d-7be9fadb3a70 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:06.964754 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2886bb7b-a352-4222-b37d-7be9fadb3a70 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:07.034513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2886bb7b-a352-4222-b37d-7be9fadb3a70 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:07.044814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2886bb7b-a352-4222-b37d-7be9fadb3a70 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.092435 Sep 14 19:54:07.045720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1050/2131] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:06 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:08.062595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9b0d4fb2-832e-47a8-ba2e-0bb5f4e91f66 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:08.063227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9b0d4fb2-832e-47a8-ba2e-0bb5f4e91f66 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:08.069256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b0d4fb2-832e-47a8-ba2e-0bb5f4e91f66 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:08.069743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b0d4fb2-832e-47a8-ba2e-0bb5f4e91f66 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:08.070517 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b0d4fb2-832e-47a8-ba2e-0bb5f4e91f66 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:08.070954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b0d4fb2-832e-47a8-ba2e-0bb5f4e91f66 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:08.131085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9b0d4fb2-832e-47a8-ba2e-0bb5f4e91f66 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:08.138574 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9b0d4fb2-832e-47a8-ba2e-0bb5f4e91f66 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079623 Sep 14 19:54:08.139176 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1082/2132] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:08 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:09.155452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-39da392e-a8a4-4a24-9743-eb4e9d440979 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:09.156058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-39da392e-a8a4-4a24-9743-eb4e9d440979 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:09.161969 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-39da392e-a8a4-4a24-9743-eb4e9d440979 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:09.162420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-39da392e-a8a4-4a24-9743-eb4e9d440979 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:09.163196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-39da392e-a8a4-4a24-9743-eb4e9d440979 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:09.163628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-39da392e-a8a4-4a24-9743-eb4e9d440979 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:09.222802 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-39da392e-a8a4-4a24-9743-eb4e9d440979 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:09.230248 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-39da392e-a8a4-4a24-9743-eb4e9d440979 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078419 Sep 14 19:54:09.230823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1051/2133] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:09 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:10.246962 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6e68f3e6-0724-471b-af58-788347b3cd3d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:10.247555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6e68f3e6-0724-471b-af58-788347b3cd3d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:10.253601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6e68f3e6-0724-471b-af58-788347b3cd3d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:10.254052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6e68f3e6-0724-471b-af58-788347b3cd3d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:10.254824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6e68f3e6-0724-471b-af58-788347b3cd3d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:10.255788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6e68f3e6-0724-471b-af58-788347b3cd3d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:10.329215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6e68f3e6-0724-471b-af58-788347b3cd3d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:10.337387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6e68f3e6-0724-471b-af58-788347b3cd3d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.094045 Sep 14 19:54:10.337998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1083/2134] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:10 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:11.355490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-624bd5ae-7e71-4dae-984c-4f8fa22d8200 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:11.356033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-624bd5ae-7e71-4dae-984c-4f8fa22d8200 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:11.362337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-624bd5ae-7e71-4dae-984c-4f8fa22d8200 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:11.362791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-624bd5ae-7e71-4dae-984c-4f8fa22d8200 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:11.363563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-624bd5ae-7e71-4dae-984c-4f8fa22d8200 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:11.364007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-624bd5ae-7e71-4dae-984c-4f8fa22d8200 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:11.423066 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-624bd5ae-7e71-4dae-984c-4f8fa22d8200 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:11.430703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-624bd5ae-7e71-4dae-984c-4f8fa22d8200 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079011 Sep 14 19:54:11.431271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1052/2135] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:11 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:12.447382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-39fb2691-3401-4d26-9679-e51f401ebe22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:12.447902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-39fb2691-3401-4d26-9679-e51f401ebe22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:12.454061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-39fb2691-3401-4d26-9679-e51f401ebe22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:12.454514 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-39fb2691-3401-4d26-9679-e51f401ebe22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:12.455293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-39fb2691-3401-4d26-9679-e51f401ebe22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:12.455730 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-39fb2691-3401-4d26-9679-e51f401ebe22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:12.515067 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-39fb2691-3401-4d26-9679-e51f401ebe22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:12.522766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-39fb2691-3401-4d26-9679-e51f401ebe22 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079072 Sep 14 19:54:12.523293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1084/2136] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:12 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:13.539734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-084a2bf1-57cb-4044-b39e-fbaa681c46d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:13.540381 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-084a2bf1-57cb-4044-b39e-fbaa681c46d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:13.546501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-084a2bf1-57cb-4044-b39e-fbaa681c46d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:13.546950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-084a2bf1-57cb-4044-b39e-fbaa681c46d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:13.547759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-084a2bf1-57cb-4044-b39e-fbaa681c46d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:13.548200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-084a2bf1-57cb-4044-b39e-fbaa681c46d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:13.608087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-084a2bf1-57cb-4044-b39e-fbaa681c46d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:13.616021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-084a2bf1-57cb-4044-b39e-fbaa681c46d6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080106 Sep 14 19:54:13.616610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1053/2137] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:13 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:14.632321 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9eaa34d7-be88-499f-9f64-e89255de1ab3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:14.633007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9eaa34d7-be88-499f-9f64-e89255de1ab3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:14.639745 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9eaa34d7-be88-499f-9f64-e89255de1ab3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:14.640249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9eaa34d7-be88-499f-9f64-e89255de1ab3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:14.641217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9eaa34d7-be88-499f-9f64-e89255de1ab3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:14.641705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9eaa34d7-be88-499f-9f64-e89255de1ab3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:14.701838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9eaa34d7-be88-499f-9f64-e89255de1ab3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:14.709184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9eaa34d7-be88-499f-9f64-e89255de1ab3 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080686 Sep 14 19:54:14.709826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1085/2138] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:14 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:15.726778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-12ba9dd6-c864-4c2f-ade7-22a11985a825 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:15.727333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-12ba9dd6-c864-4c2f-ade7-22a11985a825 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:15.733385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12ba9dd6-c864-4c2f-ade7-22a11985a825 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:15.733863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12ba9dd6-c864-4c2f-ade7-22a11985a825 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:15.734640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12ba9dd6-c864-4c2f-ade7-22a11985a825 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:15.735071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-12ba9dd6-c864-4c2f-ade7-22a11985a825 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:15.813193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-12ba9dd6-c864-4c2f-ade7-22a11985a825 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:15.821373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-12ba9dd6-c864-4c2f-ade7-22a11985a825 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.098461 Sep 14 19:54:15.821965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1054/2139] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:15 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:54:16.838791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d6d89ee5-76fd-4db1-8c19-4b9897d14a3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:16.839331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d6d89ee5-76fd-4db1-8c19-4b9897d14a3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:16.845339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6d89ee5-76fd-4db1-8c19-4b9897d14a3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:16.845820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6d89ee5-76fd-4db1-8c19-4b9897d14a3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:16.846597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6d89ee5-76fd-4db1-8c19-4b9897d14a3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:16.847035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6d89ee5-76fd-4db1-8c19-4b9897d14a3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:16.905994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d6d89ee5-76fd-4db1-8c19-4b9897d14a3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:16.913416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d6d89ee5-76fd-4db1-8c19-4b9897d14a3a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078442 Sep 14 19:54:16.914015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1086/2140] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:16 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:17.930769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-df956dfc-8c41-4b23-ae45-72df55767d82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:17.931372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-df956dfc-8c41-4b23-ae45-72df55767d82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:17.937163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df956dfc-8c41-4b23-ae45-72df55767d82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:17.937634 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df956dfc-8c41-4b23-ae45-72df55767d82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:17.938384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df956dfc-8c41-4b23-ae45-72df55767d82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:17.938810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df956dfc-8c41-4b23-ae45-72df55767d82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:17.998985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-df956dfc-8c41-4b23-ae45-72df55767d82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:18.006215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-df956dfc-8c41-4b23-ae45-72df55767d82 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079736 Sep 14 19:54:18.006766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1055/2141] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:17 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:19.022551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7b248df2-4439-482f-a675-cfd0b4718aaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:19.023167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7b248df2-4439-482f-a675-cfd0b4718aaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:19.029161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b248df2-4439-482f-a675-cfd0b4718aaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:19.029652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b248df2-4439-482f-a675-cfd0b4718aaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:19.030413 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b248df2-4439-482f-a675-cfd0b4718aaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:19.030849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b248df2-4439-482f-a675-cfd0b4718aaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:19.089798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7b248df2-4439-482f-a675-cfd0b4718aaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:19.096915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7b248df2-4439-482f-a675-cfd0b4718aaa tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078012 Sep 14 19:54:19.097469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1087/2142] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:19 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:20.114390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1a77ba92-6df3-4f64-a39f-15006456389d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:20.114978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1a77ba92-6df3-4f64-a39f-15006456389d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:20.120791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a77ba92-6df3-4f64-a39f-15006456389d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:20.121227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a77ba92-6df3-4f64-a39f-15006456389d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:20.122001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a77ba92-6df3-4f64-a39f-15006456389d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:20.122431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a77ba92-6df3-4f64-a39f-15006456389d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:20.184334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1a77ba92-6df3-4f64-a39f-15006456389d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:20.191834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1a77ba92-6df3-4f64-a39f-15006456389d tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081016 Sep 14 19:54:20.192436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1056/2143] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:20 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:21.209405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ce755b46-1835-4d15-a2e1-f33711b3a600 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:21.210036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ce755b46-1835-4d15-a2e1-f33711b3a600 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:21.215893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce755b46-1835-4d15-a2e1-f33711b3a600 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:21.216367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce755b46-1835-4d15-a2e1-f33711b3a600 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:21.217133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce755b46-1835-4d15-a2e1-f33711b3a600 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:21.217601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ce755b46-1835-4d15-a2e1-f33711b3a600 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:21.277208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ce755b46-1835-4d15-a2e1-f33711b3a600 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:21.286242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ce755b46-1835-4d15-a2e1-f33711b3a600 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080805 Sep 14 19:54:21.287208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1088/2144] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:21 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:22.302735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9ae1c275-2348-4401-958a-27a146ee34e6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:22.303380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9ae1c275-2348-4401-958a-27a146ee34e6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:22.309328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ae1c275-2348-4401-958a-27a146ee34e6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:22.309808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ae1c275-2348-4401-958a-27a146ee34e6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:22.310586 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ae1c275-2348-4401-958a-27a146ee34e6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:22.311023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ae1c275-2348-4401-958a-27a146ee34e6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:22.369101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9ae1c275-2348-4401-958a-27a146ee34e6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:22.376302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9ae1c275-2348-4401-958a-27a146ee34e6 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.077686 Sep 14 19:54:22.376863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1057/2145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:22 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:23.394417 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3aa6b599-cbd4-4535-a76f-c361bbd5fae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:23.395012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3aa6b599-cbd4-4535-a76f-c361bbd5fae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:23.401695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3aa6b599-cbd4-4535-a76f-c361bbd5fae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:23.402148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3aa6b599-cbd4-4535-a76f-c361bbd5fae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:23.402929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3aa6b599-cbd4-4535-a76f-c361bbd5fae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:23.403361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3aa6b599-cbd4-4535-a76f-c361bbd5fae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:23.464465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3aa6b599-cbd4-4535-a76f-c361bbd5fae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:23.471689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3aa6b599-cbd4-4535-a76f-c361bbd5fae1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081000 Sep 14 19:54:23.472252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1089/2146] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:23 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:24.488828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1e965ea9-be13-4dd9-9a9f-22c5712f58ec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:24.489442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1e965ea9-be13-4dd9-9a9f-22c5712f58ec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:24.495569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e965ea9-be13-4dd9-9a9f-22c5712f58ec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:24.496022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e965ea9-be13-4dd9-9a9f-22c5712f58ec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:24.496799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e965ea9-be13-4dd9-9a9f-22c5712f58ec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:24.497235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1e965ea9-be13-4dd9-9a9f-22c5712f58ec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:24.558629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1e965ea9-be13-4dd9-9a9f-22c5712f58ec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:24.566546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1e965ea9-be13-4dd9-9a9f-22c5712f58ec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081340 Sep 14 19:54:24.567328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1058/2147] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:24 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:25.583013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f9ea9715-9d57-4315-a7be-49df402271e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:25.584100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f9ea9715-9d57-4315-a7be-49df402271e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:25.590182 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9ea9715-9d57-4315-a7be-49df402271e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:25.590625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9ea9715-9d57-4315-a7be-49df402271e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:25.591404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9ea9715-9d57-4315-a7be-49df402271e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:25.591841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f9ea9715-9d57-4315-a7be-49df402271e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:25.653134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f9ea9715-9d57-4315-a7be-49df402271e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:25.660691 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f9ea9715-9d57-4315-a7be-49df402271e0 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081322 Sep 14 19:54:25.661354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1090/2148] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:25 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:26.687043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7d3ff0a3-cb12-4f4c-af66-c12dd563b874 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:26.687663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7d3ff0a3-cb12-4f4c-af66-c12dd563b874 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:26.697660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d3ff0a3-cb12-4f4c-af66-c12dd563b874 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:26.697660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d3ff0a3-cb12-4f4c-af66-c12dd563b874 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:26.697660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d3ff0a3-cb12-4f4c-af66-c12dd563b874 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:26.697660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d3ff0a3-cb12-4f4c-af66-c12dd563b874 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:26.756588 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7d3ff0a3-cb12-4f4c-af66-c12dd563b874 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:26.765117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7d3ff0a3-cb12-4f4c-af66-c12dd563b874 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081856 Sep 14 19:54:26.765809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1059/2149] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:26 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:27.782430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-914a122d-43ec-406a-b049-3dcdcb9453a8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:27.783080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-914a122d-43ec-406a-b049-3dcdcb9453a8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:27.789722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-914a122d-43ec-406a-b049-3dcdcb9453a8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:27.790172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-914a122d-43ec-406a-b049-3dcdcb9453a8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:27.790963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-914a122d-43ec-406a-b049-3dcdcb9453a8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:27.791404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-914a122d-43ec-406a-b049-3dcdcb9453a8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:27.852611 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-914a122d-43ec-406a-b049-3dcdcb9453a8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:27.859949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-914a122d-43ec-406a-b049-3dcdcb9453a8 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081240 Sep 14 19:54:27.860508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1091/2150] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:27 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:28.875933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6af5e07c-9955-44e3-aa6e-71acb696b94c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:28.876536 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6af5e07c-9955-44e3-aa6e-71acb696b94c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:28.882759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6af5e07c-9955-44e3-aa6e-71acb696b94c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:28.883191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6af5e07c-9955-44e3-aa6e-71acb696b94c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:28.883950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6af5e07c-9955-44e3-aa6e-71acb696b94c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:28.884376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6af5e07c-9955-44e3-aa6e-71acb696b94c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:28.944407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6af5e07c-9955-44e3-aa6e-71acb696b94c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:28.951793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6af5e07c-9955-44e3-aa6e-71acb696b94c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079488 Sep 14 19:54:28.952515 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1060/2151] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:28 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:29.968159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-58c32c77-091a-4a24-9b10-93b5ebaff8a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:29.968803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-58c32c77-091a-4a24-9b10-93b5ebaff8a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:29.975422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-58c32c77-091a-4a24-9b10-93b5ebaff8a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:29.975670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-58c32c77-091a-4a24-9b10-93b5ebaff8a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:29.976442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-58c32c77-091a-4a24-9b10-93b5ebaff8a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:29.976879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-58c32c77-091a-4a24-9b10-93b5ebaff8a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:30.040330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-58c32c77-091a-4a24-9b10-93b5ebaff8a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:30.049546 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-58c32c77-091a-4a24-9b10-93b5ebaff8a1 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.084857 Sep 14 19:54:30.050324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1092/2152] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:29 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:31.066099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0baadaba-24b0-425f-95aa-d5afd65204cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:31.066716 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0baadaba-24b0-425f-95aa-d5afd65204cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:31.069910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 19:54:31.074290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0baadaba-24b0-425f-95aa-d5afd65204cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:31.074750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0baadaba-24b0-425f-95aa-d5afd65204cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:31.075521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0baadaba-24b0-425f-95aa-d5afd65204cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:31.075959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0baadaba-24b0-425f-95aa-d5afd65204cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:31.148935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0baadaba-24b0-425f-95aa-d5afd65204cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:31.156382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0baadaba-24b0-425f-95aa-d5afd65204cb tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.093843 Sep 14 19:54:31.157033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1061/2153] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:31 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:32.177242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-20bcf706-5f49-4cff-8f03-e942236e9e9c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:32.178408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-20bcf706-5f49-4cff-8f03-e942236e9e9c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:32.184229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-20bcf706-5f49-4cff-8f03-e942236e9e9c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:32.184677 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-20bcf706-5f49-4cff-8f03-e942236e9e9c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:32.185439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-20bcf706-5f49-4cff-8f03-e942236e9e9c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:32.185906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-20bcf706-5f49-4cff-8f03-e942236e9e9c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:32.244741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-20bcf706-5f49-4cff-8f03-e942236e9e9c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:32.251931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-20bcf706-5f49-4cff-8f03-e942236e9e9c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078647 Sep 14 19:54:32.252488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1093/2154] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:32 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:33.269060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d4a3c1f5-98d7-47a9-ab0f-7fa7e0789c49 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:33.269811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d4a3c1f5-98d7-47a9-ab0f-7fa7e0789c49 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:33.287277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4a3c1f5-98d7-47a9-ab0f-7fa7e0789c49 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:33.287724 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4a3c1f5-98d7-47a9-ab0f-7fa7e0789c49 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:33.289177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4a3c1f5-98d7-47a9-ab0f-7fa7e0789c49 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:33.289640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d4a3c1f5-98d7-47a9-ab0f-7fa7e0789c49 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:33.294806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58306. Sep 14 19:54:33.349358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d4a3c1f5-98d7-47a9-ab0f-7fa7e0789c49 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:33.357109 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d4a3c1f5-98d7-47a9-ab0f-7fa7e0789c49 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.091716 Sep 14 19:54:33.357704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1062/2155] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:33 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:54:34.373402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-04e8869c-01a2-4527-9e4a-35184135c9f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:34.374046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-04e8869c-01a2-4527-9e4a-35184135c9f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:34.379814 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04e8869c-01a2-4527-9e4a-35184135c9f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:34.380265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04e8869c-01a2-4527-9e4a-35184135c9f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:34.381105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04e8869c-01a2-4527-9e4a-35184135c9f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:34.381577 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-04e8869c-01a2-4527-9e4a-35184135c9f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:34.440038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-04e8869c-01a2-4527-9e4a-35184135c9f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:34.447241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-04e8869c-01a2-4527-9e4a-35184135c9f7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.077426 Sep 14 19:54:34.447816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1094/2156] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:34 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:35.464010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fa73e1b9-498d-4b14-a149-0eb94fef3c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:35.464547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fa73e1b9-498d-4b14-a149-0eb94fef3c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:35.470350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa73e1b9-498d-4b14-a149-0eb94fef3c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:35.470796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa73e1b9-498d-4b14-a149-0eb94fef3c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:35.471553 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa73e1b9-498d-4b14-a149-0eb94fef3c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:35.471988 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa73e1b9-498d-4b14-a149-0eb94fef3c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:35.529193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fa73e1b9-498d-4b14-a149-0eb94fef3c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:35.536452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fa73e1b9-498d-4b14-a149-0eb94fef3c42 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.076748 Sep 14 19:54:35.537017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1063/2157] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:35 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:36.553488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c6c8b4c3-c943-4b88-a1c0-18f1a1d2c4e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:36.554093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c6c8b4c3-c943-4b88-a1c0-18f1a1d2c4e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:36.559871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6c8b4c3-c943-4b88-a1c0-18f1a1d2c4e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:36.560305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6c8b4c3-c943-4b88-a1c0-18f1a1d2c4e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:36.561052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6c8b4c3-c943-4b88-a1c0-18f1a1d2c4e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:36.561475 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6c8b4c3-c943-4b88-a1c0-18f1a1d2c4e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:36.622876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c6c8b4c3-c943-4b88-a1c0-18f1a1d2c4e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:36.630127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c6c8b4c3-c943-4b88-a1c0-18f1a1d2c4e2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080797 Sep 14 19:54:36.630693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1095/2158] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:36 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:37.646849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-33814fce-7ba4-48ff-91ee-43644fa1f543 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:37.647503 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-33814fce-7ba4-48ff-91ee-43644fa1f543 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:37.653371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33814fce-7ba4-48ff-91ee-43644fa1f543 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:37.653845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33814fce-7ba4-48ff-91ee-43644fa1f543 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:37.654601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33814fce-7ba4-48ff-91ee-43644fa1f543 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:37.655028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-33814fce-7ba4-48ff-91ee-43644fa1f543 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:37.715541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-33814fce-7ba4-48ff-91ee-43644fa1f543 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:37.722870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-33814fce-7ba4-48ff-91ee-43644fa1f543 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079734 Sep 14 19:54:37.723431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1064/2159] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:37 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:38.739614 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bdab3eb1-ce84-4bca-bc71-920ea51bbc57 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:38.740228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bdab3eb1-ce84-4bca-bc71-920ea51bbc57 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:38.746770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bdab3eb1-ce84-4bca-bc71-920ea51bbc57 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:38.747232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bdab3eb1-ce84-4bca-bc71-920ea51bbc57 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:38.748002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bdab3eb1-ce84-4bca-bc71-920ea51bbc57 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:38.748436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bdab3eb1-ce84-4bca-bc71-920ea51bbc57 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:38.809030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bdab3eb1-ce84-4bca-bc71-920ea51bbc57 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:38.816468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bdab3eb1-ce84-4bca-bc71-920ea51bbc57 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080503 Sep 14 19:54:38.817035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1096/2160] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:38 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:39.833969 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e157af20-bdf9-45c5-9111-5c6b1e1da03c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:39.834602 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e157af20-bdf9-45c5-9111-5c6b1e1da03c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:39.841324 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e157af20-bdf9-45c5-9111-5c6b1e1da03c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:39.841804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e157af20-bdf9-45c5-9111-5c6b1e1da03c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:39.842834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e157af20-bdf9-45c5-9111-5c6b1e1da03c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:39.843235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e157af20-bdf9-45c5-9111-5c6b1e1da03c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:39.902641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e157af20-bdf9-45c5-9111-5c6b1e1da03c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:39.910001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e157af20-bdf9-45c5-9111-5c6b1e1da03c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079926 Sep 14 19:54:39.910573 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1065/2161] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:39 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:40.927150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f6c4b461-f0c3-4a89-bf65-7f5581137d28 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:40.927735 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f6c4b461-f0c3-4a89-bf65-7f5581137d28 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:40.934114 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6c4b461-f0c3-4a89-bf65-7f5581137d28 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:40.934561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6c4b461-f0c3-4a89-bf65-7f5581137d28 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:40.935318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6c4b461-f0c3-4a89-bf65-7f5581137d28 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:40.935752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6c4b461-f0c3-4a89-bf65-7f5581137d28 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:40.994617 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f6c4b461-f0c3-4a89-bf65-7f5581137d28 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:41.001903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f6c4b461-f0c3-4a89-bf65-7f5581137d28 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078596 Sep 14 19:54:41.002461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1097/2162] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:40 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:42.019017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-14f9ce32-44bd-4159-bd83-c255264dbd17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:42.019604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-14f9ce32-44bd-4159-bd83-c255264dbd17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:42.026095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14f9ce32-44bd-4159-bd83-c255264dbd17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:42.026534 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14f9ce32-44bd-4159-bd83-c255264dbd17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:42.027347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14f9ce32-44bd-4159-bd83-c255264dbd17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:42.027775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14f9ce32-44bd-4159-bd83-c255264dbd17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:42.086477 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-14f9ce32-44bd-4159-bd83-c255264dbd17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:42.093712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-14f9ce32-44bd-4159-bd83-c255264dbd17 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078225 Sep 14 19:54:42.094217 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1066/2163] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:42 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:43.110354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2b307bc4-eca2-4158-bfbf-e25b171ae9c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:43.110923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2b307bc4-eca2-4158-bfbf-e25b171ae9c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:43.116820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b307bc4-eca2-4158-bfbf-e25b171ae9c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:43.119520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b307bc4-eca2-4158-bfbf-e25b171ae9c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:43.119520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b307bc4-eca2-4158-bfbf-e25b171ae9c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:43.119520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2b307bc4-eca2-4158-bfbf-e25b171ae9c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:43.177756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2b307bc4-eca2-4158-bfbf-e25b171ae9c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:43.185125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2b307bc4-eca2-4158-bfbf-e25b171ae9c2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078573 Sep 14 19:54:43.185719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1098/2164] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:43 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:44.201480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-107df734-c8bf-4069-92f3-dedbc63f5286 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:44.202112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-107df734-c8bf-4069-92f3-dedbc63f5286 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:44.208017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-107df734-c8bf-4069-92f3-dedbc63f5286 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:44.208463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-107df734-c8bf-4069-92f3-dedbc63f5286 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:44.209229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-107df734-c8bf-4069-92f3-dedbc63f5286 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:44.209698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-107df734-c8bf-4069-92f3-dedbc63f5286 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:44.271425 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-107df734-c8bf-4069-92f3-dedbc63f5286 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:44.278888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-107df734-c8bf-4069-92f3-dedbc63f5286 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081053 Sep 14 19:54:44.279446 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1067/2165] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:44 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:45.296811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ac829fc0-47be-440b-b856-fe6d7fc932d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:45.297422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ac829fc0-47be-440b-b856-fe6d7fc932d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:45.303634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac829fc0-47be-440b-b856-fe6d7fc932d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:45.304082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac829fc0-47be-440b-b856-fe6d7fc932d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:45.304882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac829fc0-47be-440b-b856-fe6d7fc932d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:45.305316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac829fc0-47be-440b-b856-fe6d7fc932d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:45.363348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ac829fc0-47be-440b-b856-fe6d7fc932d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:45.371155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ac829fc0-47be-440b-b856-fe6d7fc932d2 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078046 Sep 14 19:54:45.371720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1099/2166] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:45 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:54:46.387190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b107fc5a-e491-4009-9cfd-49615ea3c58a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:46.387763 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b107fc5a-e491-4009-9cfd-49615ea3c58a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:46.393772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b107fc5a-e491-4009-9cfd-49615ea3c58a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:46.394220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b107fc5a-e491-4009-9cfd-49615ea3c58a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:46.394995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b107fc5a-e491-4009-9cfd-49615ea3c58a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:46.395429 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b107fc5a-e491-4009-9cfd-49615ea3c58a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:46.456675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b107fc5a-e491-4009-9cfd-49615ea3c58a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:46.464837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b107fc5a-e491-4009-9cfd-49615ea3c58a tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.081442 Sep 14 19:54:46.465443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1068/2167] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:46 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:47.486460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a1db43c7-2fba-45e8-af02-a68f9c35ad9b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:47.487021 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a1db43c7-2fba-45e8-af02-a68f9c35ad9b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:47.492975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1db43c7-2fba-45e8-af02-a68f9c35ad9b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:47.493430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1db43c7-2fba-45e8-af02-a68f9c35ad9b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:47.494225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1db43c7-2fba-45e8-af02-a68f9c35ad9b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:47.494661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1db43c7-2fba-45e8-af02-a68f9c35ad9b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:47.561808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a1db43c7-2fba-45e8-af02-a68f9c35ad9b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:47.570602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a1db43c7-2fba-45e8-af02-a68f9c35ad9b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.088008 Sep 14 19:54:47.571198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1100/2168] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:47 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:48.588190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0ee2933a-4d1c-403a-aabd-29e496384b1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:48.588749 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0ee2933a-4d1c-403a-aabd-29e496384b1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:48.597177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ee2933a-4d1c-403a-aabd-29e496384b1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:48.597966 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ee2933a-4d1c-403a-aabd-29e496384b1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:48.598807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ee2933a-4d1c-403a-aabd-29e496384b1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:48.599251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0ee2933a-4d1c-403a-aabd-29e496384b1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:48.661481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0ee2933a-4d1c-403a-aabd-29e496384b1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:48.669635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0ee2933a-4d1c-403a-aabd-29e496384b1e tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.086003 Sep 14 19:54:48.670207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1069/2169] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:48 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:54:49.686577 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4ab67802-95e5-4cb1-9f66-7fe820144ab7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:49.687160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4ab67802-95e5-4cb1-9f66-7fe820144ab7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:49.692957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4ab67802-95e5-4cb1-9f66-7fe820144ab7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:49.693396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4ab67802-95e5-4cb1-9f66-7fe820144ab7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:49.694190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4ab67802-95e5-4cb1-9f66-7fe820144ab7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:49.694619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4ab67802-95e5-4cb1-9f66-7fe820144ab7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:49.758270 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4ab67802-95e5-4cb1-9f66-7fe820144ab7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:49.765916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4ab67802-95e5-4cb1-9f66-7fe820144ab7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.082901 Sep 14 19:54:49.766480 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1101/2170] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:49 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:50.782791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6afe6fe9-2766-4d7f-ae1e-73af1a5ffbc4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:50.783382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6afe6fe9-2766-4d7f-ae1e-73af1a5ffbc4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:50.789441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6afe6fe9-2766-4d7f-ae1e-73af1a5ffbc4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:50.789923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6afe6fe9-2766-4d7f-ae1e-73af1a5ffbc4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:50.790699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6afe6fe9-2766-4d7f-ae1e-73af1a5ffbc4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:50.791138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6afe6fe9-2766-4d7f-ae1e-73af1a5ffbc4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:50.851530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6afe6fe9-2766-4d7f-ae1e-73af1a5ffbc4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:50.859309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6afe6fe9-2766-4d7f-ae1e-73af1a5ffbc4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080195 Sep 14 19:54:50.859882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1070/2171] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:50 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:51.876534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1246b4bd-238d-48dd-8625-8fee15b906dc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:51.880412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1246b4bd-238d-48dd-8625-8fee15b906dc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:51.883700 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1246b4bd-238d-48dd-8625-8fee15b906dc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:51.884116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1246b4bd-238d-48dd-8625-8fee15b906dc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:51.884883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1246b4bd-238d-48dd-8625-8fee15b906dc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:51.885322 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1246b4bd-238d-48dd-8625-8fee15b906dc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:51.944678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1246b4bd-238d-48dd-8625-8fee15b906dc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:51.952056 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1246b4bd-238d-48dd-8625-8fee15b906dc tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.079207 Sep 14 19:54:51.952618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1102/2172] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:51 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:52.969550 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5a5dca0a-8275-4c45-9b3c-df378d537766 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:52.970166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5a5dca0a-8275-4c45-9b3c-df378d537766 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:52.976843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a5dca0a-8275-4c45-9b3c-df378d537766 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:52.978821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a5dca0a-8275-4c45-9b3c-df378d537766 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:52.978821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a5dca0a-8275-4c45-9b3c-df378d537766 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:52.978821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a5dca0a-8275-4c45-9b3c-df378d537766 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:53.043489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5a5dca0a-8275-4c45-9b3c-df378d537766 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:53.051621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5a5dca0a-8275-4c45-9b3c-df378d537766 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.085689 Sep 14 19:54:53.052213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1071/2173] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:52 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:54.068071 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f60299c8-35c4-4b25-aa24-4787b3fd26ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:54.068713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f60299c8-35c4-4b25-aa24-4787b3fd26ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:54.074575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f60299c8-35c4-4b25-aa24-4787b3fd26ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:54.075020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f60299c8-35c4-4b25-aa24-4787b3fd26ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:54.075813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f60299c8-35c4-4b25-aa24-4787b3fd26ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:54.076240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f60299c8-35c4-4b25-aa24-4787b3fd26ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:54.135893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f60299c8-35c4-4b25-aa24-4787b3fd26ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:54.143203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f60299c8-35c4-4b25-aa24-4787b3fd26ab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.078773 Sep 14 19:54:54.143781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1103/2174] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:54 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:55.159289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b099a12a-1244-4fe5-af4c-a91eae4f459f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:55.159922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b099a12a-1244-4fe5-af4c-a91eae4f459f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:55.165983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b099a12a-1244-4fe5-af4c-a91eae4f459f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:55.166435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b099a12a-1244-4fe5-af4c-a91eae4f459f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:55.167214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b099a12a-1244-4fe5-af4c-a91eae4f459f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:55.167657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b099a12a-1244-4fe5-af4c-a91eae4f459f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:55.228768 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b099a12a-1244-4fe5-af4c-a91eae4f459f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:55.236144 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b099a12a-1244-4fe5-af4c-a91eae4f459f tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.080526 Sep 14 19:54:55.236718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1072/2175] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:55 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:56.253990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-74aaf01d-c7ae-4fc0-8612-d4fee1d018c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:56.254615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-74aaf01d-c7ae-4fc0-8612-d4fee1d018c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:56.261262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-74aaf01d-c7ae-4fc0-8612-d4fee1d018c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:56.261752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-74aaf01d-c7ae-4fc0-8612-d4fee1d018c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:56.262543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-74aaf01d-c7ae-4fc0-8612-d4fee1d018c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:56.262982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-74aaf01d-c7ae-4fc0-8612-d4fee1d018c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:56.338578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-74aaf01d-c7ae-4fc0-8612-d4fee1d018c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:56.346521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-74aaf01d-c7ae-4fc0-8612-d4fee1d018c9 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.096240 Sep 14 19:54:56.347138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1104/2176] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:56 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:57.363054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3050d4ed-06bf-4c7a-9c83-b716bbd1533b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:57.363743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3050d4ed-06bf-4c7a-9c83-b716bbd1533b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:57.369720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3050d4ed-06bf-4c7a-9c83-b716bbd1533b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:57.370165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3050d4ed-06bf-4c7a-9c83-b716bbd1533b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:57.370932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3050d4ed-06bf-4c7a-9c83-b716bbd1533b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:57.371367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3050d4ed-06bf-4c7a-9c83-b716bbd1533b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:57.440088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3050d4ed-06bf-4c7a-9c83-b716bbd1533b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:57.447347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3050d4ed-06bf-4c7a-9c83-b716bbd1533b tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.087904 Sep 14 19:54:57.447916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1073/2177] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:57 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:58.463865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ff591ecc-04c7-4d86-b128-98e37857c8a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:58.464476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ff591ecc-04c7-4d86-b128-98e37857c8a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:58.471506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff591ecc-04c7-4d86-b128-98e37857c8a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:58.471952 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff591ecc-04c7-4d86-b128-98e37857c8a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:58.472729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff591ecc-04c7-4d86-b128-98e37857c8a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:58.473168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff591ecc-04c7-4d86-b128-98e37857c8a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:58.536945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ff591ecc-04c7-4d86-b128-98e37857c8a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:58.546816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ff591ecc-04c7-4d86-b128-98e37857c8a4 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.086575 Sep 14 19:54:58.547394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1105/2178] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:58 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:54:59.564735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f8456dc5-9201-4a80-b75d-008fb842dfab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:54:59.565410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f8456dc5-9201-4a80-b75d-008fb842dfab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:54:59.571462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8456dc5-9201-4a80-b75d-008fb842dfab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:59.571995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8456dc5-9201-4a80-b75d-008fb842dfab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:59.572754 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8456dc5-9201-4a80-b75d-008fb842dfab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:54:59.573188 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8456dc5-9201-4a80-b75d-008fb842dfab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:54:59.636363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f8456dc5-9201-4a80-b75d-008fb842dfab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:54:59.644094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f8456dc5-9201-4a80-b75d-008fb842dfab tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.083122 Sep 14 19:54:59.644672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1074/2179] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:54:59 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:55:00.662970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e4cc47cb-16ab-4d44-acdb-48ed672e057c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:00.663587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e4cc47cb-16ab-4d44-acdb-48ed672e057c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:55:00.669959 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e4cc47cb-16ab-4d44-acdb-48ed672e057c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:55:00.670414 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e4cc47cb-16ab-4d44-acdb-48ed672e057c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:55:00.671206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e4cc47cb-16ab-4d44-acdb-48ed672e057c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:55:00.672098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e4cc47cb-16ab-4d44-acdb-48ed672e057c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:55:00.764255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e4cc47cb-16ab-4d44-acdb-48ed672e057c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:00.771082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e4cc47cb-16ab-4d44-acdb-48ed672e057c tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.111645 Sep 14 19:55:00.771955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1106/2180] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:55:00 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:01.792126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-97fa4f28-85b7-47b6-96a4-ca93cd0272d7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:01.792972 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-97fa4f28-85b7-47b6-96a4-ca93cd0272d7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:55:01.799781 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97fa4f28-85b7-47b6-96a4-ca93cd0272d7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:55:01.800544 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97fa4f28-85b7-47b6-96a4-ca93cd0272d7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:55:01.801356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97fa4f28-85b7-47b6-96a4-ca93cd0272d7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:55:01.801829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-97fa4f28-85b7-47b6-96a4-ca93cd0272d7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:55:01.884313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-97fa4f28-85b7-47b6-96a4-ca93cd0272d7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:01.892733 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-97fa4f28-85b7-47b6-96a4-ca93cd0272d7 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1220 microversion: 2.1 time: 0.104555 Sep 14 19:55:01.893332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1075/2181] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:55:01 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:02.918413 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:02.922602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:55:02.926250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:55:02.926780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:55:02.928464 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:55:02.928892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:55:02.959863 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:55:02.960309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:55:02.960756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lazy-loading 'fault' on Instance uuid 7745385c-e705-4e0e-8fc7-c96f398b93d9 {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:55:03.003896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f22db89d8174d76b7c5e6f4f99a11bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ba21a8e4a9e49ea953ed4a871211a18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:03.011309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3f6609b4-9459-42f6-91ba-aed61eb41dec tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 200 len: 1314 microversion: 2.1 time: 0.096753 Sep 14 19:55:03.011876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1107/2182] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:55:02 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 1314 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:04.028889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ae7a9baf-ce6f-4489-b022-9aff9f987799 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:04.029515 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ae7a9baf-ce6f-4489-b022-9aff9f987799 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] [instance: 7745385c-e705-4e0e-8fc7-c96f398b93d9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:55:04.035369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae7a9baf-ce6f-4489-b022-9aff9f987799 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:55:04.035817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae7a9baf-ce6f-4489-b022-9aff9f987799 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:55:04.036585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae7a9baf-ce6f-4489-b022-9aff9f987799 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:55:04.037045 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ae7a9baf-ce6f-4489-b022-9aff9f987799 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:55:04.050393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-ae7a9baf-ce6f-4489-b022-9aff9f987799 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] HTTP exception thrown: Instance 7745385c-e705-4e0e-8fc7-c96f398b93d9 could not be found. Sep 14 19:55:04.050982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ae7a9baf-ce6f-4489-b022-9aff9f987799 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Returning 404 to user: Instance 7745385c-e705-4e0e-8fc7-c96f398b93d9 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:55:04.051807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ae7a9baf-ce6f-4489-b022-9aff9f987799 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9" status: 404 len: 111 microversion: 2.1 time: 0.026814 Sep 14 19:55:04.052338 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1076/2183] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:55:04 2021] GET /compute/v2.1/servers/7745385c-e705-4e0e-8fc7-c96f398b93d9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 19:55:04.284895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9be7be5f-8609-4538-bd49-7fea717a28a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] Calling method '.version_select at 0x7fd0bbd58f70>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:04.387912 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9be7be5f-8609-4538-bd49-7fea717a28a5 tempest-TestShelveInstance-1731576580 tempest-TestShelveInstance-1731576580-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1826042944" status: 202 len: 0 microversion: 2.1 time: 0.110102 Sep 14 19:55:04.388494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1108/2184] 10.222.0.58 () {58 vars in 1254 bytes} [Tue Sep 14 19:55:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1826042944 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:55:32.788783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:55:32.789329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 19:55:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:56:42.622179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:56:42.622863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 19:56:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:56:43.386045 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:56:43.386260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 19:56:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:56:44.646070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 19:56:44.646673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 19:56:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 19:57:11.271000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6fa0625b-e45c-4548-99a0-40770864f9b2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:11.271593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6fa0625b-e45c-4548-99a0-40770864f9b2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:11.278642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6fa0625b-e45c-4548-99a0-40770864f9b2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:11.279089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6fa0625b-e45c-4548-99a0-40770864f9b2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:11.279875 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6fa0625b-e45c-4548-99a0-40770864f9b2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:11.280308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6fa0625b-e45c-4548-99a0-40770864f9b2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:11.305525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6fa0625b-e45c-4548-99a0-40770864f9b2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Going to try to terminate instance {{(pid=115679) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 19:57:11.584043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6fa0625b-e45c-4548-99a0-40770864f9b2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 204 len: 0 microversion: 2.1 time: 0.317386 Sep 14 19:57:11.584558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1077/2185] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 19:57:11 2021] DELETE /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:57:11.591262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 19:57:11.596024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a85d31c5-6c27-452f-81cf-51c230a728a2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:11.596621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a85d31c5-6c27-452f-81cf-51c230a728a2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:11.602407 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a85d31c5-6c27-452f-81cf-51c230a728a2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:11.602849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a85d31c5-6c27-452f-81cf-51c230a728a2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:11.603600 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a85d31c5-6c27-452f-81cf-51c230a728a2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:11.604028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a85d31c5-6c27-452f-81cf-51c230a728a2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:11.920911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a85d31c5-6c27-452f-81cf-51c230a728a2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:11.929127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a85d31c5-6c27-452f-81cf-51c230a728a2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1559 microversion: 2.1 time: 0.340058 Sep 14 19:57:11.929821 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1109/2186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:11 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1559 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:12.805552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-0cbc4959-9dd0-495d-bdd6-486f741a859b req-67418622-5e1c-4ee0-abf5-761dff50f792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3106dd73-2741-49d1-9906-80ecde50dd8e", "name": "network-vif-deleted", "tag": "36ff7926-98a9-4ebc-92cf-fe7571488e5c"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:12.807409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:57:12.807409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:57:12.815155 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-0cbc4959-9dd0-495d-bdd6-486f741a859b req-67418622-5e1c-4ee0-abf5-761dff50f792 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:12.815588 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-0cbc4959-9dd0-495d-bdd6-486f741a859b req-67418622-5e1c-4ee0-abf5-761dff50f792 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:12.826402 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-0cbc4959-9dd0-495d-bdd6-486f741a859b req-67418622-5e1c-4ee0-abf5-761dff50f792 service nova] Creating event network-vif-deleted:36ff7926-98a9-4ebc-92cf-fe7571488e5c for instance 3106dd73-2741-49d1-9906-80ecde50dd8e on hv-cinder-80588 Sep 14 19:57:12.831379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-0cbc4959-9dd0-495d-bdd6-486f741a859b req-67418622-5e1c-4ee0-abf5-761dff50f792 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088148 Sep 14 19:57:12.832316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1078/2187] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:57:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:12.946288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5eb2c518-7bac-4dfd-9851-94d91cd0d4e7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:12.946907 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5eb2c518-7bac-4dfd-9851-94d91cd0d4e7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:12.965104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5eb2c518-7bac-4dfd-9851-94d91cd0d4e7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:12.966164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5eb2c518-7bac-4dfd-9851-94d91cd0d4e7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:12.966381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5eb2c518-7bac-4dfd-9851-94d91cd0d4e7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:12.966822 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5eb2c518-7bac-4dfd-9851-94d91cd0d4e7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:12.972938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60280. Sep 14 19:57:13.029284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5eb2c518-7bac-4dfd-9851-94d91cd0d4e7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:13.037535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5eb2c518-7bac-4dfd-9851-94d91cd0d4e7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.094830 Sep 14 19:57:13.038334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1110/2188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:12 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:14.055679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-74069e54-8448-4bd9-a7b0-c17311b4401b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:14.056545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-74069e54-8448-4bd9-a7b0-c17311b4401b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:14.063241 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74069e54-8448-4bd9-a7b0-c17311b4401b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:14.063712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74069e54-8448-4bd9-a7b0-c17311b4401b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:14.064467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74069e54-8448-4bd9-a7b0-c17311b4401b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:14.064889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-74069e54-8448-4bd9-a7b0-c17311b4401b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:14.183620 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-74069e54-8448-4bd9-a7b0-c17311b4401b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:14.191316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-74069e54-8448-4bd9-a7b0-c17311b4401b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.139625 Sep 14 19:57:14.191877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1079/2189] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:14 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:15.207719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a41f08df-07e4-487a-9204-2e4c458073a6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:15.208330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a41f08df-07e4-487a-9204-2e4c458073a6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:15.214147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a41f08df-07e4-487a-9204-2e4c458073a6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:15.214591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a41f08df-07e4-487a-9204-2e4c458073a6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:15.215347 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a41f08df-07e4-487a-9204-2e4c458073a6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:15.215779 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a41f08df-07e4-487a-9204-2e4c458073a6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:15.275255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a41f08df-07e4-487a-9204-2e4c458073a6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:15.283072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a41f08df-07e4-487a-9204-2e4c458073a6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079129 Sep 14 19:57:15.283632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1111/2190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:15 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:16.299957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8d5b6060-98c6-4530-8924-d39f8f4fbac8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:16.300582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8d5b6060-98c6-4530-8924-d39f8f4fbac8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:16.306579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d5b6060-98c6-4530-8924-d39f8f4fbac8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:16.307011 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d5b6060-98c6-4530-8924-d39f8f4fbac8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:16.307838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d5b6060-98c6-4530-8924-d39f8f4fbac8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:16.308267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d5b6060-98c6-4530-8924-d39f8f4fbac8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:16.366659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8d5b6060-98c6-4530-8924-d39f8f4fbac8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:16.374406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8d5b6060-98c6-4530-8924-d39f8f4fbac8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078411 Sep 14 19:57:16.374972 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1080/2191] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:16 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:17.391082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c2bba1ea-6b2f-4d15-b216-ed7ea1b9edc4 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:17.391683 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c2bba1ea-6b2f-4d15-b216-ed7ea1b9edc4 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:17.397477 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c2bba1ea-6b2f-4d15-b216-ed7ea1b9edc4 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:17.397951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c2bba1ea-6b2f-4d15-b216-ed7ea1b9edc4 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:17.398714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c2bba1ea-6b2f-4d15-b216-ed7ea1b9edc4 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:17.399134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c2bba1ea-6b2f-4d15-b216-ed7ea1b9edc4 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:17.460368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c2bba1ea-6b2f-4d15-b216-ed7ea1b9edc4 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:17.468498 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c2bba1ea-6b2f-4d15-b216-ed7ea1b9edc4 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081112 Sep 14 19:57:17.469046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1112/2192] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:17 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:18.485587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0dfaf6f1-1fb5-497a-ad47-12a54d9e2426 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:18.486189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0dfaf6f1-1fb5-497a-ad47-12a54d9e2426 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:18.492398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0dfaf6f1-1fb5-497a-ad47-12a54d9e2426 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:18.492850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0dfaf6f1-1fb5-497a-ad47-12a54d9e2426 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:18.493658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0dfaf6f1-1fb5-497a-ad47-12a54d9e2426 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:18.494099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0dfaf6f1-1fb5-497a-ad47-12a54d9e2426 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:18.553950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0dfaf6f1-1fb5-497a-ad47-12a54d9e2426 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:18.562366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0dfaf6f1-1fb5-497a-ad47-12a54d9e2426 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080500 Sep 14 19:57:18.562931 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1081/2193] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:18 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:19.579786 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-64466d0a-c3a6-4355-9f67-8d0825cc2591 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:19.580305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-64466d0a-c3a6-4355-9f67-8d0825cc2591 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:19.586192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64466d0a-c3a6-4355-9f67-8d0825cc2591 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:19.586644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64466d0a-c3a6-4355-9f67-8d0825cc2591 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:19.587418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64466d0a-c3a6-4355-9f67-8d0825cc2591 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:19.587858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64466d0a-c3a6-4355-9f67-8d0825cc2591 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:19.646760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-64466d0a-c3a6-4355-9f67-8d0825cc2591 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:19.654450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-64466d0a-c3a6-4355-9f67-8d0825cc2591 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079139 Sep 14 19:57:19.655036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1113/2194] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:19 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:20.671361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-40f01a1c-6ad8-4358-b12b-0402bac22c78 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:20.671975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-40f01a1c-6ad8-4358-b12b-0402bac22c78 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:20.678214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40f01a1c-6ad8-4358-b12b-0402bac22c78 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:20.678668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40f01a1c-6ad8-4358-b12b-0402bac22c78 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:20.679432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40f01a1c-6ad8-4358-b12b-0402bac22c78 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:20.679868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40f01a1c-6ad8-4358-b12b-0402bac22c78 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:20.740412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-40f01a1c-6ad8-4358-b12b-0402bac22c78 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:20.749016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-40f01a1c-6ad8-4358-b12b-0402bac22c78 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081896 Sep 14 19:57:20.749622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1082/2195] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:20 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:20.777271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-86863233-b6ef-4789-b79a-53e2b7e310a5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:20.777826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-86863233-b6ef-4789-b79a-53e2b7e310a5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:20.784241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86863233-b6ef-4789-b79a-53e2b7e310a5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:20.784697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86863233-b6ef-4789-b79a-53e2b7e310a5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:20.785515 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86863233-b6ef-4789-b79a-53e2b7e310a5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:20.785966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86863233-b6ef-4789-b79a-53e2b7e310a5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:20.810871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-86863233-b6ef-4789-b79a-53e2b7e310a5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Going to try to terminate instance {{(pid=115678) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 19:57:21.098551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-86863233-b6ef-4789-b79a-53e2b7e310a5 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 204 len: 0 microversion: 2.1 time: 0.323893 Sep 14 19:57:21.098551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1114/2196] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 19:57:20 2021] DELETE /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:57:21.109284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5c0ee1ba-745b-4c44-8f9e-7c4afb15d08c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:21.109933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5c0ee1ba-745b-4c44-8f9e-7c4afb15d08c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:21.115993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c0ee1ba-745b-4c44-8f9e-7c4afb15d08c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:21.116441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c0ee1ba-745b-4c44-8f9e-7c4afb15d08c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:21.117211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c0ee1ba-745b-4c44-8f9e-7c4afb15d08c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:21.117754 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c0ee1ba-745b-4c44-8f9e-7c4afb15d08c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:21.240541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5c0ee1ba-745b-4c44-8f9e-7c4afb15d08c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:21.248243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5c0ee1ba-745b-4c44-8f9e-7c4afb15d08c tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1555 microversion: 2.1 time: 0.144331 Sep 14 19:57:21.248807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1083/2197] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:21 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:21.766916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c15dc0e3-6b67-4af2-86c8-5b9e8ab17710 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:21.767619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c15dc0e3-6b67-4af2-86c8-5b9e8ab17710 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:21.773752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c15dc0e3-6b67-4af2-86c8-5b9e8ab17710 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:21.774327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c15dc0e3-6b67-4af2-86c8-5b9e8ab17710 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:21.775223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c15dc0e3-6b67-4af2-86c8-5b9e8ab17710 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:21.775763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c15dc0e3-6b67-4af2-86c8-5b9e8ab17710 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:21.857690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c15dc0e3-6b67-4af2-86c8-5b9e8ab17710 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:21.866353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c15dc0e3-6b67-4af2-86c8-5b9e8ab17710 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.103716 Sep 14 19:57:21.866921 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1115/2198] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:21 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:22.084469 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-d0e590d0-c922-47ac-86d6-3829202165c2 req-1d237fda-9b5d-47ce-8062-02ffe3915252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281", "name": "network-vif-deleted", "tag": "69da7992-0bf2-4642-a9ae-536e8e8fa62f"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:22.086079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:57:22.086079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:57:22.093314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-d0e590d0-c922-47ac-86d6-3829202165c2 req-1d237fda-9b5d-47ce-8062-02ffe3915252 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:22.094174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-d0e590d0-c922-47ac-86d6-3829202165c2 req-1d237fda-9b5d-47ce-8062-02ffe3915252 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:22.104477 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-d0e590d0-c922-47ac-86d6-3829202165c2 req-1d237fda-9b5d-47ce-8062-02ffe3915252 service nova] Creating event network-vif-deleted:69da7992-0bf2-4642-a9ae-536e8e8fa62f for instance c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 on hv-cinder-80588 Sep 14 19:57:22.110207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-d0e590d0-c922-47ac-86d6-3829202165c2 req-1d237fda-9b5d-47ce-8062-02ffe3915252 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029440 Sep 14 19:57:22.110791 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1084/2199] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:57:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:22.265905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-98ff7f5b-0f70-49da-98f3-bb6587315a54 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:22.266472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-98ff7f5b-0f70-49da-98f3-bb6587315a54 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:22.272470 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98ff7f5b-0f70-49da-98f3-bb6587315a54 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:22.272913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98ff7f5b-0f70-49da-98f3-bb6587315a54 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:22.273894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98ff7f5b-0f70-49da-98f3-bb6587315a54 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:22.274333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98ff7f5b-0f70-49da-98f3-bb6587315a54 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:22.336332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-98ff7f5b-0f70-49da-98f3-bb6587315a54 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cb4a2e6b0146d897917fe76dcc6565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14259a781e8c4dbeafab6f1777646286', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:22.344554 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-98ff7f5b-0f70-49da-98f3-bb6587315a54 tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 200 len: 1343 microversion: 2.1 time: 0.083040 Sep 14 19:57:22.345165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1116/2200] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:22 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 1343 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:22.883737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-84649f49-e3c5-4e9d-be17-e2f32638ce3b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:22.884422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-84649f49-e3c5-4e9d-be17-e2f32638ce3b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:22.891057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84649f49-e3c5-4e9d-be17-e2f32638ce3b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:22.891500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84649f49-e3c5-4e9d-be17-e2f32638ce3b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:22.892247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84649f49-e3c5-4e9d-be17-e2f32638ce3b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:22.892675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-84649f49-e3c5-4e9d-be17-e2f32638ce3b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:22.955493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-84649f49-e3c5-4e9d-be17-e2f32638ce3b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:22.963575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-84649f49-e3c5-4e9d-be17-e2f32638ce3b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.083803 Sep 14 19:57:22.964411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1085/2201] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:22 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:23.362125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c697c73b-a284-4693-9f53-23a03aa79c9b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:23.362743 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c697c73b-a284-4693-9f53-23a03aa79c9b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] [instance: c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:23.368700 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c697c73b-a284-4693-9f53-23a03aa79c9b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:23.369159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c697c73b-a284-4693-9f53-23a03aa79c9b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:23.369972 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c697c73b-a284-4693-9f53-23a03aa79c9b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:23.370413 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c697c73b-a284-4693-9f53-23a03aa79c9b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:23.383585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-c697c73b-a284-4693-9f53-23a03aa79c9b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] HTTP exception thrown: Instance c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 could not be found. Sep 14 19:57:23.384187 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c697c73b-a284-4693-9f53-23a03aa79c9b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Returning 404 to user: Instance c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:57:23.385018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c697c73b-a284-4693-9f53-23a03aa79c9b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281" status: 404 len: 111 microversion: 2.1 time: 0.026858 Sep 14 19:57:23.385574 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1117/2202] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:23 2021] GET /compute/v2.1/servers/c6a5e608-c4ae-4170-ad2f-c1a9e0bb4281 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:57:23.393610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-64ca7607-2200-45fd-b4df-9b1a834cbc0b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] Calling method '.version_select at 0x7fd0c8646160>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:23.504611 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-64ca7607-2200-45fd-b4df-9b1a834cbc0b tempest-TestMinimumBasicScenario-876375999 tempest-TestMinimumBasicScenario-876375999-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1428796221" status: 202 len: 0 microversion: 2.1 time: 0.114554 Sep 14 19:57:23.505217 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1086/2203] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Sep 14 19:57:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1428796221 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:57:23.980923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b1020dca-a666-49f3-9aa0-fc1df3d00838 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:23.981571 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b1020dca-a666-49f3-9aa0-fc1df3d00838 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:23.987827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1020dca-a666-49f3-9aa0-fc1df3d00838 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:23.990331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1020dca-a666-49f3-9aa0-fc1df3d00838 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:23.990331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1020dca-a666-49f3-9aa0-fc1df3d00838 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:23.990331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b1020dca-a666-49f3-9aa0-fc1df3d00838 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:24.054942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b1020dca-a666-49f3-9aa0-fc1df3d00838 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:24.067084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b1020dca-a666-49f3-9aa0-fc1df3d00838 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.089276 Sep 14 19:57:24.068276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1118/2204] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:23 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:25.090400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7443c5b5-19a4-420b-a50b-e46cc33768d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:25.091819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7443c5b5-19a4-420b-a50b-e46cc33768d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:25.097816 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7443c5b5-19a4-420b-a50b-e46cc33768d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:25.098266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7443c5b5-19a4-420b-a50b-e46cc33768d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:25.099042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7443c5b5-19a4-420b-a50b-e46cc33768d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:25.099468 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7443c5b5-19a4-420b-a50b-e46cc33768d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:25.159833 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7443c5b5-19a4-420b-a50b-e46cc33768d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:25.167407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7443c5b5-19a4-420b-a50b-e46cc33768d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080783 Sep 14 19:57:25.167975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1087/2205] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:25 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:26.185896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b0484a5a-dca5-478b-8b7f-108d1605352d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:26.187365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b0484a5a-dca5-478b-8b7f-108d1605352d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:26.194377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0484a5a-dca5-478b-8b7f-108d1605352d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:26.194935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0484a5a-dca5-478b-8b7f-108d1605352d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:26.196359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0484a5a-dca5-478b-8b7f-108d1605352d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:26.197368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0484a5a-dca5-478b-8b7f-108d1605352d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:26.279454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b0484a5a-dca5-478b-8b7f-108d1605352d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:26.287425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b0484a5a-dca5-478b-8b7f-108d1605352d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.105809 Sep 14 19:57:26.288004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1119/2206] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:26 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:27.307185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8d82beef-f4e2-4a6a-b644-644b8f659cf0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:27.307808 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8d82beef-f4e2-4a6a-b644-644b8f659cf0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:27.314294 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d82beef-f4e2-4a6a-b644-644b8f659cf0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:27.314737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d82beef-f4e2-4a6a-b644-644b8f659cf0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:27.315605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d82beef-f4e2-4a6a-b644-644b8f659cf0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:27.316056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d82beef-f4e2-4a6a-b644-644b8f659cf0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:27.397105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8d82beef-f4e2-4a6a-b644-644b8f659cf0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:27.405804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8d82beef-f4e2-4a6a-b644-644b8f659cf0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.102998 Sep 14 19:57:27.406382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1088/2207] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:27 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:28.422898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f966908c-13e5-4add-bd3f-790a9d456f2f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:28.423594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f966908c-13e5-4add-bd3f-790a9d456f2f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:28.429871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f966908c-13e5-4add-bd3f-790a9d456f2f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:28.430391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f966908c-13e5-4add-bd3f-790a9d456f2f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:28.431244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f966908c-13e5-4add-bd3f-790a9d456f2f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:28.431761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f966908c-13e5-4add-bd3f-790a9d456f2f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:28.500378 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f966908c-13e5-4add-bd3f-790a9d456f2f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:28.500929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f966908c-13e5-4add-bd3f-790a9d456f2f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081584 Sep 14 19:57:28.501697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1120/2208] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:28 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:29.517991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d96d5610-aad6-4ac0-a217-46509f82e05a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:29.518617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d96d5610-aad6-4ac0-a217-46509f82e05a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:29.524489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d96d5610-aad6-4ac0-a217-46509f82e05a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:29.524935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d96d5610-aad6-4ac0-a217-46509f82e05a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:29.525767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d96d5610-aad6-4ac0-a217-46509f82e05a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:29.526208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d96d5610-aad6-4ac0-a217-46509f82e05a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:29.603533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d96d5610-aad6-4ac0-a217-46509f82e05a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:29.612022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d96d5610-aad6-4ac0-a217-46509f82e05a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.097820 Sep 14 19:57:29.612587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1089/2209] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:29 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:30.628775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-010c3c28-db02-4f88-afa7-8a9d9ad2001e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:30.629384 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-010c3c28-db02-4f88-afa7-8a9d9ad2001e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:30.636359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-010c3c28-db02-4f88-afa7-8a9d9ad2001e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:30.636816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-010c3c28-db02-4f88-afa7-8a9d9ad2001e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:30.637684 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-010c3c28-db02-4f88-afa7-8a9d9ad2001e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:30.638128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-010c3c28-db02-4f88-afa7-8a9d9ad2001e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:30.927477 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-010c3c28-db02-4f88-afa7-8a9d9ad2001e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:30.936210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-010c3c28-db02-4f88-afa7-8a9d9ad2001e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.311229 Sep 14 19:57:30.936911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1121/2210] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:30 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:31.952043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d1ebbb1f-7c3b-456d-b225-d6f77b6c2949 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:31.952657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d1ebbb1f-7c3b-456d-b225-d6f77b6c2949 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:31.958427 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1ebbb1f-7c3b-456d-b225-d6f77b6c2949 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:31.958878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1ebbb1f-7c3b-456d-b225-d6f77b6c2949 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:31.959649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1ebbb1f-7c3b-456d-b225-d6f77b6c2949 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:31.960093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1ebbb1f-7c3b-456d-b225-d6f77b6c2949 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:32.019804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d1ebbb1f-7c3b-456d-b225-d6f77b6c2949 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:32.027556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d1ebbb1f-7c3b-456d-b225-d6f77b6c2949 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079273 Sep 14 19:57:32.028160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1090/2211] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:31 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:33.044367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d1c6d34b-a9db-4692-afbb-968636ce491c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:33.045005 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d1c6d34b-a9db-4692-afbb-968636ce491c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:33.050971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d1c6d34b-a9db-4692-afbb-968636ce491c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:33.051419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d1c6d34b-a9db-4692-afbb-968636ce491c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:33.052183 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d1c6d34b-a9db-4692-afbb-968636ce491c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:33.052615 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d1c6d34b-a9db-4692-afbb-968636ce491c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:33.112345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d1c6d34b-a9db-4692-afbb-968636ce491c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:33.120236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d1c6d34b-a9db-4692-afbb-968636ce491c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079578 Sep 14 19:57:33.121115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1122/2212] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:33 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:34.137409 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1cd399ca-08da-47ef-9666-bdbce8eb9b07 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:34.138049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1cd399ca-08da-47ef-9666-bdbce8eb9b07 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:34.140419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 19:57:34.144681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1cd399ca-08da-47ef-9666-bdbce8eb9b07 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:34.145125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1cd399ca-08da-47ef-9666-bdbce8eb9b07 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:34.145911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1cd399ca-08da-47ef-9666-bdbce8eb9b07 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:34.146345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1cd399ca-08da-47ef-9666-bdbce8eb9b07 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:34.211099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1cd399ca-08da-47ef-9666-bdbce8eb9b07 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:34.219589 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1cd399ca-08da-47ef-9666-bdbce8eb9b07 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.085823 Sep 14 19:57:34.220104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1091/2213] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:34 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:35.236500 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-86a13eb3-ce5c-4b1d-8e66-c3b5b10a4eb5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:35.237128 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-86a13eb3-ce5c-4b1d-8e66-c3b5b10a4eb5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:35.243043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86a13eb3-ce5c-4b1d-8e66-c3b5b10a4eb5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:35.243494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86a13eb3-ce5c-4b1d-8e66-c3b5b10a4eb5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:35.244262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86a13eb3-ce5c-4b1d-8e66-c3b5b10a4eb5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:35.244699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86a13eb3-ce5c-4b1d-8e66-c3b5b10a4eb5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:35.306300 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-86a13eb3-ce5c-4b1d-8e66-c3b5b10a4eb5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:35.314185 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-86a13eb3-ce5c-4b1d-8e66-c3b5b10a4eb5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081353 Sep 14 19:57:35.314995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1123/2214] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:35 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:36.331327 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-34bc83d0-ecd1-438c-bb6b-2fa61cbf6f99 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:36.331964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-34bc83d0-ecd1-438c-bb6b-2fa61cbf6f99 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:36.349017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-34bc83d0-ecd1-438c-bb6b-2fa61cbf6f99 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:36.349469 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-34bc83d0-ecd1-438c-bb6b-2fa61cbf6f99 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:36.350262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-34bc83d0-ecd1-438c-bb6b-2fa61cbf6f99 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:36.350700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-34bc83d0-ecd1-438c-bb6b-2fa61cbf6f99 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:36.355846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60618. Sep 14 19:57:36.412450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-34bc83d0-ecd1-438c-bb6b-2fa61cbf6f99 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:36.420729 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-34bc83d0-ecd1-438c-bb6b-2fa61cbf6f99 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.093107 Sep 14 19:57:36.421295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1092/2215] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:36 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:37.436902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1fefe381-2384-4930-9542-833ff498a3d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:37.437528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1fefe381-2384-4930-9542-833ff498a3d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:37.443238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1fefe381-2384-4930-9542-833ff498a3d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:37.443693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1fefe381-2384-4930-9542-833ff498a3d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:37.444463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1fefe381-2384-4930-9542-833ff498a3d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:37.444903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1fefe381-2384-4930-9542-833ff498a3d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:37.503755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1fefe381-2384-4930-9542-833ff498a3d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:37.511531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1fefe381-2384-4930-9542-833ff498a3d7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078189 Sep 14 19:57:37.512092 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1124/2216] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:37 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:38.535769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d88a2930-95be-4e7d-b7e3-31783d203eee tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:38.536373 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d88a2930-95be-4e7d-b7e3-31783d203eee tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:38.542245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d88a2930-95be-4e7d-b7e3-31783d203eee tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:38.542693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d88a2930-95be-4e7d-b7e3-31783d203eee tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:38.543559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d88a2930-95be-4e7d-b7e3-31783d203eee tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:38.543945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d88a2930-95be-4e7d-b7e3-31783d203eee tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:38.604962 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d88a2930-95be-4e7d-b7e3-31783d203eee tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:38.613382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d88a2930-95be-4e7d-b7e3-31783d203eee tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081192 Sep 14 19:57:38.613990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1093/2217] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:38 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:39.630114 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d9c90213-5d45-4601-8e33-2dd539e44ae7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:39.630765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d9c90213-5d45-4601-8e33-2dd539e44ae7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:39.636539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9c90213-5d45-4601-8e33-2dd539e44ae7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:39.636985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9c90213-5d45-4601-8e33-2dd539e44ae7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:39.637776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9c90213-5d45-4601-8e33-2dd539e44ae7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:39.638212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9c90213-5d45-4601-8e33-2dd539e44ae7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:39.698394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d9c90213-5d45-4601-8e33-2dd539e44ae7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:39.706302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d9c90213-5d45-4601-8e33-2dd539e44ae7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079896 Sep 14 19:57:39.706870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1125/2218] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:39 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:40.723244 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e1e6f940-4b6a-40c8-b567-5e9bb8e72d0b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:40.723967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e1e6f940-4b6a-40c8-b567-5e9bb8e72d0b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:40.730465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1e6f940-4b6a-40c8-b567-5e9bb8e72d0b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:40.730934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1e6f940-4b6a-40c8-b567-5e9bb8e72d0b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:40.731812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1e6f940-4b6a-40c8-b567-5e9bb8e72d0b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:40.732291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1e6f940-4b6a-40c8-b567-5e9bb8e72d0b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:40.791938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e1e6f940-4b6a-40c8-b567-5e9bb8e72d0b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:40.800049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e1e6f940-4b6a-40c8-b567-5e9bb8e72d0b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080475 Sep 14 19:57:40.800607 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1094/2219] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:40 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:41.816165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-782e8bae-d673-441d-9529-eec1c2ae4671 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:41.816692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-782e8bae-d673-441d-9529-eec1c2ae4671 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:41.822637 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-782e8bae-d673-441d-9529-eec1c2ae4671 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:41.823089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-782e8bae-d673-441d-9529-eec1c2ae4671 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:41.823857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-782e8bae-d673-441d-9529-eec1c2ae4671 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:41.824297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-782e8bae-d673-441d-9529-eec1c2ae4671 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:41.884210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-782e8bae-d673-441d-9529-eec1c2ae4671 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:41.892545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-782e8bae-d673-441d-9529-eec1c2ae4671 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080074 Sep 14 19:57:41.893120 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1126/2220] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:41 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:42.909244 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1af38429-6859-4261-bfe1-e8ce81c6c800 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:42.909792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1af38429-6859-4261-bfe1-e8ce81c6c800 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:42.915581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1af38429-6859-4261-bfe1-e8ce81c6c800 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:42.916018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1af38429-6859-4261-bfe1-e8ce81c6c800 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:42.916766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1af38429-6859-4261-bfe1-e8ce81c6c800 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:42.917195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1af38429-6859-4261-bfe1-e8ce81c6c800 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:42.976055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1af38429-6859-4261-bfe1-e8ce81c6c800 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:42.987534 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1af38429-6859-4261-bfe1-e8ce81c6c800 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082019 Sep 14 19:57:42.988593 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1095/2221] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:42 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:44.005793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5d062935-1bd2-4bf7-9fb7-a8734a701009 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:44.006369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5d062935-1bd2-4bf7-9fb7-a8734a701009 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:44.012201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d062935-1bd2-4bf7-9fb7-a8734a701009 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:44.012651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d062935-1bd2-4bf7-9fb7-a8734a701009 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:44.013420 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d062935-1bd2-4bf7-9fb7-a8734a701009 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:44.013874 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5d062935-1bd2-4bf7-9fb7-a8734a701009 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:44.076044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5d062935-1bd2-4bf7-9fb7-a8734a701009 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:44.084109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5d062935-1bd2-4bf7-9fb7-a8734a701009 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082244 Sep 14 19:57:44.084693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1127/2222] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:44 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:45.099879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2e83e816-f820-4524-b87c-b70538994e63 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:45.100567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2e83e816-f820-4524-b87c-b70538994e63 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:45.106189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e83e816-f820-4524-b87c-b70538994e63 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:45.106621 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e83e816-f820-4524-b87c-b70538994e63 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:45.107382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e83e816-f820-4524-b87c-b70538994e63 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:45.107811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2e83e816-f820-4524-b87c-b70538994e63 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:45.167083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2e83e816-f820-4524-b87c-b70538994e63 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:45.175063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2e83e816-f820-4524-b87c-b70538994e63 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078541 Sep 14 19:57:45.175633 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1096/2223] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:45 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:46.191296 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b169b154-ee20-449b-b630-04ce060cbf35 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:46.192018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b169b154-ee20-449b-b630-04ce060cbf35 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:46.197732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b169b154-ee20-449b-b630-04ce060cbf35 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:46.198181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b169b154-ee20-449b-b630-04ce060cbf35 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:46.198945 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b169b154-ee20-449b-b630-04ce060cbf35 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:46.199378 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b169b154-ee20-449b-b630-04ce060cbf35 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:46.261488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b169b154-ee20-449b-b630-04ce060cbf35 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:46.269807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b169b154-ee20-449b-b630-04ce060cbf35 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082070 Sep 14 19:57:46.270376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1128/2224] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:46 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:47.286531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-331a393e-9ed7-49cb-b870-96e48c2cc277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:47.287171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-331a393e-9ed7-49cb-b870-96e48c2cc277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:47.292930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-331a393e-9ed7-49cb-b870-96e48c2cc277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:47.293376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-331a393e-9ed7-49cb-b870-96e48c2cc277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:47.294179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-331a393e-9ed7-49cb-b870-96e48c2cc277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:47.294616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-331a393e-9ed7-49cb-b870-96e48c2cc277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:47.354254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-331a393e-9ed7-49cb-b870-96e48c2cc277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:47.362722 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-331a393e-9ed7-49cb-b870-96e48c2cc277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079822 Sep 14 19:57:47.363314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1097/2225] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:47 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:48.380455 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-22db75e2-b6e4-4bef-8514-d2bd55a1997f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:48.381109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-22db75e2-b6e4-4bef-8514-d2bd55a1997f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:48.386882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22db75e2-b6e4-4bef-8514-d2bd55a1997f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:48.387346 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22db75e2-b6e4-4bef-8514-d2bd55a1997f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:48.388106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22db75e2-b6e4-4bef-8514-d2bd55a1997f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:48.388538 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22db75e2-b6e4-4bef-8514-d2bd55a1997f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:48.447122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-22db75e2-b6e4-4bef-8514-d2bd55a1997f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:48.454781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-22db75e2-b6e4-4bef-8514-d2bd55a1997f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078041 Sep 14 19:57:48.455340 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1129/2226] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:48 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:49.471846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e8219810-1167-41e6-8fbd-fe52352a304b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:49.472457 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e8219810-1167-41e6-8fbd-fe52352a304b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:49.478333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e8219810-1167-41e6-8fbd-fe52352a304b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:49.478782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e8219810-1167-41e6-8fbd-fe52352a304b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:49.479546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e8219810-1167-41e6-8fbd-fe52352a304b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:49.479983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e8219810-1167-41e6-8fbd-fe52352a304b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:49.538459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e8219810-1167-41e6-8fbd-fe52352a304b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:49.546417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e8219810-1167-41e6-8fbd-fe52352a304b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078788 Sep 14 19:57:49.546923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1098/2227] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:49 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:50.563461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-49a406ba-e8da-4db9-aee8-ef3c8020bb64 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:50.564064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-49a406ba-e8da-4db9-aee8-ef3c8020bb64 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:50.569825 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49a406ba-e8da-4db9-aee8-ef3c8020bb64 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:50.570271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49a406ba-e8da-4db9-aee8-ef3c8020bb64 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:50.571036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49a406ba-e8da-4db9-aee8-ef3c8020bb64 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:50.571450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49a406ba-e8da-4db9-aee8-ef3c8020bb64 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:50.630243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-49a406ba-e8da-4db9-aee8-ef3c8020bb64 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:50.637953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-49a406ba-e8da-4db9-aee8-ef3c8020bb64 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078135 Sep 14 19:57:50.638509 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1130/2228] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:50 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:51.655206 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-be9d9e91-0570-4af6-bb04-4941812ea02f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:51.655824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-be9d9e91-0570-4af6-bb04-4941812ea02f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:51.662127 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be9d9e91-0570-4af6-bb04-4941812ea02f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:51.662506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be9d9e91-0570-4af6-bb04-4941812ea02f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:51.663274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be9d9e91-0570-4af6-bb04-4941812ea02f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:51.663709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be9d9e91-0570-4af6-bb04-4941812ea02f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:51.726961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-be9d9e91-0570-4af6-bb04-4941812ea02f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:51.735745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-be9d9e91-0570-4af6-bb04-4941812ea02f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.084247 Sep 14 19:57:51.736224 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1099/2229] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:51 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:52.752692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-294a012b-4dc1-4288-99f3-b475cb2c04d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:52.753361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-294a012b-4dc1-4288-99f3-b475cb2c04d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:52.759100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-294a012b-4dc1-4288-99f3-b475cb2c04d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:52.759539 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-294a012b-4dc1-4288-99f3-b475cb2c04d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:52.760357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-294a012b-4dc1-4288-99f3-b475cb2c04d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:52.760730 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-294a012b-4dc1-4288-99f3-b475cb2c04d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:52.823517 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-294a012b-4dc1-4288-99f3-b475cb2c04d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:52.832139 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-294a012b-4dc1-4288-99f3-b475cb2c04d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.083681 Sep 14 19:57:52.832715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1131/2230] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:52 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:53.849339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bb3f1261-ecfe-496a-8725-fd86764142f2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:53.849981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bb3f1261-ecfe-496a-8725-fd86764142f2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:53.855813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb3f1261-ecfe-496a-8725-fd86764142f2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:53.856256 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb3f1261-ecfe-496a-8725-fd86764142f2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:53.857030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb3f1261-ecfe-496a-8725-fd86764142f2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:53.857463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb3f1261-ecfe-496a-8725-fd86764142f2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:53.917179 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bb3f1261-ecfe-496a-8725-fd86764142f2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:53.925255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bb3f1261-ecfe-496a-8725-fd86764142f2 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079411 Sep 14 19:57:53.925862 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1100/2231] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:53 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:54.941906 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0a67b1ed-7c1d-49e3-a031-325e546af489 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:54.942521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0a67b1ed-7c1d-49e3-a031-325e546af489 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:54.948446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a67b1ed-7c1d-49e3-a031-325e546af489 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:54.948905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a67b1ed-7c1d-49e3-a031-325e546af489 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:54.949706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a67b1ed-7c1d-49e3-a031-325e546af489 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:54.950146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a67b1ed-7c1d-49e3-a031-325e546af489 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:55.009950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0a67b1ed-7c1d-49e3-a031-325e546af489 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:55.017970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0a67b1ed-7c1d-49e3-a031-325e546af489 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079665 Sep 14 19:57:55.018787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1132/2232] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:54 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:56.040282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-75a44e69-a102-4856-8d8f-f4a03a7bfbf9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:56.040829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-75a44e69-a102-4856-8d8f-f4a03a7bfbf9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:56.047146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75a44e69-a102-4856-8d8f-f4a03a7bfbf9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:56.047584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75a44e69-a102-4856-8d8f-f4a03a7bfbf9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:56.048337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75a44e69-a102-4856-8d8f-f4a03a7bfbf9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:56.048780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75a44e69-a102-4856-8d8f-f4a03a7bfbf9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:56.110758 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-75a44e69-a102-4856-8d8f-f4a03a7bfbf9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:56.118678 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-75a44e69-a102-4856-8d8f-f4a03a7bfbf9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082194 Sep 14 19:57:56.119242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1101/2233] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:56 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:57.136063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1f6fc922-e4f1-4051-8d21-73a4e992e1be tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:57.136676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1f6fc922-e4f1-4051-8d21-73a4e992e1be tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:57.143225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f6fc922-e4f1-4051-8d21-73a4e992e1be tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:57.143672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f6fc922-e4f1-4051-8d21-73a4e992e1be tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:57.144437 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f6fc922-e4f1-4051-8d21-73a4e992e1be tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:57.144879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f6fc922-e4f1-4051-8d21-73a4e992e1be tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:57.204800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1f6fc922-e4f1-4051-8d21-73a4e992e1be tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:57.212839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1f6fc922-e4f1-4051-8d21-73a4e992e1be tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080343 Sep 14 19:57:57.213350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1133/2234] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:57 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:58.230025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3cbdae36-561d-4a42-935a-491c891b47db tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:58.230636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3cbdae36-561d-4a42-935a-491c891b47db tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:58.236530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cbdae36-561d-4a42-935a-491c891b47db tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:58.236980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cbdae36-561d-4a42-935a-491c891b47db tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:58.237835 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cbdae36-561d-4a42-935a-491c891b47db tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:58.238278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cbdae36-561d-4a42-935a-491c891b47db tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:58.300183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3cbdae36-561d-4a42-935a-491c891b47db tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:58.308364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3cbdae36-561d-4a42-935a-491c891b47db tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081994 Sep 14 19:57:58.308943 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1102/2235] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:58 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:59.324699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-accc1841-4a49-4083-a666-0a3406e1e35c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:59.325321 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-accc1841-4a49-4083-a666-0a3406e1e35c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:57:59.331150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-accc1841-4a49-4083-a666-0a3406e1e35c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:59.331598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-accc1841-4a49-4083-a666-0a3406e1e35c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:59.332360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-accc1841-4a49-4083-a666-0a3406e1e35c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:57:59.332797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-accc1841-4a49-4083-a666-0a3406e1e35c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:57:59.394519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-accc1841-4a49-4083-a666-0a3406e1e35c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:59.402380 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-accc1841-4a49-4083-a666-0a3406e1e35c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081321 Sep 14 19:57:59.402957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1134/2236] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:57:59 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:00.418887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e69d9456-019e-4426-8600-05e9ea7ed17e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:00.419522 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e69d9456-019e-4426-8600-05e9ea7ed17e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:00.426113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e69d9456-019e-4426-8600-05e9ea7ed17e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:00.426564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e69d9456-019e-4426-8600-05e9ea7ed17e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:00.427331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e69d9456-019e-4426-8600-05e9ea7ed17e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:00.427770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e69d9456-019e-4426-8600-05e9ea7ed17e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:00.487483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e69d9456-019e-4426-8600-05e9ea7ed17e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:00.495529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e69d9456-019e-4426-8600-05e9ea7ed17e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080360 Sep 14 19:58:00.496099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1103/2237] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:00 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:01.513325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1a5ad52c-b852-4b84-8d4a-13dbcaaf8b91 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:01.517602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1a5ad52c-b852-4b84-8d4a-13dbcaaf8b91 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:01.520417 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a5ad52c-b852-4b84-8d4a-13dbcaaf8b91 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:01.520870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a5ad52c-b852-4b84-8d4a-13dbcaaf8b91 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:01.521673 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a5ad52c-b852-4b84-8d4a-13dbcaaf8b91 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:01.522125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1a5ad52c-b852-4b84-8d4a-13dbcaaf8b91 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:01.581950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1a5ad52c-b852-4b84-8d4a-13dbcaaf8b91 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:01.589902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1a5ad52c-b852-4b84-8d4a-13dbcaaf8b91 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080196 Sep 14 19:58:01.590481 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1135/2238] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:01 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:02.606926 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3ad70e00-1dbe-4275-8542-58ed29461031 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:02.607557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3ad70e00-1dbe-4275-8542-58ed29461031 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:02.614072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3ad70e00-1dbe-4275-8542-58ed29461031 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:02.614637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3ad70e00-1dbe-4275-8542-58ed29461031 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:02.615379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3ad70e00-1dbe-4275-8542-58ed29461031 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:02.615815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3ad70e00-1dbe-4275-8542-58ed29461031 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:02.676561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3ad70e00-1dbe-4275-8542-58ed29461031 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:02.684506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3ad70e00-1dbe-4275-8542-58ed29461031 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081294 Sep 14 19:58:02.685085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1104/2239] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:02 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:03.701352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9a0cf0ec-6204-4b2a-ac7b-b706974aa693 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:03.701998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9a0cf0ec-6204-4b2a-ac7b-b706974aa693 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:03.708245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a0cf0ec-6204-4b2a-ac7b-b706974aa693 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:03.708687 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a0cf0ec-6204-4b2a-ac7b-b706974aa693 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:03.709465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a0cf0ec-6204-4b2a-ac7b-b706974aa693 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:03.709940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a0cf0ec-6204-4b2a-ac7b-b706974aa693 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:03.773761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9a0cf0ec-6204-4b2a-ac7b-b706974aa693 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:03.782219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9a0cf0ec-6204-4b2a-ac7b-b706974aa693 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.084630 Sep 14 19:58:03.782780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1136/2240] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:03 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:04.798209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4932d6d4-7cf8-46f9-93a2-ec9e69166614 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:04.798770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4932d6d4-7cf8-46f9-93a2-ec9e69166614 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:04.804937 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4932d6d4-7cf8-46f9-93a2-ec9e69166614 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:04.805384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4932d6d4-7cf8-46f9-93a2-ec9e69166614 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:04.806187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4932d6d4-7cf8-46f9-93a2-ec9e69166614 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:04.806628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4932d6d4-7cf8-46f9-93a2-ec9e69166614 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:04.869783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4932d6d4-7cf8-46f9-93a2-ec9e69166614 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:04.878131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4932d6d4-7cf8-46f9-93a2-ec9e69166614 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.083701 Sep 14 19:58:04.878688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1105/2241] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:04 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:05.896134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-50296943-5604-49f6-860d-8f44391f051f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:05.896749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-50296943-5604-49f6-860d-8f44391f051f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:05.902592 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50296943-5604-49f6-860d-8f44391f051f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:05.903042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50296943-5604-49f6-860d-8f44391f051f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:05.903813 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50296943-5604-49f6-860d-8f44391f051f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:05.904255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-50296943-5604-49f6-860d-8f44391f051f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:05.964029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-50296943-5604-49f6-860d-8f44391f051f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:05.971636 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-50296943-5604-49f6-860d-8f44391f051f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079707 Sep 14 19:58:05.972192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1137/2242] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:05 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:06.987830 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8dd39e74-4ab4-4836-bb71-4d02b45acc25 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:06.988432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8dd39e74-4ab4-4836-bb71-4d02b45acc25 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:06.994299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8dd39e74-4ab4-4836-bb71-4d02b45acc25 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:06.994733 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8dd39e74-4ab4-4836-bb71-4d02b45acc25 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:06.995488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8dd39e74-4ab4-4836-bb71-4d02b45acc25 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:06.995908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8dd39e74-4ab4-4836-bb71-4d02b45acc25 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:07.058222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8dd39e74-4ab4-4836-bb71-4d02b45acc25 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:07.067001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8dd39e74-4ab4-4836-bb71-4d02b45acc25 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082674 Sep 14 19:58:07.067580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1106/2243] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:06 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:08.084335 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-85562a64-1f45-42dc-8bc2-56485cdb430b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:08.084953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-85562a64-1f45-42dc-8bc2-56485cdb430b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:08.090859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85562a64-1f45-42dc-8bc2-56485cdb430b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:08.091260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85562a64-1f45-42dc-8bc2-56485cdb430b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:08.092026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85562a64-1f45-42dc-8bc2-56485cdb430b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:08.092468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-85562a64-1f45-42dc-8bc2-56485cdb430b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:08.150327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-85562a64-1f45-42dc-8bc2-56485cdb430b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:08.158631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-85562a64-1f45-42dc-8bc2-56485cdb430b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078027 Sep 14 19:58:08.159201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1138/2244] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:08 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:09.176395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d156d371-266c-4feb-9048-54c457fee116 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:09.177164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d156d371-266c-4feb-9048-54c457fee116 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:09.183252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d156d371-266c-4feb-9048-54c457fee116 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:09.183698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d156d371-266c-4feb-9048-54c457fee116 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:09.184471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d156d371-266c-4feb-9048-54c457fee116 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:09.184908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d156d371-266c-4feb-9048-54c457fee116 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:09.246457 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d156d371-266c-4feb-9048-54c457fee116 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:09.254530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d156d371-266c-4feb-9048-54c457fee116 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082179 Sep 14 19:58:09.255105 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1107/2245] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:09 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:10.271383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-552ff420-9b8c-4c84-8382-71c7b65bc210 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:10.271967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-552ff420-9b8c-4c84-8382-71c7b65bc210 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:10.277919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-552ff420-9b8c-4c84-8382-71c7b65bc210 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:10.278362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-552ff420-9b8c-4c84-8382-71c7b65bc210 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:10.279116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-552ff420-9b8c-4c84-8382-71c7b65bc210 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:10.279547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-552ff420-9b8c-4c84-8382-71c7b65bc210 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:10.342099 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-552ff420-9b8c-4c84-8382-71c7b65bc210 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:10.349872 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-552ff420-9b8c-4c84-8382-71c7b65bc210 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082086 Sep 14 19:58:10.350365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1139/2246] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:10 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:11.367192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ad45a71b-70e4-4d07-9a6b-e9e518ae2de8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:11.368079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ad45a71b-70e4-4d07-9a6b-e9e518ae2de8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:11.373942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad45a71b-70e4-4d07-9a6b-e9e518ae2de8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:11.374879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad45a71b-70e4-4d07-9a6b-e9e518ae2de8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:11.375638 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad45a71b-70e4-4d07-9a6b-e9e518ae2de8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:11.376068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad45a71b-70e4-4d07-9a6b-e9e518ae2de8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:11.435434 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ad45a71b-70e4-4d07-9a6b-e9e518ae2de8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:11.443775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ad45a71b-70e4-4d07-9a6b-e9e518ae2de8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080287 Sep 14 19:58:11.444340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1108/2247] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:11 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:11.585351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1c7d02d2-a179-4dd2-ab2c-df43a9f2cfb2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:11.585898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1c7d02d2-a179-4dd2-ab2c-df43a9f2cfb2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:11.591649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c7d02d2-a179-4dd2-ab2c-df43a9f2cfb2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:11.592095 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c7d02d2-a179-4dd2-ab2c-df43a9f2cfb2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:11.592863 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c7d02d2-a179-4dd2-ab2c-df43a9f2cfb2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:11.593302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c7d02d2-a179-4dd2-ab2c-df43a9f2cfb2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:11.617388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1c7d02d2-a179-4dd2-ab2c-df43a9f2cfb2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Going to try to terminate instance {{(pid=115678) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 19:58:11.899485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1c7d02d2-a179-4dd2-ab2c-df43a9f2cfb2 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 204 len: 0 microversion: 2.1 time: 0.317440 Sep 14 19:58:11.900083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1140/2248] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 19:58:11 2021] DELETE /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:58:11.908276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f7856ede-1606-41f5-b936-b33431f5e880 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:11.908895 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f7856ede-1606-41f5-b936-b33431f5e880 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:11.914881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7856ede-1606-41f5-b936-b33431f5e880 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:11.915322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7856ede-1606-41f5-b936-b33431f5e880 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:11.916087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7856ede-1606-41f5-b936-b33431f5e880 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:11.916518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7856ede-1606-41f5-b936-b33431f5e880 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:12.040007 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f7856ede-1606-41f5-b936-b33431f5e880 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:12.047364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f7856ede-1606-41f5-b936-b33431f5e880 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1671 microversion: 2.1 time: 0.142787 Sep 14 19:58:12.047933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1109/2249] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:11 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1671 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:12.461152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-40c4e788-33f9-42d2-a1f8-4e80680b9a5f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:12.461815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-40c4e788-33f9-42d2-a1f8-4e80680b9a5f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:12.468944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40c4e788-33f9-42d2-a1f8-4e80680b9a5f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:12.469401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40c4e788-33f9-42d2-a1f8-4e80680b9a5f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:12.470210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40c4e788-33f9-42d2-a1f8-4e80680b9a5f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:12.470665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-40c4e788-33f9-42d2-a1f8-4e80680b9a5f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:12.555784 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-40c4e788-33f9-42d2-a1f8-4e80680b9a5f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:12.565523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-40c4e788-33f9-42d2-a1f8-4e80680b9a5f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.108438 Sep 14 19:58:12.566116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1141/2250] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:12 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:13.066580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-85c39da5-8f43-4f58-bf93-0a8db7a1d166 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:13.067258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-85c39da5-8f43-4f58-bf93-0a8db7a1d166 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:13.073228 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85c39da5-8f43-4f58-bf93-0a8db7a1d166 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:13.073967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85c39da5-8f43-4f58-bf93-0a8db7a1d166 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:13.074745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85c39da5-8f43-4f58-bf93-0a8db7a1d166 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:13.075177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-85c39da5-8f43-4f58-bf93-0a8db7a1d166 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:13.141705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-85c39da5-8f43-4f58-bf93-0a8db7a1d166 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:13.149150 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-85c39da5-8f43-4f58-bf93-0a8db7a1d166 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1603 microversion: 2.1 time: 0.086229 Sep 14 19:58:13.152849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1110/2251] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:13 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1603 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:13.344029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-34d45cbc-d852-49ea-b677-e80241bb6435 req-4caeb798-e059-4b6c-a713-cf22f3e2560e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e617ad6d-c91d-4057-afb6-d220eb42ef28", "name": "network-vif-deleted", "tag": "f3696efd-758e-4203-88ab-508f85e16b9d"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:13.346865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:58:13.346865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 19:58:13.354012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-34d45cbc-d852-49ea-b677-e80241bb6435 req-4caeb798-e059-4b6c-a713-cf22f3e2560e service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:13.354564 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-34d45cbc-d852-49ea-b677-e80241bb6435 req-4caeb798-e059-4b6c-a713-cf22f3e2560e service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:13.366566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-34d45cbc-d852-49ea-b677-e80241bb6435 req-4caeb798-e059-4b6c-a713-cf22f3e2560e service nova] Creating event network-vif-deleted:f3696efd-758e-4203-88ab-508f85e16b9d for instance e617ad6d-c91d-4057-afb6-d220eb42ef28 on hv-cinder-80588 Sep 14 19:58:13.372191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-34d45cbc-d852-49ea-b677-e80241bb6435 req-4caeb798-e059-4b6c-a713-cf22f3e2560e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031743 Sep 14 19:58:13.372789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1142/2252] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:58:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:58:13.583982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a2279bdf-c1c9-4003-8d92-1e063b22d026 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:13.584676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a2279bdf-c1c9-4003-8d92-1e063b22d026 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:13.591010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2279bdf-c1c9-4003-8d92-1e063b22d026 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:13.591449 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2279bdf-c1c9-4003-8d92-1e063b22d026 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:13.592252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2279bdf-c1c9-4003-8d92-1e063b22d026 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:13.592704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2279bdf-c1c9-4003-8d92-1e063b22d026 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:13.660855 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a2279bdf-c1c9-4003-8d92-1e063b22d026 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:13.671346 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a2279bdf-c1c9-4003-8d92-1e063b22d026 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.090899 Sep 14 19:58:13.671959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1111/2253] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:13 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:14.167695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:14.168925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:14.175645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:14.176085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:14.176866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:14.177296 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:14.215203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:14.215931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:14.216544 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lazy-loading 'fault' on Instance uuid e617ad6d-c91d-4057-afb6-d220eb42ef28 {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 19:58:14.262443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698509e250034b698e057bacbf44393d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a684e190277744a3b1786dc4bf5fe1e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:14.271191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c37e96e6-5a57-4fbf-8204-179521d5ceb4 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 200 len: 1325 microversion: 2.1 time: 0.107606 Sep 14 19:58:14.271892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1143/2254] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:14 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 1325 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:14.690519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-976c3bd0-7bc7-4109-a39a-3595ee3253d1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:14.691121 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-976c3bd0-7bc7-4109-a39a-3595ee3253d1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:14.696739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-976c3bd0-7bc7-4109-a39a-3595ee3253d1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:14.697175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-976c3bd0-7bc7-4109-a39a-3595ee3253d1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:14.697986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-976c3bd0-7bc7-4109-a39a-3595ee3253d1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:14.698411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-976c3bd0-7bc7-4109-a39a-3595ee3253d1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:14.766431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-976c3bd0-7bc7-4109-a39a-3595ee3253d1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:14.774130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-976c3bd0-7bc7-4109-a39a-3595ee3253d1 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.088050 Sep 14 19:58:14.774682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1112/2255] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:14 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:15.288748 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-09e922a5-6ab6-46ae-8a97-a38c90516872 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:15.289364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-09e922a5-6ab6-46ae-8a97-a38c90516872 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:15.295217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-09e922a5-6ab6-46ae-8a97-a38c90516872 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:15.295659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-09e922a5-6ab6-46ae-8a97-a38c90516872 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:15.296999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-09e922a5-6ab6-46ae-8a97-a38c90516872 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:15.297434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-09e922a5-6ab6-46ae-8a97-a38c90516872 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:15.311002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-09e922a5-6ab6-46ae-8a97-a38c90516872 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] HTTP exception thrown: Instance e617ad6d-c91d-4057-afb6-d220eb42ef28 could not be found. Sep 14 19:58:15.311596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-09e922a5-6ab6-46ae-8a97-a38c90516872 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Returning 404 to user: Instance e617ad6d-c91d-4057-afb6-d220eb42ef28 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:58:15.312425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-09e922a5-6ab6-46ae-8a97-a38c90516872 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 404 len: 111 microversion: 2.1 time: 0.027401 Sep 14 19:58:15.312963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1144/2256] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:15 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:58:15.321089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1c8acd7a-5d5e-4b2f-9b50-4830c519486d tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '.version_select at 0x7fd0c8552ca0>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:15.394318 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1c8acd7a-5d5e-4b2f-9b50-4830c519486d tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-992678241" status: 202 len: 0 microversion: 2.1 time: 0.076762 Sep 14 19:58:15.394899 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1113/2257] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Sep 14 19:58:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-992678241 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:58:15.790971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b99e4a89-5410-411d-bb5c-abbb4c5bd277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:15.791608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b99e4a89-5410-411d-bb5c-abbb4c5bd277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:15.801348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b99e4a89-5410-411d-bb5c-abbb4c5bd277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:15.801853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b99e4a89-5410-411d-bb5c-abbb4c5bd277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:15.802914 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b99e4a89-5410-411d-bb5c-abbb4c5bd277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:15.803375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b99e4a89-5410-411d-bb5c-abbb4c5bd277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:15.869742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b99e4a89-5410-411d-bb5c-abbb4c5bd277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:15.879421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b99e4a89-5410-411d-bb5c-abbb4c5bd277 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.092099 Sep 14 19:58:15.880159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1145/2258] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:15 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:16.896379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c31050c6-f8d8-4569-aa72-e4d39153fcd6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:16.896980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c31050c6-f8d8-4569-aa72-e4d39153fcd6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:16.902929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c31050c6-f8d8-4569-aa72-e4d39153fcd6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:16.903374 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c31050c6-f8d8-4569-aa72-e4d39153fcd6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:16.904166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c31050c6-f8d8-4569-aa72-e4d39153fcd6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:16.904600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c31050c6-f8d8-4569-aa72-e4d39153fcd6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:16.966090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c31050c6-f8d8-4569-aa72-e4d39153fcd6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:16.974556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c31050c6-f8d8-4569-aa72-e4d39153fcd6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082027 Sep 14 19:58:16.975067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1114/2259] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:16 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:17.991267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ff7177be-7199-42b7-bacf-8eaac0b7ca6c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:17.991876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ff7177be-7199-42b7-bacf-8eaac0b7ca6c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:17.998136 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff7177be-7199-42b7-bacf-8eaac0b7ca6c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:17.998591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff7177be-7199-42b7-bacf-8eaac0b7ca6c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:17.999409 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff7177be-7199-42b7-bacf-8eaac0b7ca6c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:17.999894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ff7177be-7199-42b7-bacf-8eaac0b7ca6c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:18.060523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ff7177be-7199-42b7-bacf-8eaac0b7ca6c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:18.068427 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ff7177be-7199-42b7-bacf-8eaac0b7ca6c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080773 Sep 14 19:58:18.068968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1146/2260] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:17 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:19.084149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cbd3fdd3-4fa2-44a5-bf7d-c39ee2456f9e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:19.084819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cbd3fdd3-4fa2-44a5-bf7d-c39ee2456f9e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:19.090629 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbd3fdd3-4fa2-44a5-bf7d-c39ee2456f9e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:19.091078 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbd3fdd3-4fa2-44a5-bf7d-c39ee2456f9e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:19.091851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbd3fdd3-4fa2-44a5-bf7d-c39ee2456f9e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:19.092291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbd3fdd3-4fa2-44a5-bf7d-c39ee2456f9e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:19.151849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cbd3fdd3-4fa2-44a5-bf7d-c39ee2456f9e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:19.159475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cbd3fdd3-4fa2-44a5-bf7d-c39ee2456f9e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079060 Sep 14 19:58:19.160065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1115/2261] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:19 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:20.176129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-52e78a38-face-41ae-a1d6-19eaea1e2819 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:20.176710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-52e78a38-face-41ae-a1d6-19eaea1e2819 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:20.182505 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52e78a38-face-41ae-a1d6-19eaea1e2819 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:20.182960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52e78a38-face-41ae-a1d6-19eaea1e2819 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:20.183726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52e78a38-face-41ae-a1d6-19eaea1e2819 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:20.184168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52e78a38-face-41ae-a1d6-19eaea1e2819 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:20.245133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-52e78a38-face-41ae-a1d6-19eaea1e2819 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:20.253462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-52e78a38-face-41ae-a1d6-19eaea1e2819 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081295 Sep 14 19:58:20.254044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1147/2262] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:20 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:21.270157 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0b661d1a-eff2-4966-8c42-e090f6496e00 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:21.270775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0b661d1a-eff2-4966-8c42-e090f6496e00 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:21.276722 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b661d1a-eff2-4966-8c42-e090f6496e00 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:21.277398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b661d1a-eff2-4966-8c42-e090f6496e00 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:21.278197 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b661d1a-eff2-4966-8c42-e090f6496e00 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:21.278634 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b661d1a-eff2-4966-8c42-e090f6496e00 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:21.341905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0b661d1a-eff2-4966-8c42-e090f6496e00 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:21.350375 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0b661d1a-eff2-4966-8c42-e090f6496e00 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.083933 Sep 14 19:58:21.350942 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1116/2263] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:21 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:22.366253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-833b71d6-904c-453c-a71f-bfdc17db36a7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:22.366926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-833b71d6-904c-453c-a71f-bfdc17db36a7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:22.372727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-833b71d6-904c-453c-a71f-bfdc17db36a7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:22.373179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-833b71d6-904c-453c-a71f-bfdc17db36a7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:22.374630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-833b71d6-904c-453c-a71f-bfdc17db36a7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:22.375114 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-833b71d6-904c-453c-a71f-bfdc17db36a7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:22.440627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-833b71d6-904c-453c-a71f-bfdc17db36a7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:22.449459 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-833b71d6-904c-453c-a71f-bfdc17db36a7 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.086530 Sep 14 19:58:22.449788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1148/2264] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:22 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:23.465192 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-58bfbc20-9f61-42d5-821b-c9394be14387 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:23.465864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-58bfbc20-9f61-42d5-821b-c9394be14387 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:23.472376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58bfbc20-9f61-42d5-821b-c9394be14387 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:23.472821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58bfbc20-9f61-42d5-821b-c9394be14387 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:23.473638 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58bfbc20-9f61-42d5-821b-c9394be14387 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:23.474076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-58bfbc20-9f61-42d5-821b-c9394be14387 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:23.533186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-58bfbc20-9f61-42d5-821b-c9394be14387 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:23.540981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-58bfbc20-9f61-42d5-821b-c9394be14387 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079451 Sep 14 19:58:23.541563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1117/2265] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:23 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:24.558393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4f1bf9c5-1cdd-413e-95ad-61ee1cf0120d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:24.559018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4f1bf9c5-1cdd-413e-95ad-61ee1cf0120d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:24.564902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f1bf9c5-1cdd-413e-95ad-61ee1cf0120d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:24.565350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f1bf9c5-1cdd-413e-95ad-61ee1cf0120d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:24.566157 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f1bf9c5-1cdd-413e-95ad-61ee1cf0120d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:24.566587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f1bf9c5-1cdd-413e-95ad-61ee1cf0120d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:24.628908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4f1bf9c5-1cdd-413e-95ad-61ee1cf0120d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:24.636887 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4f1bf9c5-1cdd-413e-95ad-61ee1cf0120d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082019 Sep 14 19:58:24.637450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1149/2266] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:24 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:25.654461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-273c3695-f9df-49f5-85ae-a4e9cf3b101b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:25.655610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-273c3695-f9df-49f5-85ae-a4e9cf3b101b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:25.661522 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-273c3695-f9df-49f5-85ae-a4e9cf3b101b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:25.661978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-273c3695-f9df-49f5-85ae-a4e9cf3b101b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:25.662818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-273c3695-f9df-49f5-85ae-a4e9cf3b101b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:25.663183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-273c3695-f9df-49f5-85ae-a4e9cf3b101b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:25.724904 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-273c3695-f9df-49f5-85ae-a4e9cf3b101b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:25.732616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-273c3695-f9df-49f5-85ae-a4e9cf3b101b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081899 Sep 14 19:58:25.733922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1118/2267] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:25 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:26.750663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-17dec066-be01-4ef6-93c7-848e69563d44 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:26.751370 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-17dec066-be01-4ef6-93c7-848e69563d44 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:26.757230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17dec066-be01-4ef6-93c7-848e69563d44 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:26.757744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17dec066-be01-4ef6-93c7-848e69563d44 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:26.758521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17dec066-be01-4ef6-93c7-848e69563d44 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:26.758964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-17dec066-be01-4ef6-93c7-848e69563d44 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:26.820554 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-17dec066-be01-4ef6-93c7-848e69563d44 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:26.828583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-17dec066-be01-4ef6-93c7-848e69563d44 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082238 Sep 14 19:58:26.829147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1150/2268] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:26 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:27.845673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3d76ee52-359d-4c6e-beb7-cc83c07e0d86 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:27.846385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3d76ee52-359d-4c6e-beb7-cc83c07e0d86 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:27.852872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d76ee52-359d-4c6e-beb7-cc83c07e0d86 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:27.853314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d76ee52-359d-4c6e-beb7-cc83c07e0d86 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:27.854119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d76ee52-359d-4c6e-beb7-cc83c07e0d86 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:27.854548 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d76ee52-359d-4c6e-beb7-cc83c07e0d86 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:27.915921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3d76ee52-359d-4c6e-beb7-cc83c07e0d86 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:27.923794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3d76ee52-359d-4c6e-beb7-cc83c07e0d86 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081735 Sep 14 19:58:27.924355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1119/2269] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:27 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:28.940503 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b04c3225-bbe8-4def-8bad-1f8723046e39 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:28.941106 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b04c3225-bbe8-4def-8bad-1f8723046e39 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:28.947041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b04c3225-bbe8-4def-8bad-1f8723046e39 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:28.947493 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b04c3225-bbe8-4def-8bad-1f8723046e39 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:28.948341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b04c3225-bbe8-4def-8bad-1f8723046e39 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:28.948781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b04c3225-bbe8-4def-8bad-1f8723046e39 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:29.008958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b04c3225-bbe8-4def-8bad-1f8723046e39 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:29.017304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b04c3225-bbe8-4def-8bad-1f8723046e39 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080803 Sep 14 19:58:29.019257 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1151/2270] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:28 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:30.034595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0b2379d3-4a3d-4da8-9c63-9cb2ab036ae5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:30.035240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0b2379d3-4a3d-4da8-9c63-9cb2ab036ae5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:30.041229 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b2379d3-4a3d-4da8-9c63-9cb2ab036ae5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:30.041725 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b2379d3-4a3d-4da8-9c63-9cb2ab036ae5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:30.042501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b2379d3-4a3d-4da8-9c63-9cb2ab036ae5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:30.042940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b2379d3-4a3d-4da8-9c63-9cb2ab036ae5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:30.102868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0b2379d3-4a3d-4da8-9c63-9cb2ab036ae5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:30.111467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0b2379d3-4a3d-4da8-9c63-9cb2ab036ae5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080621 Sep 14 19:58:30.112038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1120/2271] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:30 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:31.129173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8fe9a855-2286-436a-9ec4-92b38b3e97b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:31.129806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8fe9a855-2286-436a-9ec4-92b38b3e97b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:31.135697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8fe9a855-2286-436a-9ec4-92b38b3e97b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:31.136138 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8fe9a855-2286-436a-9ec4-92b38b3e97b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:31.136908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8fe9a855-2286-436a-9ec4-92b38b3e97b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:31.137365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8fe9a855-2286-436a-9ec4-92b38b3e97b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:31.197858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8fe9a855-2286-436a-9ec4-92b38b3e97b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:31.205442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8fe9a855-2286-436a-9ec4-92b38b3e97b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080333 Sep 14 19:58:31.206027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1152/2272] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:31 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:32.222092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d6208eff-bc13-44f0-9b55-efd73fbeae6a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:32.222717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d6208eff-bc13-44f0-9b55-efd73fbeae6a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:32.228573 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6208eff-bc13-44f0-9b55-efd73fbeae6a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:32.229021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6208eff-bc13-44f0-9b55-efd73fbeae6a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:32.229818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6208eff-bc13-44f0-9b55-efd73fbeae6a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:32.230259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d6208eff-bc13-44f0-9b55-efd73fbeae6a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:32.292367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d6208eff-bc13-44f0-9b55-efd73fbeae6a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:32.301094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d6208eff-bc13-44f0-9b55-efd73fbeae6a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082545 Sep 14 19:58:32.301622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1121/2273] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:32 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:33.317826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-217227e1-95df-495c-a479-178f9d25164c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:33.318540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-217227e1-95df-495c-a479-178f9d25164c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:33.324654 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-217227e1-95df-495c-a479-178f9d25164c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:33.325104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-217227e1-95df-495c-a479-178f9d25164c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:33.325918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-217227e1-95df-495c-a479-178f9d25164c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:33.326885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-217227e1-95df-495c-a479-178f9d25164c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:33.391846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-217227e1-95df-495c-a479-178f9d25164c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:33.400572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-217227e1-95df-495c-a479-178f9d25164c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.086510 Sep 14 19:58:33.401153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1153/2274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:33 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:34.417892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-622159ca-0d7f-4419-901b-4b16f5ef4c5d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:34.418453 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-622159ca-0d7f-4419-901b-4b16f5ef4c5d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:34.424290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-622159ca-0d7f-4419-901b-4b16f5ef4c5d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:34.424990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-622159ca-0d7f-4419-901b-4b16f5ef4c5d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:34.425772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-622159ca-0d7f-4419-901b-4b16f5ef4c5d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:34.426236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-622159ca-0d7f-4419-901b-4b16f5ef4c5d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:34.489102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-622159ca-0d7f-4419-901b-4b16f5ef4c5d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:34.497329 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-622159ca-0d7f-4419-901b-4b16f5ef4c5d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.083048 Sep 14 19:58:34.497844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1122/2275] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:34 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:35.518485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e8ed0753-9192-460c-bec8-184b6c49c1d3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:35.519683 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e8ed0753-9192-460c-bec8-184b6c49c1d3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:35.530827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8ed0753-9192-460c-bec8-184b6c49c1d3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:35.531666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8ed0753-9192-460c-bec8-184b6c49c1d3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:35.533073 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8ed0753-9192-460c-bec8-184b6c49c1d3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:35.533917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e8ed0753-9192-460c-bec8-184b6c49c1d3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:35.623174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e8ed0753-9192-460c-bec8-184b6c49c1d3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:35.631185 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e8ed0753-9192-460c-bec8-184b6c49c1d3 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.119872 Sep 14 19:58:35.631768 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1154/2276] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:35 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:36.648697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7b86b858-52e5-4af7-8c16-fa78fd788c7f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:36.649287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7b86b858-52e5-4af7-8c16-fa78fd788c7f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:36.655862 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b86b858-52e5-4af7-8c16-fa78fd788c7f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:36.656309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b86b858-52e5-4af7-8c16-fa78fd788c7f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:36.657066 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b86b858-52e5-4af7-8c16-fa78fd788c7f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:36.657524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b86b858-52e5-4af7-8c16-fa78fd788c7f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:36.715982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7b86b858-52e5-4af7-8c16-fa78fd788c7f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:36.723888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7b86b858-52e5-4af7-8c16-fa78fd788c7f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078879 Sep 14 19:58:36.724445 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1123/2277] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:36 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:37.741599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-71096cf8-4ba0-423e-acf7-a30aaeb2eea5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:37.742216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-71096cf8-4ba0-423e-acf7-a30aaeb2eea5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:37.748172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-71096cf8-4ba0-423e-acf7-a30aaeb2eea5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:37.748620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-71096cf8-4ba0-423e-acf7-a30aaeb2eea5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:37.749554 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-71096cf8-4ba0-423e-acf7-a30aaeb2eea5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:37.749998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-71096cf8-4ba0-423e-acf7-a30aaeb2eea5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:37.817012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-71096cf8-4ba0-423e-acf7-a30aaeb2eea5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:37.825473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-71096cf8-4ba0-423e-acf7-a30aaeb2eea5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.088226 Sep 14 19:58:37.826136 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1155/2278] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:37 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:38.843377 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9fd41fba-73c0-41ce-9d77-64d5d79ed7f9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:38.844023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9fd41fba-73c0-41ce-9d77-64d5d79ed7f9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:38.850139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9fd41fba-73c0-41ce-9d77-64d5d79ed7f9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:38.850587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9fd41fba-73c0-41ce-9d77-64d5d79ed7f9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:38.851372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9fd41fba-73c0-41ce-9d77-64d5d79ed7f9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:38.851806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9fd41fba-73c0-41ce-9d77-64d5d79ed7f9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:38.916805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9fd41fba-73c0-41ce-9d77-64d5d79ed7f9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:38.925865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9fd41fba-73c0-41ce-9d77-64d5d79ed7f9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.086059 Sep 14 19:58:38.926431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1124/2279] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:38 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:39.942671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-10844a7a-f447-4434-97d9-d1f31ade9326 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:39.943282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-10844a7a-f447-4434-97d9-d1f31ade9326 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:39.949209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10844a7a-f447-4434-97d9-d1f31ade9326 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:39.949729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10844a7a-f447-4434-97d9-d1f31ade9326 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:39.950505 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10844a7a-f447-4434-97d9-d1f31ade9326 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:39.950936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-10844a7a-f447-4434-97d9-d1f31ade9326 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:40.011726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-10844a7a-f447-4434-97d9-d1f31ade9326 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:40.021625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-10844a7a-f447-4434-97d9-d1f31ade9326 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081287 Sep 14 19:58:40.021625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1156/2280] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:39 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:41.037856 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2d00cb5e-1010-4fde-8d43-b0d9d3f54d51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:41.038394 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2d00cb5e-1010-4fde-8d43-b0d9d3f54d51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:41.044401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d00cb5e-1010-4fde-8d43-b0d9d3f54d51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:41.044850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d00cb5e-1010-4fde-8d43-b0d9d3f54d51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:41.045653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d00cb5e-1010-4fde-8d43-b0d9d3f54d51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:41.046133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2d00cb5e-1010-4fde-8d43-b0d9d3f54d51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:41.106763 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2d00cb5e-1010-4fde-8d43-b0d9d3f54d51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:41.115175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2d00cb5e-1010-4fde-8d43-b0d9d3f54d51 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081114 Sep 14 19:58:41.115738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1125/2281] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:41 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:42.132496 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f6ad22dc-f1ee-4de2-82e6-62f60dce9758 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:42.133135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f6ad22dc-f1ee-4de2-82e6-62f60dce9758 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:42.138968 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6ad22dc-f1ee-4de2-82e6-62f60dce9758 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:42.139418 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6ad22dc-f1ee-4de2-82e6-62f60dce9758 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:42.140775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6ad22dc-f1ee-4de2-82e6-62f60dce9758 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:42.141214 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f6ad22dc-f1ee-4de2-82e6-62f60dce9758 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:42.200854 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f6ad22dc-f1ee-4de2-82e6-62f60dce9758 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:42.209714 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f6ad22dc-f1ee-4de2-82e6-62f60dce9758 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081396 Sep 14 19:58:42.210281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1157/2282] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:42 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:43.226890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-23626219-9532-49c5-8f7e-9a07c472ed4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:43.227735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-23626219-9532-49c5-8f7e-9a07c472ed4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:43.233331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23626219-9532-49c5-8f7e-9a07c472ed4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:43.233819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23626219-9532-49c5-8f7e-9a07c472ed4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:43.234595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23626219-9532-49c5-8f7e-9a07c472ed4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:43.235025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23626219-9532-49c5-8f7e-9a07c472ed4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:43.301416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-23626219-9532-49c5-8f7e-9a07c472ed4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:43.311825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-23626219-9532-49c5-8f7e-9a07c472ed4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.088773 Sep 14 19:58:43.312439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1126/2283] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:43 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:44.011077 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d807ef82-7962-4f89-aa37-6142a395ee05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:44.011598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d807ef82-7962-4f89-aa37-6142a395ee05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:44.017756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d807ef82-7962-4f89-aa37-6142a395ee05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:44.018203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d807ef82-7962-4f89-aa37-6142a395ee05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:44.019014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d807ef82-7962-4f89-aa37-6142a395ee05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:44.019457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d807ef82-7962-4f89-aa37-6142a395ee05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:44.044435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d807ef82-7962-4f89-aa37-6142a395ee05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Going to try to terminate instance {{(pid=115678) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 19:58:44.328737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-20cf52d6-ef55-4f89-9e32-db1d97b7bf8a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:44.331868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-20cf52d6-ef55-4f89-9e32-db1d97b7bf8a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:44.334967 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20cf52d6-ef55-4f89-9e32-db1d97b7bf8a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:44.335418 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20cf52d6-ef55-4f89-9e32-db1d97b7bf8a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:44.336197 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20cf52d6-ef55-4f89-9e32-db1d97b7bf8a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:44.336634 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-20cf52d6-ef55-4f89-9e32-db1d97b7bf8a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:44.381809 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d807ef82-7962-4f89-aa37-6142a395ee05 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "DELETE /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 204 len: 0 microversion: 2.20 time: 0.374160 Sep 14 19:58:44.382532 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1158/2284] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Sep 14 19:58:44 2021] DELETE /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 19:58:44.391412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-60688722-6515-4204-8d27-7c135262cf5d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:44.392116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-60688722-6515-4204-8d27-7c135262cf5d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:44.398526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60688722-6515-4204-8d27-7c135262cf5d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:44.398967 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60688722-6515-4204-8d27-7c135262cf5d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:44.399456 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-20cf52d6-ef55-4f89-9e32-db1d97b7bf8a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:44.399799 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60688722-6515-4204-8d27-7c135262cf5d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:44.400318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60688722-6515-4204-8d27-7c135262cf5d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:44.408134 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-20cf52d6-ef55-4f89-9e32-db1d97b7bf8a tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.083783 Sep 14 19:58:44.408711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1127/2285] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:44 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:44.534753 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-60688722-6515-4204-8d27-7c135262cf5d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:44.543412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-60688722-6515-4204-8d27-7c135262cf5d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:44.544896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-60688722-6515-4204-8d27-7c135262cf5d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:44.546200 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-60688722-6515-4204-8d27-7c135262cf5d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1800 microversion: 2.20 time: 0.158898 Sep 14 19:58:44.546991 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1159/2286] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:58:45.427738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f92912a0-1ac9-49d3-af79-caf42a992a29 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:45.429017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f92912a0-1ac9-49d3-af79-caf42a992a29 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:45.435307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f92912a0-1ac9-49d3-af79-caf42a992a29 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:45.442466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f92912a0-1ac9-49d3-af79-caf42a992a29 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:45.442466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f92912a0-1ac9-49d3-af79-caf42a992a29 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:45.442466 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f92912a0-1ac9-49d3-af79-caf42a992a29 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:45.505838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f92912a0-1ac9-49d3-af79-caf42a992a29 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:45.515476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f92912a0-1ac9-49d3-af79-caf42a992a29 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.092750 Sep 14 19:58:45.516224 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1128/2287] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:45 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:45.564771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1bd9e6c2-a8bd-4dc9-b902-c09ebfc1a139 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:45.566761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1bd9e6c2-a8bd-4dc9-b902-c09ebfc1a139 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:45.571513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bd9e6c2-a8bd-4dc9-b902-c09ebfc1a139 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:45.571961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bd9e6c2-a8bd-4dc9-b902-c09ebfc1a139 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:45.572739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bd9e6c2-a8bd-4dc9-b902-c09ebfc1a139 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:45.573216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1bd9e6c2-a8bd-4dc9-b902-c09ebfc1a139 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:45.809847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1bd9e6c2-a8bd-4dc9-b902-c09ebfc1a139 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:45.818497 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1bd9e6c2-a8bd-4dc9-b902-c09ebfc1a139 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:45.820053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1bd9e6c2-a8bd-4dc9-b902-c09ebfc1a139 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:45.821245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1bd9e6c2-a8bd-4dc9-b902-c09ebfc1a139 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1800 microversion: 2.20 time: 0.260943 Sep 14 19:58:45.821838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1160/2288] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1800 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:45.999290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-9cca68a5-890d-4b96-b477-70e954785823 req-053b5bd1-b311-4653-8205-284867de88dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a26129-f7fb-4755-979a-968cdf0c7d34", "name": "network-vif-deleted", "tag": "f0babfc4-e4f0-41d5-9206-dc7125b0b10e"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:46.000888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 19:58:46.000888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 19:58:46.008514 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-9cca68a5-890d-4b96-b477-70e954785823 req-053b5bd1-b311-4653-8205-284867de88dc service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:46.012618 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-9cca68a5-890d-4b96-b477-70e954785823 req-053b5bd1-b311-4653-8205-284867de88dc service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:46.021559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-9cca68a5-890d-4b96-b477-70e954785823 req-053b5bd1-b311-4653-8205-284867de88dc service nova] Creating event network-vif-deleted:f0babfc4-e4f0-41d5-9206-dc7125b0b10e for instance 72a26129-f7fb-4755-979a-968cdf0c7d34 on hv-cinder-80588 Sep 14 19:58:46.028892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-9cca68a5-890d-4b96-b477-70e954785823 req-053b5bd1-b311-4653-8205-284867de88dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Sep 14 19:58:46.030363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1129/2289] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 19:58:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:58:46.532789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a1f73e63-e74f-4805-a216-14ae2455ae4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:46.533544 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a1f73e63-e74f-4805-a216-14ae2455ae4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:46.540486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1f73e63-e74f-4805-a216-14ae2455ae4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:46.541273 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1f73e63-e74f-4805-a216-14ae2455ae4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:46.542142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1f73e63-e74f-4805-a216-14ae2455ae4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:46.542624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a1f73e63-e74f-4805-a216-14ae2455ae4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:46.612971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a1f73e63-e74f-4805-a216-14ae2455ae4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:46.621750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a1f73e63-e74f-4805-a216-14ae2455ae4c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.092949 Sep 14 19:58:46.622342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1161/2290] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:46 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:46.843012 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ad8f68c9-b1fa-47df-b664-aa69d05d948d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:46.844325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ad8f68c9-b1fa-47df-b664-aa69d05d948d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:46.854424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad8f68c9-b1fa-47df-b664-aa69d05d948d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:46.855146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad8f68c9-b1fa-47df-b664-aa69d05d948d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:46.856539 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad8f68c9-b1fa-47df-b664-aa69d05d948d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:46.857278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ad8f68c9-b1fa-47df-b664-aa69d05d948d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:46.933952 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ad8f68c9-b1fa-47df-b664-aa69d05d948d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:46.946096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ad8f68c9-b1fa-47df-b664-aa69d05d948d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:46.947521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ad8f68c9-b1fa-47df-b664-aa69d05d948d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:46.948734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ad8f68c9-b1fa-47df-b664-aa69d05d948d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.112656 Sep 14 19:58:46.949464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1130/2291] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:47.639314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9f9ce444-77b9-40ef-a196-cfc651d1145d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:47.639912 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9f9ce444-77b9-40ef-a196-cfc651d1145d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:47.646382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f9ce444-77b9-40ef-a196-cfc651d1145d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:47.646827 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f9ce444-77b9-40ef-a196-cfc651d1145d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:47.647599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f9ce444-77b9-40ef-a196-cfc651d1145d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:47.648032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9f9ce444-77b9-40ef-a196-cfc651d1145d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:47.707395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9f9ce444-77b9-40ef-a196-cfc651d1145d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:47.715243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9f9ce444-77b9-40ef-a196-cfc651d1145d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079596 Sep 14 19:58:47.715802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1162/2292] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:47 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:47.966737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fa24c514-babd-46c2-a24d-06a71e2c3d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:47.967302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fa24c514-babd-46c2-a24d-06a71e2c3d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:47.973290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa24c514-babd-46c2-a24d-06a71e2c3d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:47.973770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa24c514-babd-46c2-a24d-06a71e2c3d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:47.974527 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa24c514-babd-46c2-a24d-06a71e2c3d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:47.974954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa24c514-babd-46c2-a24d-06a71e2c3d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:48.034685 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fa24c514-babd-46c2-a24d-06a71e2c3d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:48.042907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fa24c514-babd-46c2-a24d-06a71e2c3d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:48.044380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fa24c514-babd-46c2-a24d-06a71e2c3d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:48.045522 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fa24c514-babd-46c2-a24d-06a71e2c3d44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082614 Sep 14 19:58:48.046092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1131/2293] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:47 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:48.732585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-048a5c00-42cb-4aa5-b58b-4ae4bd694032 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:48.733201 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-048a5c00-42cb-4aa5-b58b-4ae4bd694032 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:48.744446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-048a5c00-42cb-4aa5-b58b-4ae4bd694032 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:48.744446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-048a5c00-42cb-4aa5-b58b-4ae4bd694032 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:48.744446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-048a5c00-42cb-4aa5-b58b-4ae4bd694032 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:48.744446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-048a5c00-42cb-4aa5-b58b-4ae4bd694032 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:48.802584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-048a5c00-42cb-4aa5-b58b-4ae4bd694032 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:48.810265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-048a5c00-42cb-4aa5-b58b-4ae4bd694032 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081429 Sep 14 19:58:48.810830 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1163/2294] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:48 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:49.062933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fa51ea46-02a3-435b-a1d7-e01cf92bf08b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:49.063571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fa51ea46-02a3-435b-a1d7-e01cf92bf08b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:49.069412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa51ea46-02a3-435b-a1d7-e01cf92bf08b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:49.070196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa51ea46-02a3-435b-a1d7-e01cf92bf08b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:49.070958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa51ea46-02a3-435b-a1d7-e01cf92bf08b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:49.071394 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fa51ea46-02a3-435b-a1d7-e01cf92bf08b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:49.130029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fa51ea46-02a3-435b-a1d7-e01cf92bf08b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:49.138144 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fa51ea46-02a3-435b-a1d7-e01cf92bf08b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:49.139630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fa51ea46-02a3-435b-a1d7-e01cf92bf08b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:49.141285 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fa51ea46-02a3-435b-a1d7-e01cf92bf08b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081622 Sep 14 19:58:49.141871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1132/2295] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:49 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:49.826917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ac8fd9f5-ac04-46d8-bb05-957f86bd03ce tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:49.827534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ac8fd9f5-ac04-46d8-bb05-957f86bd03ce tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:49.833446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac8fd9f5-ac04-46d8-bb05-957f86bd03ce tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:49.833938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac8fd9f5-ac04-46d8-bb05-957f86bd03ce tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:49.834798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac8fd9f5-ac04-46d8-bb05-957f86bd03ce tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:49.835165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ac8fd9f5-ac04-46d8-bb05-957f86bd03ce tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:49.895981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ac8fd9f5-ac04-46d8-bb05-957f86bd03ce tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:49.904063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ac8fd9f5-ac04-46d8-bb05-957f86bd03ce tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080826 Sep 14 19:58:49.904641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1164/2296] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:49 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:50.159369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cda13d58-51d3-4e86-a5a1-4ad24bc09434 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:50.159973 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cda13d58-51d3-4e86-a5a1-4ad24bc09434 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:50.165827 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cda13d58-51d3-4e86-a5a1-4ad24bc09434 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:50.166282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cda13d58-51d3-4e86-a5a1-4ad24bc09434 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:50.167075 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cda13d58-51d3-4e86-a5a1-4ad24bc09434 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:50.167518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cda13d58-51d3-4e86-a5a1-4ad24bc09434 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:50.225571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cda13d58-51d3-4e86-a5a1-4ad24bc09434 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:50.233635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cda13d58-51d3-4e86-a5a1-4ad24bc09434 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:50.235726 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cda13d58-51d3-4e86-a5a1-4ad24bc09434 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:50.236869 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cda13d58-51d3-4e86-a5a1-4ad24bc09434 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081758 Sep 14 19:58:50.237420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1133/2297] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:50 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:50.920758 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fdcd5fb9-7821-45de-94a7-9d425011c52e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:50.921322 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fdcd5fb9-7821-45de-94a7-9d425011c52e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:50.927439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fb9-7821-45de-94a7-9d425011c52e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:50.927892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fb9-7821-45de-94a7-9d425011c52e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:50.928660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fb9-7821-45de-94a7-9d425011c52e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:50.929102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fdcd5fb9-7821-45de-94a7-9d425011c52e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:50.987552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-fdcd5fb9-7821-45de-94a7-9d425011c52e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:50.995472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fdcd5fb9-7821-45de-94a7-9d425011c52e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078450 Sep 14 19:58:50.996047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1165/2298] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:50 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:51.255050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-948591ab-7d36-4d1c-80c5-0392d817ddac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:51.255785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-948591ab-7d36-4d1c-80c5-0392d817ddac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:51.263391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-948591ab-7d36-4d1c-80c5-0392d817ddac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:51.264052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-948591ab-7d36-4d1c-80c5-0392d817ddac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:51.264867 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-948591ab-7d36-4d1c-80c5-0392d817ddac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:51.265290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-948591ab-7d36-4d1c-80c5-0392d817ddac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:51.327533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-948591ab-7d36-4d1c-80c5-0392d817ddac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:51.335843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-948591ab-7d36-4d1c-80c5-0392d817ddac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:51.337322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-948591ab-7d36-4d1c-80c5-0392d817ddac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:51.338488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-948591ab-7d36-4d1c-80c5-0392d817ddac tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.087291 Sep 14 19:58:51.339042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1134/2299] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:51 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:58:52.012712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c498f0ba-7c22-4185-a311-56762429c03b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:52.013318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c498f0ba-7c22-4185-a311-56762429c03b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:52.019659 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c498f0ba-7c22-4185-a311-56762429c03b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:52.020107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c498f0ba-7c22-4185-a311-56762429c03b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:52.020875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c498f0ba-7c22-4185-a311-56762429c03b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:52.021316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c498f0ba-7c22-4185-a311-56762429c03b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:52.081909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c498f0ba-7c22-4185-a311-56762429c03b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:52.089744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c498f0ba-7c22-4185-a311-56762429c03b tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080603 Sep 14 19:58:52.090245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1166/2300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:52 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:52.355624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-16ef0023-8284-4da8-8864-2f9f6c644ddf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:52.356263 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-16ef0023-8284-4da8-8864-2f9f6c644ddf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:52.363286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16ef0023-8284-4da8-8864-2f9f6c644ddf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:52.363727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16ef0023-8284-4da8-8864-2f9f6c644ddf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:52.364622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16ef0023-8284-4da8-8864-2f9f6c644ddf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:52.365125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16ef0023-8284-4da8-8864-2f9f6c644ddf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:52.436325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16ef0023-8284-4da8-8864-2f9f6c644ddf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:52.445789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16ef0023-8284-4da8-8864-2f9f6c644ddf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:52.447303 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16ef0023-8284-4da8-8864-2f9f6c644ddf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:52.448516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-16ef0023-8284-4da8-8864-2f9f6c644ddf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.096806 Sep 14 19:58:52.449095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1135/2301] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:53.106976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-70a2995d-5b90-4cdc-ae48-ed31680bb2d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:53.107551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-70a2995d-5b90-4cdc-ae48-ed31680bb2d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:53.113846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70a2995d-5b90-4cdc-ae48-ed31680bb2d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:53.114293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70a2995d-5b90-4cdc-ae48-ed31680bb2d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:53.115058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70a2995d-5b90-4cdc-ae48-ed31680bb2d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:53.115495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70a2995d-5b90-4cdc-ae48-ed31680bb2d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:53.175299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-70a2995d-5b90-4cdc-ae48-ed31680bb2d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:53.183034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-70a2995d-5b90-4cdc-ae48-ed31680bb2d9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079771 Sep 14 19:58:53.188681 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1167/2302] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:53 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:53.467898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-16ec7107-a14b-4b43-ad6a-3bfd93e7d684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:53.469008 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-16ec7107-a14b-4b43-ad6a-3bfd93e7d684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:53.475207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16ec7107-a14b-4b43-ad6a-3bfd93e7d684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:53.475654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16ec7107-a14b-4b43-ad6a-3bfd93e7d684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:53.476422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16ec7107-a14b-4b43-ad6a-3bfd93e7d684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:53.476857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16ec7107-a14b-4b43-ad6a-3bfd93e7d684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:53.537927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16ec7107-a14b-4b43-ad6a-3bfd93e7d684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:53.546483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16ec7107-a14b-4b43-ad6a-3bfd93e7d684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:53.547976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16ec7107-a14b-4b43-ad6a-3bfd93e7d684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:53.549138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-16ec7107-a14b-4b43-ad6a-3bfd93e7d684 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085086 Sep 14 19:58:53.550023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1136/2303] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:53 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:54.200245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e9448436-eb60-4651-b1a4-e0da74f2738d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:54.200858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e9448436-eb60-4651-b1a4-e0da74f2738d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:54.208435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9448436-eb60-4651-b1a4-e0da74f2738d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:54.208885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9448436-eb60-4651-b1a4-e0da74f2738d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:54.209687 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9448436-eb60-4651-b1a4-e0da74f2738d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:54.210126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9448436-eb60-4651-b1a4-e0da74f2738d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:54.269955 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e9448436-eb60-4651-b1a4-e0da74f2738d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:54.277783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e9448436-eb60-4651-b1a4-e0da74f2738d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081176 Sep 14 19:58:54.278345 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1168/2304] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:54 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:54.569130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1b811b17-196a-40a7-b326-76b09b4ade74 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:54.569714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1b811b17-196a-40a7-b326-76b09b4ade74 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:54.575533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b811b17-196a-40a7-b326-76b09b4ade74 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:54.575978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b811b17-196a-40a7-b326-76b09b4ade74 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:54.576740 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b811b17-196a-40a7-b326-76b09b4ade74 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:54.577221 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b811b17-196a-40a7-b326-76b09b4ade74 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:54.636523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1b811b17-196a-40a7-b326-76b09b4ade74 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:54.644973 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1b811b17-196a-40a7-b326-76b09b4ade74 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:54.646552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1b811b17-196a-40a7-b326-76b09b4ade74 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:54.647709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1b811b17-196a-40a7-b326-76b09b4ade74 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082372 Sep 14 19:58:54.648264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1137/2305] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:58:55.294495 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dcb144d9-2d87-40ba-838b-89b657ea00d5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:55.295169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dcb144d9-2d87-40ba-838b-89b657ea00d5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:55.301450 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcb144d9-2d87-40ba-838b-89b657ea00d5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:55.301930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcb144d9-2d87-40ba-838b-89b657ea00d5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:55.302715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcb144d9-2d87-40ba-838b-89b657ea00d5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:55.303153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcb144d9-2d87-40ba-838b-89b657ea00d5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:55.363025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dcb144d9-2d87-40ba-838b-89b657ea00d5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:55.370836 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dcb144d9-2d87-40ba-838b-89b657ea00d5 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.080019 Sep 14 19:58:55.371406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1169/2306] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:55 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:55.666009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-132e5e92-04a9-4482-82fb-d8bc1fd8c6bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:55.666647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-132e5e92-04a9-4482-82fb-d8bc1fd8c6bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:55.672720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-132e5e92-04a9-4482-82fb-d8bc1fd8c6bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:55.673165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-132e5e92-04a9-4482-82fb-d8bc1fd8c6bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:55.673979 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-132e5e92-04a9-4482-82fb-d8bc1fd8c6bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:55.674412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-132e5e92-04a9-4482-82fb-d8bc1fd8c6bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:55.737108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-132e5e92-04a9-4482-82fb-d8bc1fd8c6bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:55.745908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-132e5e92-04a9-4482-82fb-d8bc1fd8c6bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:55.747582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-132e5e92-04a9-4482-82fb-d8bc1fd8c6bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:55.748735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-132e5e92-04a9-4482-82fb-d8bc1fd8c6bc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.086493 Sep 14 19:58:55.749292 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1138/2307] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:55 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:56.388041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e9e4dc20-1859-40b6-af90-4a7a9820b7f6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:56.388672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e9e4dc20-1859-40b6-af90-4a7a9820b7f6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:56.394606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9e4dc20-1859-40b6-af90-4a7a9820b7f6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:56.395048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9e4dc20-1859-40b6-af90-4a7a9820b7f6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:56.395823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9e4dc20-1859-40b6-af90-4a7a9820b7f6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:56.396253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e9e4dc20-1859-40b6-af90-4a7a9820b7f6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:56.457133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e9e4dc20-1859-40b6-af90-4a7a9820b7f6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:56.465680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e9e4dc20-1859-40b6-af90-4a7a9820b7f6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081222 Sep 14 19:58:56.466266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1170/2308] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:56 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:56.767657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7df10018-b958-471d-a81a-6e1615269760 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:56.768244 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7df10018-b958-471d-a81a-6e1615269760 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:56.774444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7df10018-b958-471d-a81a-6e1615269760 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:56.774921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7df10018-b958-471d-a81a-6e1615269760 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:56.775692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7df10018-b958-471d-a81a-6e1615269760 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:56.776132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7df10018-b958-471d-a81a-6e1615269760 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:56.838889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7df10018-b958-471d-a81a-6e1615269760 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:56.848014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7df10018-b958-471d-a81a-6e1615269760 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:56.849482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7df10018-b958-471d-a81a-6e1615269760 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:56.850668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7df10018-b958-471d-a81a-6e1615269760 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.087260 Sep 14 19:58:56.851204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1139/2309] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:56 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:57.483508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0d64a85c-f6e8-4a19-bbf4-bc1b97cda876 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:57.484641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0d64a85c-f6e8-4a19-bbf4-bc1b97cda876 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:57.490655 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d64a85c-f6e8-4a19-bbf4-bc1b97cda876 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:57.491100 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d64a85c-f6e8-4a19-bbf4-bc1b97cda876 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:57.491868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d64a85c-f6e8-4a19-bbf4-bc1b97cda876 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:57.492298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0d64a85c-f6e8-4a19-bbf4-bc1b97cda876 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:57.553458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0d64a85c-f6e8-4a19-bbf4-bc1b97cda876 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:57.561389 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0d64a85c-f6e8-4a19-bbf4-bc1b97cda876 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.081568 Sep 14 19:58:57.561992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1171/2310] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:57 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:57.868648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ea7c020c-1fb2-47c8-9d3b-7de0a02f19d7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:57.869291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ea7c020c-1fb2-47c8-9d3b-7de0a02f19d7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:57.875351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea7c020c-1fb2-47c8-9d3b-7de0a02f19d7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:57.875790 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea7c020c-1fb2-47c8-9d3b-7de0a02f19d7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:57.876556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea7c020c-1fb2-47c8-9d3b-7de0a02f19d7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:57.876974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea7c020c-1fb2-47c8-9d3b-7de0a02f19d7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:57.938704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ea7c020c-1fb2-47c8-9d3b-7de0a02f19d7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:57.947088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ea7c020c-1fb2-47c8-9d3b-7de0a02f19d7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:57.948568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ea7c020c-1fb2-47c8-9d3b-7de0a02f19d7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:57.949777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ea7c020c-1fb2-47c8-9d3b-7de0a02f19d7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084859 Sep 14 19:58:57.950336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1140/2311] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:57 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:58.579357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d390aa95-32fa-4318-9379-8124e0f07f1f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:58.579971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d390aa95-32fa-4318-9379-8124e0f07f1f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:58.586171 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d390aa95-32fa-4318-9379-8124e0f07f1f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:58.586623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d390aa95-32fa-4318-9379-8124e0f07f1f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:58.587405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d390aa95-32fa-4318-9379-8124e0f07f1f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:58.587842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d390aa95-32fa-4318-9379-8124e0f07f1f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:58.652228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d390aa95-32fa-4318-9379-8124e0f07f1f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:58.660210 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d390aa95-32fa-4318-9379-8124e0f07f1f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.085184 Sep 14 19:58:58.660791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1172/2312] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:58 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:58.967635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-83469f35-150b-42e4-b8e9-8549e8500f0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:58.968246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-83469f35-150b-42e4-b8e9-8549e8500f0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:58.974212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83469f35-150b-42e4-b8e9-8549e8500f0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:58.974664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83469f35-150b-42e4-b8e9-8549e8500f0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:58.975430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83469f35-150b-42e4-b8e9-8549e8500f0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:58.975871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-83469f35-150b-42e4-b8e9-8549e8500f0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:59.038302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-83469f35-150b-42e4-b8e9-8549e8500f0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:59.047219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-83469f35-150b-42e4-b8e9-8549e8500f0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:59.048655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-83469f35-150b-42e4-b8e9-8549e8500f0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:59.050158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-83469f35-150b-42e4-b8e9-8549e8500f0f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085983 Sep 14 19:58:59.050721 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1141/2313] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:58:58 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:59.677118 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-21aba33f-75f2-4970-8714-1111a3302e06 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:59.677739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-21aba33f-75f2-4970-8714-1111a3302e06 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:58:59.683635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21aba33f-75f2-4970-8714-1111a3302e06 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:59.684086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21aba33f-75f2-4970-8714-1111a3302e06 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:59.684855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21aba33f-75f2-4970-8714-1111a3302e06 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:58:59.685294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-21aba33f-75f2-4970-8714-1111a3302e06 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:58:59.743404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-21aba33f-75f2-4970-8714-1111a3302e06 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:59.751170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-21aba33f-75f2-4970-8714-1111a3302e06 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.077973 Sep 14 19:58:59.751733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1173/2314] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:58:59 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:00.068563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-98ea6797-00de-4df3-9a9f-31258e3ff42d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:00.069092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-98ea6797-00de-4df3-9a9f-31258e3ff42d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:00.075050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98ea6797-00de-4df3-9a9f-31258e3ff42d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:00.075499 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98ea6797-00de-4df3-9a9f-31258e3ff42d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:00.076310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98ea6797-00de-4df3-9a9f-31258e3ff42d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:00.076745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98ea6797-00de-4df3-9a9f-31258e3ff42d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:00.136301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-98ea6797-00de-4df3-9a9f-31258e3ff42d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:00.145126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-98ea6797-00de-4df3-9a9f-31258e3ff42d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:00.146659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-98ea6797-00de-4df3-9a9f-31258e3ff42d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:00.148143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-98ea6797-00de-4df3-9a9f-31258e3ff42d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083020 Sep 14 19:59:00.148701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1142/2315] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:00 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:00.767975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-91c75144-8970-4aa6-9e01-82a72ab697e9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:00.768587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-91c75144-8970-4aa6-9e01-82a72ab697e9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:00.774437 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91c75144-8970-4aa6-9e01-82a72ab697e9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:00.774890 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91c75144-8970-4aa6-9e01-82a72ab697e9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:00.775658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91c75144-8970-4aa6-9e01-82a72ab697e9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:00.776099 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91c75144-8970-4aa6-9e01-82a72ab697e9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:00.835276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-91c75144-8970-4aa6-9e01-82a72ab697e9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:00.843047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-91c75144-8970-4aa6-9e01-82a72ab697e9 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078952 Sep 14 19:59:00.844107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1174/2316] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:00 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:01.165650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a8a8b7e2-0a05-414f-b5af-42ab70e1df63 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:01.166218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a8a8b7e2-0a05-414f-b5af-42ab70e1df63 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:01.172230 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a8a8b7e2-0a05-414f-b5af-42ab70e1df63 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:01.172682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a8a8b7e2-0a05-414f-b5af-42ab70e1df63 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:01.173453 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a8a8b7e2-0a05-414f-b5af-42ab70e1df63 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:01.173925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a8a8b7e2-0a05-414f-b5af-42ab70e1df63 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:01.232710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a8a8b7e2-0a05-414f-b5af-42ab70e1df63 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:01.241024 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a8a8b7e2-0a05-414f-b5af-42ab70e1df63 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:01.242556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a8a8b7e2-0a05-414f-b5af-42ab70e1df63 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:01.243694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a8a8b7e2-0a05-414f-b5af-42ab70e1df63 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081876 Sep 14 19:59:01.244260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1143/2317] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:01 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:01.860554 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-87746970-17cc-4ff9-a0ee-d596dc4e0061 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:01.861165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-87746970-17cc-4ff9-a0ee-d596dc4e0061 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:01.867086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87746970-17cc-4ff9-a0ee-d596dc4e0061 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:01.867558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87746970-17cc-4ff9-a0ee-d596dc4e0061 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:01.868324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87746970-17cc-4ff9-a0ee-d596dc4e0061 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:01.868749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87746970-17cc-4ff9-a0ee-d596dc4e0061 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:01.927915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-87746970-17cc-4ff9-a0ee-d596dc4e0061 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:01.935788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-87746970-17cc-4ff9-a0ee-d596dc4e0061 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079437 Sep 14 19:59:01.936403 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1175/2318] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:01 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:02.267052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dc952df4-0c18-41ba-b9bb-2fa15c6cd943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:02.267650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dc952df4-0c18-41ba-b9bb-2fa15c6cd943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:02.273795 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc952df4-0c18-41ba-b9bb-2fa15c6cd943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:02.274293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc952df4-0c18-41ba-b9bb-2fa15c6cd943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:02.275062 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc952df4-0c18-41ba-b9bb-2fa15c6cd943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:02.275529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dc952df4-0c18-41ba-b9bb-2fa15c6cd943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:02.335091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dc952df4-0c18-41ba-b9bb-2fa15c6cd943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:02.343866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dc952df4-0c18-41ba-b9bb-2fa15c6cd943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:02.345676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dc952df4-0c18-41ba-b9bb-2fa15c6cd943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:02.347705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dc952df4-0c18-41ba-b9bb-2fa15c6cd943 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084165 Sep 14 19:59:02.348720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1144/2319] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:02 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:02.954034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bb8ffcd7-6370-43ca-b71b-2ba967248097 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:02.954604 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bb8ffcd7-6370-43ca-b71b-2ba967248097 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:02.960946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bb8ffcd7-6370-43ca-b71b-2ba967248097 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:02.961393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bb8ffcd7-6370-43ca-b71b-2ba967248097 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:02.962211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bb8ffcd7-6370-43ca-b71b-2ba967248097 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:02.962650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bb8ffcd7-6370-43ca-b71b-2ba967248097 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:03.172107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bb8ffcd7-6370-43ca-b71b-2ba967248097 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:03.180099 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bb8ffcd7-6370-43ca-b71b-2ba967248097 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.230596 Sep 14 19:59:03.180671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1176/2320] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:02 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:03.365831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5d5cd90f-3788-414b-9db9-36ab0cc4c5ec tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:03.367393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5d5cd90f-3788-414b-9db9-36ab0cc4c5ec tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:03.372461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d5cd90f-3788-414b-9db9-36ab0cc4c5ec tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:03.373027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d5cd90f-3788-414b-9db9-36ab0cc4c5ec tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:03.373833 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d5cd90f-3788-414b-9db9-36ab0cc4c5ec tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:03.374271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5d5cd90f-3788-414b-9db9-36ab0cc4c5ec tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:03.434971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5d5cd90f-3788-414b-9db9-36ab0cc4c5ec tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:03.444112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5d5cd90f-3788-414b-9db9-36ab0cc4c5ec tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:03.445663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5d5cd90f-3788-414b-9db9-36ab0cc4c5ec tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:03.446787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5d5cd90f-3788-414b-9db9-36ab0cc4c5ec tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084748 Sep 14 19:59:03.447339 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1145/2321] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:04.196307 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5dbbcf28-31c2-4ba2-a025-e0155a0c2954 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:04.196895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5dbbcf28-31c2-4ba2-a025-e0155a0c2954 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:04.203250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5dbbcf28-31c2-4ba2-a025-e0155a0c2954 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:04.203699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5dbbcf28-31c2-4ba2-a025-e0155a0c2954 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:04.204452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5dbbcf28-31c2-4ba2-a025-e0155a0c2954 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:04.204881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5dbbcf28-31c2-4ba2-a025-e0155a0c2954 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:04.267260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5dbbcf28-31c2-4ba2-a025-e0155a0c2954 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:04.275144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5dbbcf28-31c2-4ba2-a025-e0155a0c2954 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.082458 Sep 14 19:59:04.275718 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1177/2322] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:04 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:04.464354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-966f88de-8236-4324-a25a-84601a3fb5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:04.464896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-966f88de-8236-4324-a25a-84601a3fb5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:04.470755 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-966f88de-8236-4324-a25a-84601a3fb5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:04.471203 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-966f88de-8236-4324-a25a-84601a3fb5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:04.471964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-966f88de-8236-4324-a25a-84601a3fb5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:04.472399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-966f88de-8236-4324-a25a-84601a3fb5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:04.530590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-966f88de-8236-4324-a25a-84601a3fb5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:04.538814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-966f88de-8236-4324-a25a-84601a3fb5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:04.540305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-966f88de-8236-4324-a25a-84601a3fb5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:04.541447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-966f88de-8236-4324-a25a-84601a3fb5f7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.080892 Sep 14 19:59:04.542028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1146/2323] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:04 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:05.292439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8b51ff1c-505c-4f86-85a4-59cb59d93b1c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:05.293063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8b51ff1c-505c-4f86-85a4-59cb59d93b1c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:05.299694 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b51ff1c-505c-4f86-85a4-59cb59d93b1c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:05.300394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b51ff1c-505c-4f86-85a4-59cb59d93b1c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:05.301169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b51ff1c-505c-4f86-85a4-59cb59d93b1c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:05.301642 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8b51ff1c-505c-4f86-85a4-59cb59d93b1c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:05.360113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8b51ff1c-505c-4f86-85a4-59cb59d93b1c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:05.367733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8b51ff1c-505c-4f86-85a4-59cb59d93b1c tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.079015 Sep 14 19:59:05.368283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1178/2324] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:05 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:05.559272 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7d5950b5-e0ee-4854-a96c-6426b988e43a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:05.559813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7d5950b5-e0ee-4854-a96c-6426b988e43a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:05.565741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d5950b5-e0ee-4854-a96c-6426b988e43a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:05.566193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d5950b5-e0ee-4854-a96c-6426b988e43a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:05.566956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d5950b5-e0ee-4854-a96c-6426b988e43a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:05.567392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d5950b5-e0ee-4854-a96c-6426b988e43a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:05.627725 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7d5950b5-e0ee-4854-a96c-6426b988e43a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:05.636131 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7d5950b5-e0ee-4854-a96c-6426b988e43a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:05.637673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7d5950b5-e0ee-4854-a96c-6426b988e43a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:05.638841 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7d5950b5-e0ee-4854-a96c-6426b988e43a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083382 Sep 14 19:59:05.639396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1147/2325] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:05 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:06.384376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fa8e878e-7e95-43d4-be66-aa8576ee2bfc tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:06.384985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fa8e878e-7e95-43d4-be66-aa8576ee2bfc tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:06.390835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa8e878e-7e95-43d4-be66-aa8576ee2bfc tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:06.391283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa8e878e-7e95-43d4-be66-aa8576ee2bfc tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:06.392041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa8e878e-7e95-43d4-be66-aa8576ee2bfc tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:06.392505 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fa8e878e-7e95-43d4-be66-aa8576ee2bfc tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:06.451066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-fa8e878e-7e95-43d4-be66-aa8576ee2bfc tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:06.458793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fa8e878e-7e95-43d4-be66-aa8576ee2bfc tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078124 Sep 14 19:59:06.459352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1179/2326] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:06 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:06.657532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b325e47a-c010-4054-a6ff-24ec1108157c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:06.658092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b325e47a-c010-4054-a6ff-24ec1108157c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:06.664310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b325e47a-c010-4054-a6ff-24ec1108157c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:06.664759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b325e47a-c010-4054-a6ff-24ec1108157c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:06.665551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b325e47a-c010-4054-a6ff-24ec1108157c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:06.665986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b325e47a-c010-4054-a6ff-24ec1108157c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:06.725796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b325e47a-c010-4054-a6ff-24ec1108157c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:06.734276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b325e47a-c010-4054-a6ff-24ec1108157c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:06.736354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b325e47a-c010-4054-a6ff-24ec1108157c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:06.737523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b325e47a-c010-4054-a6ff-24ec1108157c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084606 Sep 14 19:59:06.738070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1148/2327] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:06 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:07.475853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a358b9c8-cf0e-4747-bf36-5314bcadb77d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:07.476456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a358b9c8-cf0e-4747-bf36-5314bcadb77d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:07.482245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a358b9c8-cf0e-4747-bf36-5314bcadb77d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:07.482690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a358b9c8-cf0e-4747-bf36-5314bcadb77d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:07.483444 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a358b9c8-cf0e-4747-bf36-5314bcadb77d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:07.483871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a358b9c8-cf0e-4747-bf36-5314bcadb77d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:07.542017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a358b9c8-cf0e-4747-bf36-5314bcadb77d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:07.550676 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a358b9c8-cf0e-4747-bf36-5314bcadb77d tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078478 Sep 14 19:59:07.551229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1180/2328] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:07 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:07.755139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f16c6506-413f-478c-8705-51cec04d02ba tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:07.755706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f16c6506-413f-478c-8705-51cec04d02ba tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:07.761824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f16c6506-413f-478c-8705-51cec04d02ba tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:07.762264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f16c6506-413f-478c-8705-51cec04d02ba tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:07.763013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f16c6506-413f-478c-8705-51cec04d02ba tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:07.763443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f16c6506-413f-478c-8705-51cec04d02ba tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:07.821436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f16c6506-413f-478c-8705-51cec04d02ba tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:07.830944 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f16c6506-413f-478c-8705-51cec04d02ba tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:07.832590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f16c6506-413f-478c-8705-51cec04d02ba tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:07.833932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f16c6506-413f-478c-8705-51cec04d02ba tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082501 Sep 14 19:59:07.834684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1149/2329] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:07 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:08.568042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a00065dd-c953-4e41-bc2b-55392b1aaab8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:08.568648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a00065dd-c953-4e41-bc2b-55392b1aaab8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:08.574500 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a00065dd-c953-4e41-bc2b-55392b1aaab8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:08.574952 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a00065dd-c953-4e41-bc2b-55392b1aaab8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:08.575721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a00065dd-c953-4e41-bc2b-55392b1aaab8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:08.576166 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a00065dd-c953-4e41-bc2b-55392b1aaab8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:08.634529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a00065dd-c953-4e41-bc2b-55392b1aaab8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:08.642219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a00065dd-c953-4e41-bc2b-55392b1aaab8 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.077853 Sep 14 19:59:08.642780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1181/2330] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:08 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:08.851372 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2de5cb2b-8391-4beb-b7e0-94f612e956d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:08.851980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2de5cb2b-8391-4beb-b7e0-94f612e956d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:08.857842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2de5cb2b-8391-4beb-b7e0-94f612e956d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:08.858295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2de5cb2b-8391-4beb-b7e0-94f612e956d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:08.859061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2de5cb2b-8391-4beb-b7e0-94f612e956d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:08.859500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2de5cb2b-8391-4beb-b7e0-94f612e956d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:08.917888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2de5cb2b-8391-4beb-b7e0-94f612e956d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:08.927027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2de5cb2b-8391-4beb-b7e0-94f612e956d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:08.928647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2de5cb2b-8391-4beb-b7e0-94f612e956d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:08.929691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2de5cb2b-8391-4beb-b7e0-94f612e956d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082035 Sep 14 19:59:08.930254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1150/2331] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:08 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:09.658790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-49d22843-bf91-4959-ad9b-25812f0ab06f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:09.659386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-49d22843-bf91-4959-ad9b-25812f0ab06f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:09.665267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49d22843-bf91-4959-ad9b-25812f0ab06f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:09.665825 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49d22843-bf91-4959-ad9b-25812f0ab06f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:09.666588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49d22843-bf91-4959-ad9b-25812f0ab06f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:09.667012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-49d22843-bf91-4959-ad9b-25812f0ab06f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:09.725610 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-49d22843-bf91-4959-ad9b-25812f0ab06f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:09.733313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-49d22843-bf91-4959-ad9b-25812f0ab06f tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.078171 Sep 14 19:59:09.733912 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1182/2332] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:09 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:09.947468 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-df63e807-ab76-458e-8f16-8016d85086da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:09.948030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-df63e807-ab76-458e-8f16-8016d85086da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:09.954550 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df63e807-ab76-458e-8f16-8016d85086da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:09.954999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df63e807-ab76-458e-8f16-8016d85086da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:09.955805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df63e807-ab76-458e-8f16-8016d85086da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:09.956242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df63e807-ab76-458e-8f16-8016d85086da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:10.014690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-df63e807-ab76-458e-8f16-8016d85086da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:10.022889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-df63e807-ab76-458e-8f16-8016d85086da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:10.024440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-df63e807-ab76-458e-8f16-8016d85086da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:10.025620 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-df63e807-ab76-458e-8f16-8016d85086da tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081922 Sep 14 19:59:10.026176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1151/2333] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:10.916372 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6cd24e49-a0ea-4728-8cd5-594a332a8327 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:10.916995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6cd24e49-a0ea-4728-8cd5-594a332a8327 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:10.922855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd24e49-a0ea-4728-8cd5-594a332a8327 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:10.923315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd24e49-a0ea-4728-8cd5-594a332a8327 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:10.924089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd24e49-a0ea-4728-8cd5-594a332a8327 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:10.924527 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd24e49-a0ea-4728-8cd5-594a332a8327 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:10.986342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6cd24e49-a0ea-4728-8cd5-594a332a8327 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:10.994049 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6cd24e49-a0ea-4728-8cd5-594a332a8327 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.247776 Sep 14 19:59:10.994616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1183/2334] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:10 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:11.044795 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8af9a071-867c-4407-9071-7597771c65d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:11.045325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8af9a071-867c-4407-9071-7597771c65d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:11.051432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8af9a071-867c-4407-9071-7597771c65d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:11.051881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8af9a071-867c-4407-9071-7597771c65d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:11.052644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8af9a071-867c-4407-9071-7597771c65d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:11.053082 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8af9a071-867c-4407-9071-7597771c65d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:11.111326 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8af9a071-867c-4407-9071-7597771c65d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:11.119431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8af9a071-867c-4407-9071-7597771c65d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:11.120941 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8af9a071-867c-4407-9071-7597771c65d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:11.122125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8af9a071-867c-4407-9071-7597771c65d3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082793 Sep 14 19:59:11.122685 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1152/2335] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:11 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:59:12.010651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b6a192be-2480-4b44-9e95-74dd525e08e6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:12.011294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b6a192be-2480-4b44-9e95-74dd525e08e6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:12.017175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6a192be-2480-4b44-9e95-74dd525e08e6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:12.017657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6a192be-2480-4b44-9e95-74dd525e08e6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:12.018488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6a192be-2480-4b44-9e95-74dd525e08e6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:12.018925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6a192be-2480-4b44-9e95-74dd525e08e6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:12.083051 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b6a192be-2480-4b44-9e95-74dd525e08e6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:12.090905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b6a192be-2480-4b44-9e95-74dd525e08e6 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.083878 Sep 14 19:59:12.091397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1184/2336] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:12 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:12.139994 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2258633f-6a82-494c-928b-b7db18a8c0e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:12.140596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2258633f-6a82-494c-928b-b7db18a8c0e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:12.146674 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2258633f-6a82-494c-928b-b7db18a8c0e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:12.147145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2258633f-6a82-494c-928b-b7db18a8c0e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:12.147911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2258633f-6a82-494c-928b-b7db18a8c0e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:12.148342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2258633f-6a82-494c-928b-b7db18a8c0e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:12.209980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2258633f-6a82-494c-928b-b7db18a8c0e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:12.218137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2258633f-6a82-494c-928b-b7db18a8c0e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:12.220155 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2258633f-6a82-494c-928b-b7db18a8c0e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:12.221287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2258633f-6a82-494c-928b-b7db18a8c0e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084997 Sep 14 19:59:12.221874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1153/2337] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:12 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:13.107645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a9bf4a8f-ef3d-45b1-b2dc-883998b924b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:13.108342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a9bf4a8f-ef3d-45b1-b2dc-883998b924b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:13.114847 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9bf4a8f-ef3d-45b1-b2dc-883998b924b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:13.124194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9bf4a8f-ef3d-45b1-b2dc-883998b924b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:13.124194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9bf4a8f-ef3d-45b1-b2dc-883998b924b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:13.124194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a9bf4a8f-ef3d-45b1-b2dc-883998b924b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:13.181347 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a9bf4a8f-ef3d-45b1-b2dc-883998b924b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f93d21b697e42b896a5ad9314b75c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18cc0be51b4a2c8016758bb56e20f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:13.190666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a9bf4a8f-ef3d-45b1-b2dc-883998b924b0 tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 200 len: 1350 microversion: 2.1 time: 0.086498 Sep 14 19:59:13.191240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1185/2338] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:13 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:13.238523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c472bc45-687e-48ac-a056-b6f0bd9fce25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:13.239251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c472bc45-687e-48ac-a056-b6f0bd9fce25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:13.245009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c472bc45-687e-48ac-a056-b6f0bd9fce25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:13.245531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c472bc45-687e-48ac-a056-b6f0bd9fce25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:13.246324 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c472bc45-687e-48ac-a056-b6f0bd9fce25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:13.246783 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c472bc45-687e-48ac-a056-b6f0bd9fce25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:13.308324 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c472bc45-687e-48ac-a056-b6f0bd9fce25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:13.317202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c472bc45-687e-48ac-a056-b6f0bd9fce25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:13.318795 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c472bc45-687e-48ac-a056-b6f0bd9fce25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:13.319886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c472bc45-687e-48ac-a056-b6f0bd9fce25 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085605 Sep 14 19:59:13.320471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1154/2339] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:14.208027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e0de80a1-cd94-4978-a581-f41374d6d91e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:14.208638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e0de80a1-cd94-4978-a581-f41374d6d91e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] [instance: 3106dd73-2741-49d1-9906-80ecde50dd8e] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:14.214605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0de80a1-cd94-4978-a581-f41374d6d91e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:14.215051 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0de80a1-cd94-4978-a581-f41374d6d91e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:14.215810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0de80a1-cd94-4978-a581-f41374d6d91e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:14.216252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e0de80a1-cd94-4978-a581-f41374d6d91e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:14.229133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-e0de80a1-cd94-4978-a581-f41374d6d91e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] HTTP exception thrown: Instance 3106dd73-2741-49d1-9906-80ecde50dd8e could not be found. Sep 14 19:59:14.229760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e0de80a1-cd94-4978-a581-f41374d6d91e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] Returning 404 to user: Instance 3106dd73-2741-49d1-9906-80ecde50dd8e could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 19:59:14.230570 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e0de80a1-cd94-4978-a581-f41374d6d91e tempest-VolumesSnapshotTestJSON-1924764113 tempest-VolumesSnapshotTestJSON-1924764113-project] 10.222.0.58 "GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e" status: 404 len: 111 microversion: 2.1 time: 0.026943 Sep 14 19:59:14.231082 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1186/2340] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 19:59:14 2021] GET /compute/v2.1/servers/3106dd73-2741-49d1-9906-80ecde50dd8e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:59:14.337559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a5441ec7-2a38-4f54-9d47-8b3ce4f13740 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:14.338214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a5441ec7-2a38-4f54-9d47-8b3ce4f13740 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:14.343917 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5441ec7-2a38-4f54-9d47-8b3ce4f13740 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:14.344364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5441ec7-2a38-4f54-9d47-8b3ce4f13740 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:14.345118 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5441ec7-2a38-4f54-9d47-8b3ce4f13740 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:14.345572 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a5441ec7-2a38-4f54-9d47-8b3ce4f13740 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:14.405126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a5441ec7-2a38-4f54-9d47-8b3ce4f13740 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:14.413310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a5441ec7-2a38-4f54-9d47-8b3ce4f13740 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:14.414814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a5441ec7-2a38-4f54-9d47-8b3ce4f13740 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:14.415999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a5441ec7-2a38-4f54-9d47-8b3ce4f13740 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082046 Sep 14 19:59:14.416498 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1155/2341] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:14 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:15.434019 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2ac423db-7bb3-481f-b8c8-f6eb99cb9102 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:15.434661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2ac423db-7bb3-481f-b8c8-f6eb99cb9102 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:15.440595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ac423db-7bb3-481f-b8c8-f6eb99cb9102 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:15.441042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ac423db-7bb3-481f-b8c8-f6eb99cb9102 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:15.441839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ac423db-7bb3-481f-b8c8-f6eb99cb9102 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:15.442275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2ac423db-7bb3-481f-b8c8-f6eb99cb9102 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:15.500540 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2ac423db-7bb3-481f-b8c8-f6eb99cb9102 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:15.508621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2ac423db-7bb3-481f-b8c8-f6eb99cb9102 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:15.510162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2ac423db-7bb3-481f-b8c8-f6eb99cb9102 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:15.511297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2ac423db-7bb3-481f-b8c8-f6eb99cb9102 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081152 Sep 14 19:59:15.511844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1187/2342] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:15 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:16.529144 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-637e207f-6929-4628-94f6-7b7d7dc26873 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:16.529799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-637e207f-6929-4628-94f6-7b7d7dc26873 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:16.536047 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-637e207f-6929-4628-94f6-7b7d7dc26873 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:16.536481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-637e207f-6929-4628-94f6-7b7d7dc26873 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:16.537226 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-637e207f-6929-4628-94f6-7b7d7dc26873 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:16.537689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-637e207f-6929-4628-94f6-7b7d7dc26873 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:16.596716 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-637e207f-6929-4628-94f6-7b7d7dc26873 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:16.605335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-637e207f-6929-4628-94f6-7b7d7dc26873 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:16.606866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-637e207f-6929-4628-94f6-7b7d7dc26873 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:16.607999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-637e207f-6929-4628-94f6-7b7d7dc26873 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082566 Sep 14 19:59:16.608585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1156/2343] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:16 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:17.626406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c4b2ed05-8f47-443d-94bf-e09299820403 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:17.626999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c4b2ed05-8f47-443d-94bf-e09299820403 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:17.632705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4b2ed05-8f47-443d-94bf-e09299820403 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:17.633146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4b2ed05-8f47-443d-94bf-e09299820403 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:17.633932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4b2ed05-8f47-443d-94bf-e09299820403 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:17.634368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c4b2ed05-8f47-443d-94bf-e09299820403 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:17.692663 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c4b2ed05-8f47-443d-94bf-e09299820403 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:17.700747 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c4b2ed05-8f47-443d-94bf-e09299820403 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:17.702262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c4b2ed05-8f47-443d-94bf-e09299820403 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:17.703387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c4b2ed05-8f47-443d-94bf-e09299820403 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081358 Sep 14 19:59:17.703943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1188/2344] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:17 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:18.721079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fc7563fe-1c67-4e30-9f4e-2697ba40474d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:18.721784 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fc7563fe-1c67-4e30-9f4e-2697ba40474d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:18.727639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc7563fe-1c67-4e30-9f4e-2697ba40474d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:18.728087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc7563fe-1c67-4e30-9f4e-2697ba40474d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:18.728856 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc7563fe-1c67-4e30-9f4e-2697ba40474d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:18.729288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fc7563fe-1c67-4e30-9f4e-2697ba40474d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:18.788440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fc7563fe-1c67-4e30-9f4e-2697ba40474d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:18.796748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fc7563fe-1c67-4e30-9f4e-2697ba40474d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:18.798273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fc7563fe-1c67-4e30-9f4e-2697ba40474d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:18.799420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fc7563fe-1c67-4e30-9f4e-2697ba40474d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082157 Sep 14 19:59:18.800259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1157/2345] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:18 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:19.816918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3f115e64-12cf-4205-90b5-9862b470ce5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:19.817573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3f115e64-12cf-4205-90b5-9862b470ce5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:19.823294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f115e64-12cf-4205-90b5-9862b470ce5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:19.823734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f115e64-12cf-4205-90b5-9862b470ce5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:19.824484 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f115e64-12cf-4205-90b5-9862b470ce5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:19.824911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f115e64-12cf-4205-90b5-9862b470ce5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:19.885177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3f115e64-12cf-4205-90b5-9862b470ce5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:19.894011 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3f115e64-12cf-4205-90b5-9862b470ce5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:19.897207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3f115e64-12cf-4205-90b5-9862b470ce5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:19.897207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3f115e64-12cf-4205-90b5-9862b470ce5e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083355 Sep 14 19:59:19.897207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1189/2346] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:20.913984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2439b509-02d3-4821-a151-5caaab4d1a6e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:20.914617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2439b509-02d3-4821-a151-5caaab4d1a6e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:20.920861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2439b509-02d3-4821-a151-5caaab4d1a6e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:20.921242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2439b509-02d3-4821-a151-5caaab4d1a6e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:20.922694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2439b509-02d3-4821-a151-5caaab4d1a6e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:20.923130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2439b509-02d3-4821-a151-5caaab4d1a6e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:20.981098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2439b509-02d3-4821-a151-5caaab4d1a6e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:20.990210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2439b509-02d3-4821-a151-5caaab4d1a6e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:20.991716 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2439b509-02d3-4821-a151-5caaab4d1a6e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:20.992864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2439b509-02d3-4821-a151-5caaab4d1a6e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082491 Sep 14 19:59:20.993424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1158/2347] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:22.009689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-45fa6b21-51a8-4582-9b35-1880899b1341 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:22.010302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-45fa6b21-51a8-4582-9b35-1880899b1341 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:22.016172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45fa6b21-51a8-4582-9b35-1880899b1341 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:22.016620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45fa6b21-51a8-4582-9b35-1880899b1341 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:22.017377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45fa6b21-51a8-4582-9b35-1880899b1341 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:22.017838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-45fa6b21-51a8-4582-9b35-1880899b1341 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:22.078833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-45fa6b21-51a8-4582-9b35-1880899b1341 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:22.087036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-45fa6b21-51a8-4582-9b35-1880899b1341 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:22.088535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-45fa6b21-51a8-4582-9b35-1880899b1341 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:22.089702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-45fa6b21-51a8-4582-9b35-1880899b1341 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083732 Sep 14 19:59:22.090262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1190/2348] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:22 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:23.108954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-790d4441-8c90-4f03-b8c0-b78619d7f57c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:23.109639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-790d4441-8c90-4f03-b8c0-b78619d7f57c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:23.115726 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-790d4441-8c90-4f03-b8c0-b78619d7f57c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:23.116191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-790d4441-8c90-4f03-b8c0-b78619d7f57c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:23.116959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-790d4441-8c90-4f03-b8c0-b78619d7f57c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:23.117389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-790d4441-8c90-4f03-b8c0-b78619d7f57c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:23.188086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-790d4441-8c90-4f03-b8c0-b78619d7f57c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:23.196881 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-790d4441-8c90-4f03-b8c0-b78619d7f57c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:23.198396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-790d4441-8c90-4f03-b8c0-b78619d7f57c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:23.199549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-790d4441-8c90-4f03-b8c0-b78619d7f57c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.095703 Sep 14 19:59:23.200110 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1159/2349] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:24.217654 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-33fb8af9-795c-4e67-a0d5-456429803ce3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:24.218264 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-33fb8af9-795c-4e67-a0d5-456429803ce3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:24.224900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-33fb8af9-795c-4e67-a0d5-456429803ce3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:24.225355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-33fb8af9-795c-4e67-a0d5-456429803ce3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:24.226152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-33fb8af9-795c-4e67-a0d5-456429803ce3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:24.226590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-33fb8af9-795c-4e67-a0d5-456429803ce3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:24.285640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-33fb8af9-795c-4e67-a0d5-456429803ce3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:24.293871 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-33fb8af9-795c-4e67-a0d5-456429803ce3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:24.295369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-33fb8af9-795c-4e67-a0d5-456429803ce3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:24.296584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-33fb8af9-795c-4e67-a0d5-456429803ce3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082652 Sep 14 19:59:24.297148 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1191/2350] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:25.314815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-51104ade-d573-411c-9939-c075ee1193d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:25.315447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-51104ade-d573-411c-9939-c075ee1193d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:25.321570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51104ade-d573-411c-9939-c075ee1193d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:25.322024 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51104ade-d573-411c-9939-c075ee1193d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:25.322780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51104ade-d573-411c-9939-c075ee1193d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:25.323222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-51104ade-d573-411c-9939-c075ee1193d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:25.381993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-51104ade-d573-411c-9939-c075ee1193d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:25.390156 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-51104ade-d573-411c-9939-c075ee1193d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:25.391682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-51104ade-d573-411c-9939-c075ee1193d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:25.392821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-51104ade-d573-411c-9939-c075ee1193d0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082467 Sep 14 19:59:25.393383 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1160/2351] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:26.410408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2472d19d-a137-4f2b-8d3f-88681558252c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:26.411020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2472d19d-a137-4f2b-8d3f-88681558252c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:26.416823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2472d19d-a137-4f2b-8d3f-88681558252c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:26.417264 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2472d19d-a137-4f2b-8d3f-88681558252c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:26.418053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2472d19d-a137-4f2b-8d3f-88681558252c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:26.418488 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2472d19d-a137-4f2b-8d3f-88681558252c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:26.477812 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2472d19d-a137-4f2b-8d3f-88681558252c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:26.486749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2472d19d-a137-4f2b-8d3f-88681558252c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:26.488238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2472d19d-a137-4f2b-8d3f-88681558252c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:26.489379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2472d19d-a137-4f2b-8d3f-88681558252c tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082681 Sep 14 19:59:26.489972 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1192/2352] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:27.507271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5e166a47-13ff-47f2-8778-b9521e820d96 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:27.507873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5e166a47-13ff-47f2-8778-b9521e820d96 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:27.513752 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e166a47-13ff-47f2-8778-b9521e820d96 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:27.514196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e166a47-13ff-47f2-8778-b9521e820d96 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:27.514957 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e166a47-13ff-47f2-8778-b9521e820d96 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:27.515888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5e166a47-13ff-47f2-8778-b9521e820d96 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:27.574349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5e166a47-13ff-47f2-8778-b9521e820d96 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:27.582882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5e166a47-13ff-47f2-8778-b9521e820d96 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:27.584352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5e166a47-13ff-47f2-8778-b9521e820d96 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:27.585468 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5e166a47-13ff-47f2-8778-b9521e820d96 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081926 Sep 14 19:59:27.586045 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1161/2353] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:27 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:28.603635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-396f6c36-3a8b-4faa-bcbe-98e315379c78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:28.604235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-396f6c36-3a8b-4faa-bcbe-98e315379c78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:28.610697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-396f6c36-3a8b-4faa-bcbe-98e315379c78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:28.611151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-396f6c36-3a8b-4faa-bcbe-98e315379c78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:28.611912 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-396f6c36-3a8b-4faa-bcbe-98e315379c78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:28.612351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-396f6c36-3a8b-4faa-bcbe-98e315379c78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:28.669989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-396f6c36-3a8b-4faa-bcbe-98e315379c78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:28.679144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-396f6c36-3a8b-4faa-bcbe-98e315379c78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:28.680636 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-396f6c36-3a8b-4faa-bcbe-98e315379c78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:28.681803 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-396f6c36-3a8b-4faa-bcbe-98e315379c78 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081893 Sep 14 19:59:28.682367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1193/2354] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:28 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:29.699691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2483760f-9034-4f17-8f2a-9ec70b546d86 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:29.700285 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2483760f-9034-4f17-8f2a-9ec70b546d86 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:29.706107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2483760f-9034-4f17-8f2a-9ec70b546d86 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:29.706547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2483760f-9034-4f17-8f2a-9ec70b546d86 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:29.707302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2483760f-9034-4f17-8f2a-9ec70b546d86 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:29.707724 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2483760f-9034-4f17-8f2a-9ec70b546d86 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:29.767561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2483760f-9034-4f17-8f2a-9ec70b546d86 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:29.776495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2483760f-9034-4f17-8f2a-9ec70b546d86 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:29.778174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2483760f-9034-4f17-8f2a-9ec70b546d86 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:29.787536 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2483760f-9034-4f17-8f2a-9ec70b546d86 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083459 Sep 14 19:59:29.787536 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1162/2355] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:29 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:30.803444 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c45aca20-f811-45b3-9834-b373aa1f7953 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:30.804061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c45aca20-f811-45b3-9834-b373aa1f7953 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:30.809800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c45aca20-f811-45b3-9834-b373aa1f7953 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:30.810239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c45aca20-f811-45b3-9834-b373aa1f7953 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:30.810990 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c45aca20-f811-45b3-9834-b373aa1f7953 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:30.811419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c45aca20-f811-45b3-9834-b373aa1f7953 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:30.871369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c45aca20-f811-45b3-9834-b373aa1f7953 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:30.880218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c45aca20-f811-45b3-9834-b373aa1f7953 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:30.881723 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c45aca20-f811-45b3-9834-b373aa1f7953 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:30.882857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c45aca20-f811-45b3-9834-b373aa1f7953 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083349 Sep 14 19:59:30.883398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1194/2356] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:30 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:31.900937 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2ee7ab82-df7b-4e8c-835e-ca6c6171c0a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:31.901558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2ee7ab82-df7b-4e8c-835e-ca6c6171c0a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:31.907321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ee7ab82-df7b-4e8c-835e-ca6c6171c0a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:31.907757 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ee7ab82-df7b-4e8c-835e-ca6c6171c0a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:31.908508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ee7ab82-df7b-4e8c-835e-ca6c6171c0a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:31.908935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2ee7ab82-df7b-4e8c-835e-ca6c6171c0a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:31.967129 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2ee7ab82-df7b-4e8c-835e-ca6c6171c0a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:31.975292 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2ee7ab82-df7b-4e8c-835e-ca6c6171c0a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:31.976764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2ee7ab82-df7b-4e8c-835e-ca6c6171c0a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:31.977923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2ee7ab82-df7b-4e8c-835e-ca6c6171c0a3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.080612 Sep 14 19:59:31.978478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1163/2357] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:31 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:32.995895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0b5fcf1e-eb79-4b70-b958-e01a27b95d01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:32.996505 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0b5fcf1e-eb79-4b70-b958-e01a27b95d01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:33.002791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b5fcf1e-eb79-4b70-b958-e01a27b95d01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:33.003231 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b5fcf1e-eb79-4b70-b958-e01a27b95d01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:33.003985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b5fcf1e-eb79-4b70-b958-e01a27b95d01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:33.004422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b5fcf1e-eb79-4b70-b958-e01a27b95d01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:33.063818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0b5fcf1e-eb79-4b70-b958-e01a27b95d01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:33.071946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0b5fcf1e-eb79-4b70-b958-e01a27b95d01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:33.073422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0b5fcf1e-eb79-4b70-b958-e01a27b95d01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:33.074596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0b5fcf1e-eb79-4b70-b958-e01a27b95d01 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082442 Sep 14 19:59:33.075285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1195/2358] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:32 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:34.092937 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7b0fdc6d-6534-4b47-89f0-91744ed32b0b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:34.094148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7b0fdc6d-6534-4b47-89f0-91744ed32b0b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:34.100250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b0fdc6d-6534-4b47-89f0-91744ed32b0b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:34.100767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b0fdc6d-6534-4b47-89f0-91744ed32b0b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:34.101639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b0fdc6d-6534-4b47-89f0-91744ed32b0b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:34.102164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7b0fdc6d-6534-4b47-89f0-91744ed32b0b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:34.164026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7b0fdc6d-6534-4b47-89f0-91744ed32b0b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:34.172247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7b0fdc6d-6534-4b47-89f0-91744ed32b0b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:34.173773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7b0fdc6d-6534-4b47-89f0-91744ed32b0b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:34.175184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7b0fdc6d-6534-4b47-89f0-91744ed32b0b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085801 Sep 14 19:59:34.175745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1164/2359] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:34 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:35.192123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dd31b301-1208-4f18-9c5d-172b179c00b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:35.192726 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dd31b301-1208-4f18-9c5d-172b179c00b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:35.198502 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd31b301-1208-4f18-9c5d-172b179c00b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:35.198944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd31b301-1208-4f18-9c5d-172b179c00b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:35.199705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd31b301-1208-4f18-9c5d-172b179c00b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:35.200136 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd31b301-1208-4f18-9c5d-172b179c00b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:35.264151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dd31b301-1208-4f18-9c5d-172b179c00b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:35.272628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dd31b301-1208-4f18-9c5d-172b179c00b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:35.274179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dd31b301-1208-4f18-9c5d-172b179c00b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:35.275328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dd31b301-1208-4f18-9c5d-172b179c00b3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.086829 Sep 14 19:59:35.275889 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1196/2360] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:35 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:36.293443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a4b119ae-78ab-4d01-a18a-2aa2fde26a68 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:36.294186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a4b119ae-78ab-4d01-a18a-2aa2fde26a68 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:36.301316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4b119ae-78ab-4d01-a18a-2aa2fde26a68 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:36.301743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4b119ae-78ab-4d01-a18a-2aa2fde26a68 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:36.302519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4b119ae-78ab-4d01-a18a-2aa2fde26a68 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:36.303117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4b119ae-78ab-4d01-a18a-2aa2fde26a68 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:36.367077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a4b119ae-78ab-4d01-a18a-2aa2fde26a68 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:36.375342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a4b119ae-78ab-4d01-a18a-2aa2fde26a68 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:36.376824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a4b119ae-78ab-4d01-a18a-2aa2fde26a68 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:36.377993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a4b119ae-78ab-4d01-a18a-2aa2fde26a68 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.088365 Sep 14 19:59:36.378554 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1165/2361] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:36 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:37.395716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b4e9a217-e68b-4ad6-9225-ebcbfcd79b9b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:37.396325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b4e9a217-e68b-4ad6-9225-ebcbfcd79b9b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:37.402144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b4e9a217-e68b-4ad6-9225-ebcbfcd79b9b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:37.402599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b4e9a217-e68b-4ad6-9225-ebcbfcd79b9b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:37.403361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b4e9a217-e68b-4ad6-9225-ebcbfcd79b9b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:37.403797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b4e9a217-e68b-4ad6-9225-ebcbfcd79b9b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:37.463112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b4e9a217-e68b-4ad6-9225-ebcbfcd79b9b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:37.471738 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b4e9a217-e68b-4ad6-9225-ebcbfcd79b9b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:37.473223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b4e9a217-e68b-4ad6-9225-ebcbfcd79b9b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:37.474454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b4e9a217-e68b-4ad6-9225-ebcbfcd79b9b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082417 Sep 14 19:59:37.475016 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1197/2362] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:38.492393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-127c3d16-0236-4593-a16b-cfbb121a09c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:38.493003 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-127c3d16-0236-4593-a16b-cfbb121a09c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:38.498864 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-127c3d16-0236-4593-a16b-cfbb121a09c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:38.499959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-127c3d16-0236-4593-a16b-cfbb121a09c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:38.500721 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-127c3d16-0236-4593-a16b-cfbb121a09c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:38.501161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-127c3d16-0236-4593-a16b-cfbb121a09c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:38.560124 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-127c3d16-0236-4593-a16b-cfbb121a09c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:38.569137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-127c3d16-0236-4593-a16b-cfbb121a09c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:38.570687 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-127c3d16-0236-4593-a16b-cfbb121a09c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:38.571805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-127c3d16-0236-4593-a16b-cfbb121a09c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083106 Sep 14 19:59:38.572367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1166/2363] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:38 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:39.589793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4a87b024-9ff9-4dfa-85c4-03a9191ec221 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:39.590429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4a87b024-9ff9-4dfa-85c4-03a9191ec221 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:39.596909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a87b024-9ff9-4dfa-85c4-03a9191ec221 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:39.597354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a87b024-9ff9-4dfa-85c4-03a9191ec221 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:39.598155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a87b024-9ff9-4dfa-85c4-03a9191ec221 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:39.598586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a87b024-9ff9-4dfa-85c4-03a9191ec221 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:39.658014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4a87b024-9ff9-4dfa-85c4-03a9191ec221 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:39.666157 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4a87b024-9ff9-4dfa-85c4-03a9191ec221 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:39.667629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4a87b024-9ff9-4dfa-85c4-03a9191ec221 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:39.668770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4a87b024-9ff9-4dfa-85c4-03a9191ec221 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082720 Sep 14 19:59:39.669316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1198/2364] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:39 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:40.686857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a12a1183-42c4-4834-968a-d2717a3f3a49 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:40.687452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a12a1183-42c4-4834-968a-d2717a3f3a49 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:40.693580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a12a1183-42c4-4834-968a-d2717a3f3a49 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:40.693956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a12a1183-42c4-4834-968a-d2717a3f3a49 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:40.694718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a12a1183-42c4-4834-968a-d2717a3f3a49 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:40.695155 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a12a1183-42c4-4834-968a-d2717a3f3a49 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:40.754649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a12a1183-42c4-4834-968a-d2717a3f3a49 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:40.763002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a12a1183-42c4-4834-968a-d2717a3f3a49 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:40.764476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a12a1183-42c4-4834-968a-d2717a3f3a49 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:40.766153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a12a1183-42c4-4834-968a-d2717a3f3a49 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083153 Sep 14 19:59:40.766688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1167/2365] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:41.782428 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7cb97d13-a0e6-4f9c-8475-650a59733620 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:41.783036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7cb97d13-a0e6-4f9c-8475-650a59733620 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:41.788952 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7cb97d13-a0e6-4f9c-8475-650a59733620 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:41.789612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7cb97d13-a0e6-4f9c-8475-650a59733620 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:41.790287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7cb97d13-a0e6-4f9c-8475-650a59733620 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:41.790603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7cb97d13-a0e6-4f9c-8475-650a59733620 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:41.854964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7cb97d13-a0e6-4f9c-8475-650a59733620 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:41.864151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7cb97d13-a0e6-4f9c-8475-650a59733620 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:41.865680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7cb97d13-a0e6-4f9c-8475-650a59733620 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:41.866826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7cb97d13-a0e6-4f9c-8475-650a59733620 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.088009 Sep 14 19:59:41.867377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1199/2366] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:41 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:42.883908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6b45e165-a411-4909-b62a-e5a0c5790f3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:42.884504 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6b45e165-a411-4909-b62a-e5a0c5790f3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:42.891154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b45e165-a411-4909-b62a-e5a0c5790f3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:42.891627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b45e165-a411-4909-b62a-e5a0c5790f3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:42.892435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b45e165-a411-4909-b62a-e5a0c5790f3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:42.892874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6b45e165-a411-4909-b62a-e5a0c5790f3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:42.951428 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6b45e165-a411-4909-b62a-e5a0c5790f3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:42.960245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6b45e165-a411-4909-b62a-e5a0c5790f3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:42.961779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6b45e165-a411-4909-b62a-e5a0c5790f3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:42.962921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6b45e165-a411-4909-b62a-e5a0c5790f3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082764 Sep 14 19:59:42.963476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1168/2367] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:42 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:43.980569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-52925842-4c86-4123-8b42-b06e7bd11200 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:43.981441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-52925842-4c86-4123-8b42-b06e7bd11200 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:43.987132 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52925842-4c86-4123-8b42-b06e7bd11200 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:43.987577 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52925842-4c86-4123-8b42-b06e7bd11200 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:43.988328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52925842-4c86-4123-8b42-b06e7bd11200 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:43.988760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-52925842-4c86-4123-8b42-b06e7bd11200 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:44.048826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-52925842-4c86-4123-8b42-b06e7bd11200 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:44.057484 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-52925842-4c86-4123-8b42-b06e7bd11200 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:44.059004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-52925842-4c86-4123-8b42-b06e7bd11200 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:44.060143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-52925842-4c86-4123-8b42-b06e7bd11200 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083358 Sep 14 19:59:44.060693 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1200/2368] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:45.078190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-975f5ab3-080c-43b7-8a9a-1bff7a3464af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:45.078777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-975f5ab3-080c-43b7-8a9a-1bff7a3464af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:45.084684 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-975f5ab3-080c-43b7-8a9a-1bff7a3464af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:45.085119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-975f5ab3-080c-43b7-8a9a-1bff7a3464af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:45.085924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-975f5ab3-080c-43b7-8a9a-1bff7a3464af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:45.086350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-975f5ab3-080c-43b7-8a9a-1bff7a3464af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:45.145913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-975f5ab3-080c-43b7-8a9a-1bff7a3464af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:45.154354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-975f5ab3-080c-43b7-8a9a-1bff7a3464af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:45.156513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-975f5ab3-080c-43b7-8a9a-1bff7a3464af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:45.157701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-975f5ab3-080c-43b7-8a9a-1bff7a3464af tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083343 Sep 14 19:59:45.158270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1169/2369] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:46.176048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-60949879-f29f-4d25-9ca2-69c591fe00ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:46.176660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-60949879-f29f-4d25-9ca2-69c591fe00ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:46.183008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60949879-f29f-4d25-9ca2-69c591fe00ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:46.183463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60949879-f29f-4d25-9ca2-69c591fe00ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:46.184244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60949879-f29f-4d25-9ca2-69c591fe00ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:46.184686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60949879-f29f-4d25-9ca2-69c591fe00ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:46.245253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-60949879-f29f-4d25-9ca2-69c591fe00ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:46.257364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-60949879-f29f-4d25-9ca2-69c591fe00ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:46.257364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-60949879-f29f-4d25-9ca2-69c591fe00ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:46.257364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-60949879-f29f-4d25-9ca2-69c591fe00ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084685 Sep 14 19:59:46.257915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1201/2370] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:47.274431 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6590d722-6c7b-4bd0-a4c4-97745dd4f0c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:47.275041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6590d722-6c7b-4bd0-a4c4-97745dd4f0c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:47.281269 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6590d722-6c7b-4bd0-a4c4-97745dd4f0c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:47.281701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6590d722-6c7b-4bd0-a4c4-97745dd4f0c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:47.282492 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6590d722-6c7b-4bd0-a4c4-97745dd4f0c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:47.282933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6590d722-6c7b-4bd0-a4c4-97745dd4f0c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:47.342688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6590d722-6c7b-4bd0-a4c4-97745dd4f0c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:47.350809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6590d722-6c7b-4bd0-a4c4-97745dd4f0c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:47.352296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6590d722-6c7b-4bd0-a4c4-97745dd4f0c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:47.353423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6590d722-6c7b-4bd0-a4c4-97745dd4f0c1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082713 Sep 14 19:59:47.354009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1170/2371] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:47 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:48.371241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7c5849b0-7f17-4288-b6df-1b85c695fb7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:48.371904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7c5849b0-7f17-4288-b6df-1b85c695fb7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:48.378559 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7c5849b0-7f17-4288-b6df-1b85c695fb7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:48.379009 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7c5849b0-7f17-4288-b6df-1b85c695fb7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:48.379801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7c5849b0-7f17-4288-b6df-1b85c695fb7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:48.380246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7c5849b0-7f17-4288-b6df-1b85c695fb7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:48.447510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7c5849b0-7f17-4288-b6df-1b85c695fb7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:48.457209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7c5849b0-7f17-4288-b6df-1b85c695fb7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:48.458729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7c5849b0-7f17-4288-b6df-1b85c695fb7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:48.459881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7c5849b0-7f17-4288-b6df-1b85c695fb7d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.092601 Sep 14 19:59:48.460436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1202/2372] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:48 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:49.478605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-44cc1881-9b6e-49d8-824e-468fe823e267 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:49.479421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-44cc1881-9b6e-49d8-824e-468fe823e267 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:49.485712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-44cc1881-9b6e-49d8-824e-468fe823e267 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:49.486167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-44cc1881-9b6e-49d8-824e-468fe823e267 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:49.486930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-44cc1881-9b6e-49d8-824e-468fe823e267 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:49.487364 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-44cc1881-9b6e-49d8-824e-468fe823e267 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:49.548263 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-44cc1881-9b6e-49d8-824e-468fe823e267 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:49.556705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-44cc1881-9b6e-49d8-824e-468fe823e267 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:49.558286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-44cc1881-9b6e-49d8-824e-468fe823e267 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:49.559419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-44cc1881-9b6e-49d8-824e-468fe823e267 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084752 Sep 14 19:59:49.559983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1171/2373] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:49 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:50.577083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1c637063-4974-43d2-a66c-0329b45703c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:50.577623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1c637063-4974-43d2-a66c-0329b45703c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:50.583415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c637063-4974-43d2-a66c-0329b45703c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:50.583861 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c637063-4974-43d2-a66c-0329b45703c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:50.584620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c637063-4974-43d2-a66c-0329b45703c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:50.585058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c637063-4974-43d2-a66c-0329b45703c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:50.644336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1c637063-4974-43d2-a66c-0329b45703c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:50.652720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1c637063-4974-43d2-a66c-0329b45703c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:50.654182 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1c637063-4974-43d2-a66c-0329b45703c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:50.655465 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1c637063-4974-43d2-a66c-0329b45703c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082102 Sep 14 19:59:50.655919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1203/2374] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:50 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:51.672493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bad7d46d-27d1-4228-aa48-c4d0ed3079fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:51.673110 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bad7d46d-27d1-4228-aa48-c4d0ed3079fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:51.679359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bad7d46d-27d1-4228-aa48-c4d0ed3079fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:51.679798 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bad7d46d-27d1-4228-aa48-c4d0ed3079fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:51.680569 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bad7d46d-27d1-4228-aa48-c4d0ed3079fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:51.681049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bad7d46d-27d1-4228-aa48-c4d0ed3079fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:51.739305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bad7d46d-27d1-4228-aa48-c4d0ed3079fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:51.747658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bad7d46d-27d1-4228-aa48-c4d0ed3079fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:51.749767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bad7d46d-27d1-4228-aa48-c4d0ed3079fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:51.750985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bad7d46d-27d1-4228-aa48-c4d0ed3079fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082230 Sep 14 19:59:51.751556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1172/2375] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:51 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:52.767971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-29d001a4-4d11-438a-b170-c118fdb4cab3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:52.768612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-29d001a4-4d11-438a-b170-c118fdb4cab3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:52.774963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29d001a4-4d11-438a-b170-c118fdb4cab3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:52.775356 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29d001a4-4d11-438a-b170-c118fdb4cab3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:52.776137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29d001a4-4d11-438a-b170-c118fdb4cab3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:52.776577 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29d001a4-4d11-438a-b170-c118fdb4cab3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:52.837609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-29d001a4-4d11-438a-b170-c118fdb4cab3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:52.845844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-29d001a4-4d11-438a-b170-c118fdb4cab3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:52.847330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-29d001a4-4d11-438a-b170-c118fdb4cab3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:52.848463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-29d001a4-4d11-438a-b170-c118fdb4cab3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084259 Sep 14 19:59:52.849012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1204/2376] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:52 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:53.866983 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-49a34254-2741-456a-b699-966f08855082 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:53.867610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-49a34254-2741-456a-b699-966f08855082 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:53.873707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49a34254-2741-456a-b699-966f08855082 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:53.874649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49a34254-2741-456a-b699-966f08855082 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:53.875399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49a34254-2741-456a-b699-966f08855082 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:53.875854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-49a34254-2741-456a-b699-966f08855082 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:53.937766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-49a34254-2741-456a-b699-966f08855082 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:53.946164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-49a34254-2741-456a-b699-966f08855082 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:53.947697 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-49a34254-2741-456a-b699-966f08855082 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:53.948828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-49a34254-2741-456a-b699-966f08855082 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085689 Sep 14 19:59:53.949375 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1173/2377] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:53 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:54.966923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0a615dd1-5d92-410a-ac26-70b47501955d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:54.967594 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0a615dd1-5d92-410a-ac26-70b47501955d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:54.973398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a615dd1-5d92-410a-ac26-70b47501955d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:54.973865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a615dd1-5d92-410a-ac26-70b47501955d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:54.974613 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a615dd1-5d92-410a-ac26-70b47501955d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:54.975041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0a615dd1-5d92-410a-ac26-70b47501955d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:55.034031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0a615dd1-5d92-410a-ac26-70b47501955d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:55.042353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0a615dd1-5d92-410a-ac26-70b47501955d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:55.043867 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0a615dd1-5d92-410a-ac26-70b47501955d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:55.045060 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0a615dd1-5d92-410a-ac26-70b47501955d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081809 Sep 14 19:59:55.045570 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1205/2378] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:54 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:56.062707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cfe3a33d-6e7a-4614-b73f-e694140e09f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:56.063310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cfe3a33d-6e7a-4614-b73f-e694140e09f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:56.069160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cfe3a33d-6e7a-4614-b73f-e694140e09f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:56.069641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cfe3a33d-6e7a-4614-b73f-e694140e09f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:56.070404 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cfe3a33d-6e7a-4614-b73f-e694140e09f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:56.070842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cfe3a33d-6e7a-4614-b73f-e694140e09f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:56.129482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cfe3a33d-6e7a-4614-b73f-e694140e09f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:56.137681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cfe3a33d-6e7a-4614-b73f-e694140e09f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:56.139169 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cfe3a33d-6e7a-4614-b73f-e694140e09f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:56.140865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cfe3a33d-6e7a-4614-b73f-e694140e09f2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081901 Sep 14 19:59:56.141424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1174/2379] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:56 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:57.159116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4947022a-b2ba-42a6-bedc-4cb646be451f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:57.159729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4947022a-b2ba-42a6-bedc-4cb646be451f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:57.165574 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4947022a-b2ba-42a6-bedc-4cb646be451f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:57.166028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4947022a-b2ba-42a6-bedc-4cb646be451f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:57.166787 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4947022a-b2ba-42a6-bedc-4cb646be451f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:57.167235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4947022a-b2ba-42a6-bedc-4cb646be451f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:57.226401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4947022a-b2ba-42a6-bedc-4cb646be451f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:57.234492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4947022a-b2ba-42a6-bedc-4cb646be451f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:57.235994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4947022a-b2ba-42a6-bedc-4cb646be451f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:57.237130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4947022a-b2ba-42a6-bedc-4cb646be451f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082216 Sep 14 19:59:57.237724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1206/2380] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:57 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:58.255227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ee76ef91-f039-4ca5-8e9b-2f9d97d37732 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:58.255843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ee76ef91-f039-4ca5-8e9b-2f9d97d37732 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:58.262326 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee76ef91-f039-4ca5-8e9b-2f9d97d37732 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:58.262779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee76ef91-f039-4ca5-8e9b-2f9d97d37732 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:58.263565 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee76ef91-f039-4ca5-8e9b-2f9d97d37732 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:58.263998 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee76ef91-f039-4ca5-8e9b-2f9d97d37732 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:58.324500 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ee76ef91-f039-4ca5-8e9b-2f9d97d37732 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:58.333512 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ee76ef91-f039-4ca5-8e9b-2f9d97d37732 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:58.335144 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ee76ef91-f039-4ca5-8e9b-2f9d97d37732 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:58.336287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ee76ef91-f039-4ca5-8e9b-2f9d97d37732 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084826 Sep 14 19:59:58.336860 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1175/2381] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:58 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:59:59.354557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dffb08a2-255b-4ae6-be9b-7949c7d71315 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:59.355213 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dffb08a2-255b-4ae6-be9b-7949c7d71315 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 19:59:59.361715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dffb08a2-255b-4ae6-be9b-7949c7d71315 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:59.362159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dffb08a2-255b-4ae6-be9b-7949c7d71315 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:59.362912 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dffb08a2-255b-4ae6-be9b-7949c7d71315 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 19:59:59.363347 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dffb08a2-255b-4ae6-be9b-7949c7d71315 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 19:59:59.421524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dffb08a2-255b-4ae6-be9b-7949c7d71315 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:59.432909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dffb08a2-255b-4ae6-be9b-7949c7d71315 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:59.434457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dffb08a2-255b-4ae6-be9b-7949c7d71315 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:59.435639 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dffb08a2-255b-4ae6-be9b-7949c7d71315 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084725 Sep 14 19:59:59.436231 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1207/2382] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 19:59:59 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:00.453484 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cf83fc16-f61a-4bf0-8e65-33c90c9b4531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:00.454115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cf83fc16-f61a-4bf0-8e65-33c90c9b4531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:00.459965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cf83fc16-f61a-4bf0-8e65-33c90c9b4531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:00.460436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cf83fc16-f61a-4bf0-8e65-33c90c9b4531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:00.461211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cf83fc16-f61a-4bf0-8e65-33c90c9b4531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:00.461676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cf83fc16-f61a-4bf0-8e65-33c90c9b4531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:00.525086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cf83fc16-f61a-4bf0-8e65-33c90c9b4531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:00.534338 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cf83fc16-f61a-4bf0-8e65-33c90c9b4531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:00.535878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cf83fc16-f61a-4bf0-8e65-33c90c9b4531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:00.537033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cf83fc16-f61a-4bf0-8e65-33c90c9b4531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.087730 Sep 14 20:00:00.537638 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1176/2383] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:00 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:01.555220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ae921dc9-caf5-4d4f-a830-4348252f76c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:01.555858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ae921dc9-caf5-4d4f-a830-4348252f76c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:01.562361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae921dc9-caf5-4d4f-a830-4348252f76c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:01.562812 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae921dc9-caf5-4d4f-a830-4348252f76c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:01.563583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae921dc9-caf5-4d4f-a830-4348252f76c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:01.564021 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae921dc9-caf5-4d4f-a830-4348252f76c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:01.627390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ae921dc9-caf5-4d4f-a830-4348252f76c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:01.635608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ae921dc9-caf5-4d4f-a830-4348252f76c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:01.637096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ae921dc9-caf5-4d4f-a830-4348252f76c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:01.638265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ae921dc9-caf5-4d4f-a830-4348252f76c9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.086941 Sep 14 20:00:01.638823 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1208/2384] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:01 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:02.656389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8455dd01-e930-4970-8ef2-518291c2f35a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:02.656996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8455dd01-e930-4970-8ef2-518291c2f35a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:02.662735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8455dd01-e930-4970-8ef2-518291c2f35a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:02.671248 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8455dd01-e930-4970-8ef2-518291c2f35a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:02.672085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8455dd01-e930-4970-8ef2-518291c2f35a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:02.672533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8455dd01-e930-4970-8ef2-518291c2f35a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:02.735553 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8455dd01-e930-4970-8ef2-518291c2f35a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:02.743665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8455dd01-e930-4970-8ef2-518291c2f35a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:02.745146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8455dd01-e930-4970-8ef2-518291c2f35a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:02.746302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8455dd01-e930-4970-8ef2-518291c2f35a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.094122 Sep 14 20:00:02.746854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1177/2385] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:02 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:03.404839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:00:03.405058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:00:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:00:03.764117 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4a0cb660-b1ee-451c-9149-59e777f723e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:03.764735 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4a0cb660-b1ee-451c-9149-59e777f723e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:03.770547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a0cb660-b1ee-451c-9149-59e777f723e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:03.770997 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a0cb660-b1ee-451c-9149-59e777f723e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:03.771797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a0cb660-b1ee-451c-9149-59e777f723e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:03.772232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4a0cb660-b1ee-451c-9149-59e777f723e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:03.831342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4a0cb660-b1ee-451c-9149-59e777f723e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:03.840125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4a0cb660-b1ee-451c-9149-59e777f723e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:03.841622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4a0cb660-b1ee-451c-9149-59e777f723e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:03.842776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4a0cb660-b1ee-451c-9149-59e777f723e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083115 Sep 14 20:00:03.843807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1209/2386] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:03 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:04.665212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:00:04.665460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:00:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:00:04.860490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c9306927-4a15-43a5-b236-54444f4dd871 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:04.861104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c9306927-4a15-43a5-b236-54444f4dd871 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:04.866962 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9306927-4a15-43a5-b236-54444f4dd871 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:04.867407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9306927-4a15-43a5-b236-54444f4dd871 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:04.868171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9306927-4a15-43a5-b236-54444f4dd871 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:04.868605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c9306927-4a15-43a5-b236-54444f4dd871 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:04.932559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c9306927-4a15-43a5-b236-54444f4dd871 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:04.941666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c9306927-4a15-43a5-b236-54444f4dd871 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:04.943174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c9306927-4a15-43a5-b236-54444f4dd871 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:04.944325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c9306927-4a15-43a5-b236-54444f4dd871 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.088061 Sep 14 20:00:04.944876 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1178/2387] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:04 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:05.962067 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-18f7169e-2b95-4e7f-902b-bd610fa79915 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:05.962678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-18f7169e-2b95-4e7f-902b-bd610fa79915 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:05.968555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18f7169e-2b95-4e7f-902b-bd610fa79915 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:05.969054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18f7169e-2b95-4e7f-902b-bd610fa79915 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:05.969893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18f7169e-2b95-4e7f-902b-bd610fa79915 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:05.970338 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18f7169e-2b95-4e7f-902b-bd610fa79915 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:06.029926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-18f7169e-2b95-4e7f-902b-bd610fa79915 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:06.038195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-18f7169e-2b95-4e7f-902b-bd610fa79915 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:06.039771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-18f7169e-2b95-4e7f-902b-bd610fa79915 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:06.040844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-18f7169e-2b95-4e7f-902b-bd610fa79915 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082518 Sep 14 20:00:06.041398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1210/2388] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:05 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:07.058623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bb885e3f-48bb-4e06-ab7b-e9611da22090 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:07.059121 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bb885e3f-48bb-4e06-ab7b-e9611da22090 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:07.064837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb885e3f-48bb-4e06-ab7b-e9611da22090 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:07.065282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb885e3f-48bb-4e06-ab7b-e9611da22090 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:07.066085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb885e3f-48bb-4e06-ab7b-e9611da22090 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:07.066522 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bb885e3f-48bb-4e06-ab7b-e9611da22090 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:07.125640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bb885e3f-48bb-4e06-ab7b-e9611da22090 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:07.134203 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bb885e3f-48bb-4e06-ab7b-e9611da22090 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:07.135707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bb885e3f-48bb-4e06-ab7b-e9611da22090 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:07.136846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bb885e3f-48bb-4e06-ab7b-e9611da22090 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082501 Sep 14 20:00:07.137400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1179/2389] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:07 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:08.156131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-462be55e-19ec-46dc-9602-2071e6635ca2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:08.156742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-462be55e-19ec-46dc-9602-2071e6635ca2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:08.162581 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-462be55e-19ec-46dc-9602-2071e6635ca2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:08.163032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-462be55e-19ec-46dc-9602-2071e6635ca2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:08.163775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-462be55e-19ec-46dc-9602-2071e6635ca2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:08.164204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-462be55e-19ec-46dc-9602-2071e6635ca2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:08.222045 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-462be55e-19ec-46dc-9602-2071e6635ca2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:08.230293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-462be55e-19ec-46dc-9602-2071e6635ca2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:08.231761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-462be55e-19ec-46dc-9602-2071e6635ca2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:08.232882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-462be55e-19ec-46dc-9602-2071e6635ca2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.080899 Sep 14 20:00:08.233440 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1211/2390] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:08 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:09.251585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-32b6cc49-04e4-4bf9-bc13-cd4c61c3b42b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:09.252191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-32b6cc49-04e4-4bf9-bc13-cd4c61c3b42b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:09.258378 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32b6cc49-04e4-4bf9-bc13-cd4c61c3b42b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:09.258822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32b6cc49-04e4-4bf9-bc13-cd4c61c3b42b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:09.259590 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32b6cc49-04e4-4bf9-bc13-cd4c61c3b42b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:09.260016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32b6cc49-04e4-4bf9-bc13-cd4c61c3b42b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:09.320208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-32b6cc49-04e4-4bf9-bc13-cd4c61c3b42b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:09.328545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-32b6cc49-04e4-4bf9-bc13-cd4c61c3b42b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:09.330067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-32b6cc49-04e4-4bf9-bc13-cd4c61c3b42b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:09.331240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-32b6cc49-04e4-4bf9-bc13-cd4c61c3b42b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084000 Sep 14 20:00:09.331787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1180/2391] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:09 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:10.349046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-57e6ab83-c16a-40d8-8b4c-e64a9a276767 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:10.349682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-57e6ab83-c16a-40d8-8b4c-e64a9a276767 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:10.355553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-57e6ab83-c16a-40d8-8b4c-e64a9a276767 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:10.355944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-57e6ab83-c16a-40d8-8b4c-e64a9a276767 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:10.356711 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-57e6ab83-c16a-40d8-8b4c-e64a9a276767 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:10.357151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-57e6ab83-c16a-40d8-8b4c-e64a9a276767 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:10.418592 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-57e6ab83-c16a-40d8-8b4c-e64a9a276767 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:10.427560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-57e6ab83-c16a-40d8-8b4c-e64a9a276767 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:10.429054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-57e6ab83-c16a-40d8-8b4c-e64a9a276767 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:10.430255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-57e6ab83-c16a-40d8-8b4c-e64a9a276767 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084888 Sep 14 20:00:10.430802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1212/2392] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:10 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:11.448242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a513bb1b-2f6e-4e54-85d0-4e2ccdbadb44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:11.448842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a513bb1b-2f6e-4e54-85d0-4e2ccdbadb44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:11.455191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a513bb1b-2f6e-4e54-85d0-4e2ccdbadb44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:11.455638 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a513bb1b-2f6e-4e54-85d0-4e2ccdbadb44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:11.456401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a513bb1b-2f6e-4e54-85d0-4e2ccdbadb44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:11.456838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a513bb1b-2f6e-4e54-85d0-4e2ccdbadb44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:11.514692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a513bb1b-2f6e-4e54-85d0-4e2ccdbadb44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:11.523423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a513bb1b-2f6e-4e54-85d0-4e2ccdbadb44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:11.524941 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a513bb1b-2f6e-4e54-85d0-4e2ccdbadb44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:11.526118 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a513bb1b-2f6e-4e54-85d0-4e2ccdbadb44 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081608 Sep 14 20:00:11.526678 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1181/2393] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:11 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:12.543686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a6b4137c-c0a4-442c-93bc-f0a58ae4d33f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:12.544221 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a6b4137c-c0a4-442c-93bc-f0a58ae4d33f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:12.550943 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6b4137c-c0a4-442c-93bc-f0a58ae4d33f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:12.551396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6b4137c-c0a4-442c-93bc-f0a58ae4d33f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:12.552161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6b4137c-c0a4-442c-93bc-f0a58ae4d33f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:12.552602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6b4137c-c0a4-442c-93bc-f0a58ae4d33f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:12.614232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a6b4137c-c0a4-442c-93bc-f0a58ae4d33f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:12.622379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a6b4137c-c0a4-442c-93bc-f0a58ae4d33f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:12.623893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a6b4137c-c0a4-442c-93bc-f0a58ae4d33f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:12.625028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a6b4137c-c0a4-442c-93bc-f0a58ae4d33f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085193 Sep 14 20:00:12.625608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1213/2394] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:12 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:13.643382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-df5460b6-a1e9-477f-bc18-c1077e7a87cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:13.643996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-df5460b6-a1e9-477f-bc18-c1077e7a87cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:13.649873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df5460b6-a1e9-477f-bc18-c1077e7a87cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:13.650320 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df5460b6-a1e9-477f-bc18-c1077e7a87cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:13.651086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df5460b6-a1e9-477f-bc18-c1077e7a87cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:13.651518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df5460b6-a1e9-477f-bc18-c1077e7a87cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:13.710108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-df5460b6-a1e9-477f-bc18-c1077e7a87cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:13.718264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-df5460b6-a1e9-477f-bc18-c1077e7a87cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:13.719801 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-df5460b6-a1e9-477f-bc18-c1077e7a87cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:13.720937 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-df5460b6-a1e9-477f-bc18-c1077e7a87cb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082027 Sep 14 20:00:13.721489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1182/2395] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:13 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:14.343607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:00:14.344098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:00:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:00:14.738546 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-36897e6b-ab39-416e-b7ab-4c299cc6d908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:14.739161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-36897e6b-ab39-416e-b7ab-4c299cc6d908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:14.741552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 20:00:14.746203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36897e6b-ab39-416e-b7ab-4c299cc6d908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:14.746660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36897e6b-ab39-416e-b7ab-4c299cc6d908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:14.747531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36897e6b-ab39-416e-b7ab-4c299cc6d908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:14.747966 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36897e6b-ab39-416e-b7ab-4c299cc6d908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:14.807306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-36897e6b-ab39-416e-b7ab-4c299cc6d908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:14.815974 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-36897e6b-ab39-416e-b7ab-4c299cc6d908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:14.817466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-36897e6b-ab39-416e-b7ab-4c299cc6d908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:14.818628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-36897e6b-ab39-416e-b7ab-4c299cc6d908 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083841 Sep 14 20:00:14.819174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1214/2396] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:14 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:15.836176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-22caee7f-6bfa-46f7-9a53-90d072d45526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:15.836899 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-22caee7f-6bfa-46f7-9a53-90d072d45526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:15.842850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22caee7f-6bfa-46f7-9a53-90d072d45526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:15.843309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22caee7f-6bfa-46f7-9a53-90d072d45526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:15.844086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22caee7f-6bfa-46f7-9a53-90d072d45526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:15.845014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-22caee7f-6bfa-46f7-9a53-90d072d45526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:15.911443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-22caee7f-6bfa-46f7-9a53-90d072d45526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:15.919702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-22caee7f-6bfa-46f7-9a53-90d072d45526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:15.921195 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-22caee7f-6bfa-46f7-9a53-90d072d45526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:15.922358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-22caee7f-6bfa-46f7-9a53-90d072d45526 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.089992 Sep 14 20:00:15.922922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1183/2397] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:15 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:16.940015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ca25efa2-7876-4bce-9b8d-6c653f43e7d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:16.940689 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ca25efa2-7876-4bce-9b8d-6c653f43e7d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:16.962959 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 33820. Sep 14 20:00:16.965036 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca25efa2-7876-4bce-9b8d-6c653f43e7d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:16.965486 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca25efa2-7876-4bce-9b8d-6c653f43e7d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:16.966327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca25efa2-7876-4bce-9b8d-6c653f43e7d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:16.966767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca25efa2-7876-4bce-9b8d-6c653f43e7d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:17.027194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ca25efa2-7876-4bce-9b8d-6c653f43e7d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:17.036173 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ca25efa2-7876-4bce-9b8d-6c653f43e7d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:17.037629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ca25efa2-7876-4bce-9b8d-6c653f43e7d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:17.038762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ca25efa2-7876-4bce-9b8d-6c653f43e7d1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.102497 Sep 14 20:00:17.039325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1215/2398] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:16 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:18.057355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f5e7f613-c298-4bc1-8f70-5d1bc5c85c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:18.057997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f5e7f613-c298-4bc1-8f70-5d1bc5c85c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:18.064153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5e7f613-c298-4bc1-8f70-5d1bc5c85c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:18.064603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5e7f613-c298-4bc1-8f70-5d1bc5c85c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:18.065363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5e7f613-c298-4bc1-8f70-5d1bc5c85c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:18.065819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f5e7f613-c298-4bc1-8f70-5d1bc5c85c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:18.127857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f5e7f613-c298-4bc1-8f70-5d1bc5c85c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:18.135856 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f5e7f613-c298-4bc1-8f70-5d1bc5c85c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:18.137370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f5e7f613-c298-4bc1-8f70-5d1bc5c85c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:18.138524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f5e7f613-c298-4bc1-8f70-5d1bc5c85c02 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085926 Sep 14 20:00:18.139068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1184/2399] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:18 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:19.155844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-93465128-5985-40dc-ba33-00832c3d1963 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:19.156474 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-93465128-5985-40dc-ba33-00832c3d1963 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:19.163665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93465128-5985-40dc-ba33-00832c3d1963 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:19.164094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93465128-5985-40dc-ba33-00832c3d1963 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:19.164995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93465128-5985-40dc-ba33-00832c3d1963 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:19.165429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-93465128-5985-40dc-ba33-00832c3d1963 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:19.229541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-93465128-5985-40dc-ba33-00832c3d1963 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:19.238383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-93465128-5985-40dc-ba33-00832c3d1963 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:19.239861 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-93465128-5985-40dc-ba33-00832c3d1963 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:19.240981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-93465128-5985-40dc-ba33-00832c3d1963 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.088878 Sep 14 20:00:19.241541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1216/2400] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:19 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:20.261950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9331f51a-da1c-4b6f-8243-9ff48301c763 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:20.262660 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9331f51a-da1c-4b6f-8243-9ff48301c763 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:20.269228 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9331f51a-da1c-4b6f-8243-9ff48301c763 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:20.269714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9331f51a-da1c-4b6f-8243-9ff48301c763 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:20.270490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9331f51a-da1c-4b6f-8243-9ff48301c763 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:20.270923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9331f51a-da1c-4b6f-8243-9ff48301c763 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:20.334424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9331f51a-da1c-4b6f-8243-9ff48301c763 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:20.342654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9331f51a-da1c-4b6f-8243-9ff48301c763 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:20.344157 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9331f51a-da1c-4b6f-8243-9ff48301c763 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:20.345313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9331f51a-da1c-4b6f-8243-9ff48301c763 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.087107 Sep 14 20:00:20.345924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1185/2401] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:20 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:21.363047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-64cf8b72-bff9-435f-8e03-f59cca0fe079 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:21.363662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-64cf8b72-bff9-435f-8e03-f59cca0fe079 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:21.369856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64cf8b72-bff9-435f-8e03-f59cca0fe079 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:21.370312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64cf8b72-bff9-435f-8e03-f59cca0fe079 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:21.371080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64cf8b72-bff9-435f-8e03-f59cca0fe079 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:21.371515 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-64cf8b72-bff9-435f-8e03-f59cca0fe079 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:21.431142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-64cf8b72-bff9-435f-8e03-f59cca0fe079 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:21.439366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-64cf8b72-bff9-435f-8e03-f59cca0fe079 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:21.440881 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-64cf8b72-bff9-435f-8e03-f59cca0fe079 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:21.442117 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-64cf8b72-bff9-435f-8e03-f59cca0fe079 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082791 Sep 14 20:00:21.442660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1217/2402] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:21 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:22.458982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-19e5287c-3384-45d0-8ba3-6d5311e3cf43 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:22.459577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-19e5287c-3384-45d0-8ba3-6d5311e3cf43 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:22.465441 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19e5287c-3384-45d0-8ba3-6d5311e3cf43 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:22.466044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19e5287c-3384-45d0-8ba3-6d5311e3cf43 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:22.466806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19e5287c-3384-45d0-8ba3-6d5311e3cf43 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:22.467245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-19e5287c-3384-45d0-8ba3-6d5311e3cf43 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:22.526751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-19e5287c-3384-45d0-8ba3-6d5311e3cf43 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:22.535681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-19e5287c-3384-45d0-8ba3-6d5311e3cf43 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:22.537174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-19e5287c-3384-45d0-8ba3-6d5311e3cf43 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:22.538349 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-19e5287c-3384-45d0-8ba3-6d5311e3cf43 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083264 Sep 14 20:00:22.538908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1186/2403] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:22 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:23.556273 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a5ae333f-eecb-48f9-875d-27304a8f4d31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:23.556902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a5ae333f-eecb-48f9-875d-27304a8f4d31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:23.562791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5ae333f-eecb-48f9-875d-27304a8f4d31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:23.563243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5ae333f-eecb-48f9-875d-27304a8f4d31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:23.564014 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5ae333f-eecb-48f9-875d-27304a8f4d31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:23.564461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a5ae333f-eecb-48f9-875d-27304a8f4d31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:23.624443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a5ae333f-eecb-48f9-875d-27304a8f4d31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:23.632775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a5ae333f-eecb-48f9-875d-27304a8f4d31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:23.634287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a5ae333f-eecb-48f9-875d-27304a8f4d31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:23.635416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a5ae333f-eecb-48f9-875d-27304a8f4d31 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083025 Sep 14 20:00:23.635961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1218/2404] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:23 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:24.652668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-76b57abb-5b97-45ed-85ee-e3c348457d54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:24.653584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-76b57abb-5b97-45ed-85ee-e3c348457d54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:24.660839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-76b57abb-5b97-45ed-85ee-e3c348457d54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:24.666488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-76b57abb-5b97-45ed-85ee-e3c348457d54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:24.666488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-76b57abb-5b97-45ed-85ee-e3c348457d54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:24.666488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-76b57abb-5b97-45ed-85ee-e3c348457d54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:24.725683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-76b57abb-5b97-45ed-85ee-e3c348457d54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:24.736072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-76b57abb-5b97-45ed-85ee-e3c348457d54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:24.738425 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-76b57abb-5b97-45ed-85ee-e3c348457d54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:24.740078 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-76b57abb-5b97-45ed-85ee-e3c348457d54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.090930 Sep 14 20:00:24.740883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1187/2405] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:24 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:25.760164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b6c51281-b24a-468c-8efe-c0795585bd54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:25.760777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b6c51281-b24a-468c-8efe-c0795585bd54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:25.766873 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6c51281-b24a-468c-8efe-c0795585bd54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:25.767328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6c51281-b24a-468c-8efe-c0795585bd54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:25.768109 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6c51281-b24a-468c-8efe-c0795585bd54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:25.768545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b6c51281-b24a-468c-8efe-c0795585bd54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:25.831619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b6c51281-b24a-468c-8efe-c0795585bd54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:25.840134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b6c51281-b24a-468c-8efe-c0795585bd54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:25.841678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b6c51281-b24a-468c-8efe-c0795585bd54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:25.842844 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b6c51281-b24a-468c-8efe-c0795585bd54 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.086416 Sep 14 20:00:25.843396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1219/2406] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:25 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:26.859949 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-75b9aa50-12ce-469f-a530-d82316db08e5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:26.860544 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-75b9aa50-12ce-469f-a530-d82316db08e5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:26.866389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75b9aa50-12ce-469f-a530-d82316db08e5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:26.866828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75b9aa50-12ce-469f-a530-d82316db08e5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:26.867576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75b9aa50-12ce-469f-a530-d82316db08e5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:26.868004 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75b9aa50-12ce-469f-a530-d82316db08e5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:26.927568 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-75b9aa50-12ce-469f-a530-d82316db08e5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:26.936078 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-75b9aa50-12ce-469f-a530-d82316db08e5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:26.938132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-75b9aa50-12ce-469f-a530-d82316db08e5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:26.939325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-75b9aa50-12ce-469f-a530-d82316db08e5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083051 Sep 14 20:00:26.940308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1188/2407] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:26 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:27.957438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ee2e0a01-f295-4b76-8067-5cc5874997fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:27.958075 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ee2e0a01-f295-4b76-8067-5cc5874997fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:27.963959 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee2e0a01-f295-4b76-8067-5cc5874997fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:27.964407 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee2e0a01-f295-4b76-8067-5cc5874997fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:27.965182 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee2e0a01-f295-4b76-8067-5cc5874997fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:27.965647 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ee2e0a01-f295-4b76-8067-5cc5874997fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:28.025785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ee2e0a01-f295-4b76-8067-5cc5874997fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:28.034119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ee2e0a01-f295-4b76-8067-5cc5874997fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:28.035805 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ee2e0a01-f295-4b76-8067-5cc5874997fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:28.036752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ee2e0a01-f295-4b76-8067-5cc5874997fb tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083366 Sep 14 20:00:28.037316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1220/2408] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:27 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:29.055395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ff5ab443-034c-42f4-8b2b-9cbc5510156d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:29.056003 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ff5ab443-034c-42f4-8b2b-9cbc5510156d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:29.061968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff5ab443-034c-42f4-8b2b-9cbc5510156d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:29.062944 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff5ab443-034c-42f4-8b2b-9cbc5510156d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:29.063698 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff5ab443-034c-42f4-8b2b-9cbc5510156d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:29.064130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ff5ab443-034c-42f4-8b2b-9cbc5510156d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:29.130190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ff5ab443-034c-42f4-8b2b-9cbc5510156d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:29.144337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ff5ab443-034c-42f4-8b2b-9cbc5510156d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:29.146941 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ff5ab443-034c-42f4-8b2b-9cbc5510156d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:29.151644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ff5ab443-034c-42f4-8b2b-9cbc5510156d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.097281 Sep 14 20:00:29.151644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1189/2409] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:29 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:30.175911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-358b447f-b575-4c0f-b8b5-ed31eee1b07e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:30.176561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-358b447f-b575-4c0f-b8b5-ed31eee1b07e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:30.182516 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-358b447f-b575-4c0f-b8b5-ed31eee1b07e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:30.182953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-358b447f-b575-4c0f-b8b5-ed31eee1b07e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:30.183703 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-358b447f-b575-4c0f-b8b5-ed31eee1b07e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:30.184135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-358b447f-b575-4c0f-b8b5-ed31eee1b07e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:30.244925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-358b447f-b575-4c0f-b8b5-ed31eee1b07e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:30.253426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-358b447f-b575-4c0f-b8b5-ed31eee1b07e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:30.254950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-358b447f-b575-4c0f-b8b5-ed31eee1b07e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:30.256145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-358b447f-b575-4c0f-b8b5-ed31eee1b07e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084188 Sep 14 20:00:30.256882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1221/2410] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:30 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:31.278805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fd1484a5-3371-4262-9e33-77e78352d3e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:31.279948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fd1484a5-3371-4262-9e33-77e78352d3e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:31.290064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd1484a5-3371-4262-9e33-77e78352d3e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:31.290712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd1484a5-3371-4262-9e33-77e78352d3e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:31.291658 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd1484a5-3371-4262-9e33-77e78352d3e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:31.292248 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd1484a5-3371-4262-9e33-77e78352d3e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:31.358345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fd1484a5-3371-4262-9e33-77e78352d3e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:31.369045 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fd1484a5-3371-4262-9e33-77e78352d3e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:31.370564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fd1484a5-3371-4262-9e33-77e78352d3e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:31.371731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fd1484a5-3371-4262-9e33-77e78352d3e1 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.100083 Sep 14 20:00:31.372289 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1190/2411] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:31 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:32.388432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7b3cec56-558a-49c9-98bc-191a2f839db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:32.389037 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7b3cec56-558a-49c9-98bc-191a2f839db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:32.395510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b3cec56-558a-49c9-98bc-191a2f839db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:32.395951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b3cec56-558a-49c9-98bc-191a2f839db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:32.396721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b3cec56-558a-49c9-98bc-191a2f839db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:32.397135 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b3cec56-558a-49c9-98bc-191a2f839db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:32.455973 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7b3cec56-558a-49c9-98bc-191a2f839db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:32.466548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7b3cec56-558a-49c9-98bc-191a2f839db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:32.468032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7b3cec56-558a-49c9-98bc-191a2f839db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:32.469167 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7b3cec56-558a-49c9-98bc-191a2f839db7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.084362 Sep 14 20:00:32.469756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1222/2412] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:32 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:33.486738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d54f841f-ce43-4843-814b-27236d4faa3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:33.487352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d54f841f-ce43-4843-814b-27236d4faa3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:33.493230 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d54f841f-ce43-4843-814b-27236d4faa3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:33.493641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d54f841f-ce43-4843-814b-27236d4faa3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:33.494391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d54f841f-ce43-4843-814b-27236d4faa3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:33.494818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d54f841f-ce43-4843-814b-27236d4faa3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:33.554107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d54f841f-ce43-4843-814b-27236d4faa3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:33.563211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d54f841f-ce43-4843-814b-27236d4faa3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:33.564716 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d54f841f-ce43-4843-814b-27236d4faa3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:33.565883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d54f841f-ce43-4843-814b-27236d4faa3f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082845 Sep 14 20:00:33.566443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1191/2413] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:33 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:34.583682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-edfd8ff8-d104-4619-bb56-ea65dca658d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:34.584199 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-edfd8ff8-d104-4619-bb56-ea65dca658d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:34.590107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-edfd8ff8-d104-4619-bb56-ea65dca658d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:34.590562 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-edfd8ff8-d104-4619-bb56-ea65dca658d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:34.591330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-edfd8ff8-d104-4619-bb56-ea65dca658d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:34.591768 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-edfd8ff8-d104-4619-bb56-ea65dca658d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:34.650948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-edfd8ff8-d104-4619-bb56-ea65dca658d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:34.659930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-edfd8ff8-d104-4619-bb56-ea65dca658d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:34.661427 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-edfd8ff8-d104-4619-bb56-ea65dca658d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:34.662597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-edfd8ff8-d104-4619-bb56-ea65dca658d4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.082754 Sep 14 20:00:34.663155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1223/2414] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:34 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:35.680986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-28b2b3ce-a581-4a69-adea-b504799fb4f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:35.681625 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-28b2b3ce-a581-4a69-adea-b504799fb4f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:35.687433 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28b2b3ce-a581-4a69-adea-b504799fb4f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:35.687866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28b2b3ce-a581-4a69-adea-b504799fb4f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:35.688712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28b2b3ce-a581-4a69-adea-b504799fb4f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:35.689045 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28b2b3ce-a581-4a69-adea-b504799fb4f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:35.747183 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-28b2b3ce-a581-4a69-adea-b504799fb4f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:35.755273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-28b2b3ce-a581-4a69-adea-b504799fb4f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:35.756748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-28b2b3ce-a581-4a69-adea-b504799fb4f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:35.757906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-28b2b3ce-a581-4a69-adea-b504799fb4f5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.080642 Sep 14 20:00:35.758454 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1192/2415] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:35 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:36.776279 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3f65bc90-2905-45ff-b901-16584319dcf4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:36.776925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3f65bc90-2905-45ff-b901-16584319dcf4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:36.783770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f65bc90-2905-45ff-b901-16584319dcf4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:36.784225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f65bc90-2905-45ff-b901-16584319dcf4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:36.784995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f65bc90-2905-45ff-b901-16584319dcf4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:36.785434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3f65bc90-2905-45ff-b901-16584319dcf4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:36.847172 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3f65bc90-2905-45ff-b901-16584319dcf4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:36.855453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3f65bc90-2905-45ff-b901-16584319dcf4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:36.856989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3f65bc90-2905-45ff-b901-16584319dcf4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:36.858162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3f65bc90-2905-45ff-b901-16584319dcf4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085696 Sep 14 20:00:36.858705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1224/2416] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:36 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:37.877354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d8d60927-d2e9-4aed-aa41-ecfa3450a531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:37.878100 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d8d60927-d2e9-4aed-aa41-ecfa3450a531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:37.880343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 20:00:37.884894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d8d60927-d2e9-4aed-aa41-ecfa3450a531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:37.885345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d8d60927-d2e9-4aed-aa41-ecfa3450a531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:37.886153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d8d60927-d2e9-4aed-aa41-ecfa3450a531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:37.886601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d8d60927-d2e9-4aed-aa41-ecfa3450a531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:37.955085 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d8d60927-d2e9-4aed-aa41-ecfa3450a531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:37.963693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d8d60927-d2e9-4aed-aa41-ecfa3450a531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:37.965190 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d8d60927-d2e9-4aed-aa41-ecfa3450a531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:37.966368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d8d60927-d2e9-4aed-aa41-ecfa3450a531 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.093483 Sep 14 20:00:37.966928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1193/2417] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:37 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:38.983832 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-89060a20-3a7c-4b93-9fed-b3a6177dbfdf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:38.984444 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-89060a20-3a7c-4b93-9fed-b3a6177dbfdf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:38.990355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89060a20-3a7c-4b93-9fed-b3a6177dbfdf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:38.990806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89060a20-3a7c-4b93-9fed-b3a6177dbfdf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:38.991572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89060a20-3a7c-4b93-9fed-b3a6177dbfdf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:38.992013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89060a20-3a7c-4b93-9fed-b3a6177dbfdf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:39.053710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-89060a20-3a7c-4b93-9fed-b3a6177dbfdf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:39.062969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-89060a20-3a7c-4b93-9fed-b3a6177dbfdf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:39.070301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-89060a20-3a7c-4b93-9fed-b3a6177dbfdf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:39.070301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-89060a20-3a7c-4b93-9fed-b3a6177dbfdf tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085511 Sep 14 20:00:39.070301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1225/2418] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:38 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:40.086598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-00b76d0a-2de3-473a-b073-b36f3b870cf9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:40.087258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-00b76d0a-2de3-473a-b073-b36f3b870cf9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:40.105836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00b76d0a-2de3-473a-b073-b36f3b870cf9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:40.106249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00b76d0a-2de3-473a-b073-b36f3b870cf9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:40.107099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00b76d0a-2de3-473a-b073-b36f3b870cf9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:40.107574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-00b76d0a-2de3-473a-b073-b36f3b870cf9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:40.113266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 34040. Sep 14 20:00:40.170022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-00b76d0a-2de3-473a-b073-b36f3b870cf9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:40.178401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-00b76d0a-2de3-473a-b073-b36f3b870cf9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:40.179876 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-00b76d0a-2de3-473a-b073-b36f3b870cf9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:40.180999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-00b76d0a-2de3-473a-b073-b36f3b870cf9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.098075 Sep 14 20:00:40.181567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1194/2419] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:40 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:41.198762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-16ed3e37-ef1f-45c9-b1fe-6cb61c78dc5b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:41.199375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-16ed3e37-ef1f-45c9-b1fe-6cb61c78dc5b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:41.205268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16ed3e37-ef1f-45c9-b1fe-6cb61c78dc5b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:41.205750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16ed3e37-ef1f-45c9-b1fe-6cb61c78dc5b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:41.206520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16ed3e37-ef1f-45c9-b1fe-6cb61c78dc5b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:41.206960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-16ed3e37-ef1f-45c9-b1fe-6cb61c78dc5b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:41.265457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-16ed3e37-ef1f-45c9-b1fe-6cb61c78dc5b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:41.273909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-16ed3e37-ef1f-45c9-b1fe-6cb61c78dc5b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:41.275416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-16ed3e37-ef1f-45c9-b1fe-6cb61c78dc5b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:41.276573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-16ed3e37-ef1f-45c9-b1fe-6cb61c78dc5b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.081496 Sep 14 20:00:41.277202 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1226/2420] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:41 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:42.294909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8185443b-41ab-460d-b710-3d004990eebd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:42.295521 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8185443b-41ab-460d-b710-3d004990eebd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:42.302612 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8185443b-41ab-460d-b710-3d004990eebd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:42.303054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8185443b-41ab-460d-b710-3d004990eebd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:42.303816 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8185443b-41ab-460d-b710-3d004990eebd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:42.304243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8185443b-41ab-460d-b710-3d004990eebd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:42.365045 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8185443b-41ab-460d-b710-3d004990eebd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:42.373167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8185443b-41ab-460d-b710-3d004990eebd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:42.375388 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8185443b-41ab-460d-b710-3d004990eebd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:42.376508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8185443b-41ab-460d-b710-3d004990eebd tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085343 Sep 14 20:00:42.377050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1195/2421] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:42 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:43.394088 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0150fb3c-05c4-45e1-8412-001eb1da6a6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:43.394678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0150fb3c-05c4-45e1-8412-001eb1da6a6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:43.400766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0150fb3c-05c4-45e1-8412-001eb1da6a6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:43.401221 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0150fb3c-05c4-45e1-8412-001eb1da6a6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:43.402029 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0150fb3c-05c4-45e1-8412-001eb1da6a6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:43.402469 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0150fb3c-05c4-45e1-8412-001eb1da6a6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:43.462196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0150fb3c-05c4-45e1-8412-001eb1da6a6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:43.470332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0150fb3c-05c4-45e1-8412-001eb1da6a6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:43.471817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0150fb3c-05c4-45e1-8412-001eb1da6a6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:43.472946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0150fb3c-05c4-45e1-8412-001eb1da6a6d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083196 Sep 14 20:00:43.473520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1227/2422] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:43 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:44.490603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3e822827-b894-4a3d-977c-ed3bea82f7dc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:44.491206 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3e822827-b894-4a3d-977c-ed3bea82f7dc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:44.497083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e822827-b894-4a3d-977c-ed3bea82f7dc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:44.497555 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e822827-b894-4a3d-977c-ed3bea82f7dc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:44.498340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e822827-b894-4a3d-977c-ed3bea82f7dc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:44.498769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e822827-b894-4a3d-977c-ed3bea82f7dc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:44.560792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3e822827-b894-4a3d-977c-ed3bea82f7dc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:44.569781 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3e822827-b894-4a3d-977c-ed3bea82f7dc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:44.571261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3e822827-b894-4a3d-977c-ed3bea82f7dc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:44.572394 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3e822827-b894-4a3d-977c-ed3bea82f7dc tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.085517 Sep 14 20:00:44.573182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1196/2423] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:44 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:45.590635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0b9528dd-8fbb-4df9-a8f9-66a0c79b0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:45.591266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0b9528dd-8fbb-4df9-a8f9-66a0c79b0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:45.597558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b9528dd-8fbb-4df9-a8f9-66a0c79b0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:45.598004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b9528dd-8fbb-4df9-a8f9-66a0c79b0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:45.598765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b9528dd-8fbb-4df9-a8f9-66a0c79b0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:45.599197 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b9528dd-8fbb-4df9-a8f9-66a0c79b0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:45.659395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0b9528dd-8fbb-4df9-a8f9-66a0c79b0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:45.667718 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0b9528dd-8fbb-4df9-a8f9-66a0c79b0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:45.669204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0b9528dd-8fbb-4df9-a8f9-66a0c79b0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:45.670373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0b9528dd-8fbb-4df9-a8f9-66a0c79b0a45 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1443 microversion: 2.20 time: 0.083435 Sep 14 20:00:45.670995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1228/2424] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:45 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:46.689594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:46.690209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:46.696266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:46.696718 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:46.697614 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:46.698038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:46.728046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:46.728494 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:46.728944 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lazy-loading 'fault' on Instance uuid 72a26129-f7fb-4755-979a-968cdf0c7d34 {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 20:00:46.769011 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:46.777437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:46.778974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:46.780146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bfe1cc83-6a3f-4606-8fc6-e1dff360dcd0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 200 len: 1537 microversion: 2.20 time: 0.095060 Sep 14 20:00:46.780742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1197/2425] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:46 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 1537 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:47.801882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f206b4d9-6263-4419-abce-9c9bdab5b48a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:47.802901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f206b4d9-6263-4419-abce-9c9bdab5b48a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:47.808960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f206b4d9-6263-4419-abce-9c9bdab5b48a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:47.809407 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f206b4d9-6263-4419-abce-9c9bdab5b48a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:47.811265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f206b4d9-6263-4419-abce-9c9bdab5b48a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:47.812188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f206b4d9-6263-4419-abce-9c9bdab5b48a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:47.826147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-f206b4d9-6263-4419-abce-9c9bdab5b48a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] HTTP exception thrown: Instance 72a26129-f7fb-4755-979a-968cdf0c7d34 could not be found. Sep 14 20:00:47.826759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f206b4d9-6263-4419-abce-9c9bdab5b48a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Returning 404 to user: Instance 72a26129-f7fb-4755-979a-968cdf0c7d34 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:00:47.828168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f206b4d9-6263-4419-abce-9c9bdab5b48a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 404 len: 111 microversion: 2.20 time: 0.033005 Sep 14 20:00:47.828725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1229/2426] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:47 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 20:00:47.837093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bd7dc6e3-c4cc-4b01-ac93-2ca787d3ca59 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '.version_select at 0x7fd0c85b2b80>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:47.923662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bd7dc6e3-c4cc-4b01-ac93-2ca787d3ca59 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-316047328" status: 204 len: 0 microversion: 2.20 time: 0.090170 Sep 14 20:00:47.924267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1198/2427] 10.222.0.58 () {60 vars in 1259 bytes} [Tue Sep 14 20:00:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-316047328 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 20:00:48.882859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-88ba3ef8-c21c-406b-a86f-a81235df04ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'create', calling method: .version_select at 0x7fd0bbeb33a0>, body: {"keypair": {"name": "tempest-keypair-1929869716"}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:48.901319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-88ba3ef8-c21c-406b-a86f-a81235df04ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for project bbba3e0792bf41beb30a9f910ff28269. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 20:00:48.906177 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-88ba3ef8-c21c-406b-a86f-a81235df04ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for user 732d822c6c8141c8a51dd509cf560da0 and project bbba3e0792bf41beb30a9f910ff28269. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 20:00:49.284244 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-88ba3ef8-c21c-406b-a86f-a81235df04ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for project bbba3e0792bf41beb30a9f910ff28269. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 20:00:49.288203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-88ba3ef8-c21c-406b-a86f-a81235df04ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for user 732d822c6c8141c8a51dd509cf560da0 and project bbba3e0792bf41beb30a9f910ff28269. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 20:00:49.301628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-88ba3ef8-c21c-406b-a86f-a81235df04ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.422458 Sep 14 20:00:49.302396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1230/2428] 10.222.0.58 () {62 vars in 1199 bytes} [Tue Sep 14 20:00:48 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 424 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 14 20:00:51.626810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-699554126", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6be650c3-02d9-4d68-9d35-6f57841ba148"}], "security_groups": [{"name": "tempest-securitygroup--1660952089"}], "key_name": "tempest-keypair-1929869716", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:51.727803 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] validate_networks() for [('6be650c3-02d9-4d68-9d35-6f57841ba148', None, None, None, None, None)] {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 20:00:52.182615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:00:52.183175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:00:52.183653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:00:52.184057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:00:52.184516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:00:52.194691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:52.195137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:52.195937 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:52.196370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:52.214776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for project bbba3e0792bf41beb30a9f910ff28269. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 20:00:52.219779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Getting quotas for user 732d822c6c8141c8a51dd509cf560da0 and project bbba3e0792bf41beb30a9f910ff28269. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 20:00:52.231412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 20:00:52.233900 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 20:00:52.350614 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8cc9be36-2c1b-46ef-ab91-82feff17a398 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.725234 Sep 14 20:00:52.350614 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1199/2429] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Sep 14 20:00:51 2021] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 20:00:52.362130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-118d253a-49c2-49cd-a6e6-fc6fddda762e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:52.362777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-118d253a-49c2-49cd-a6e6-fc6fddda762e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:52.428034 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-118d253a-49c2-49cd-a6e6-fc6fddda762e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:52.435826 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-118d253a-49c2-49cd-a6e6-fc6fddda762e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:52.438476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-118d253a-49c2-49cd-a6e6-fc6fddda762e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:52.439605 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-118d253a-49c2-49cd-a6e6-fc6fddda762e tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1281 microversion: 2.20 time: 0.083347 Sep 14 20:00:52.440393 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1231/2430] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:52 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:53.459417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8a87cf7a-6d8b-4c18-ad51-d0c10f515aab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:53.460160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8a87cf7a-6d8b-4c18-ad51-d0c10f515aab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:53.468994 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a87cf7a-6d8b-4c18-ad51-d0c10f515aab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:53.469614 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a87cf7a-6d8b-4c18-ad51-d0c10f515aab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:53.470598 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a87cf7a-6d8b-4c18-ad51-d0c10f515aab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:53.470971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a87cf7a-6d8b-4c18-ad51-d0c10f515aab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:53.535604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8a87cf7a-6d8b-4c18-ad51-d0c10f515aab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:53.544198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8a87cf7a-6d8b-4c18-ad51-d0c10f515aab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:53.545811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8a87cf7a-6d8b-4c18-ad51-d0c10f515aab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:53.546971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8a87cf7a-6d8b-4c18-ad51-d0c10f515aab tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1285 microversion: 2.20 time: 0.091770 Sep 14 20:00:53.547533 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1200/2431] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:53 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:54.567485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2d632b86-02c3-4544-93ff-5d37516eb6f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:54.574498 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2d632b86-02c3-4544-93ff-5d37516eb6f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:54.580049 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d632b86-02c3-4544-93ff-5d37516eb6f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:54.580772 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d632b86-02c3-4544-93ff-5d37516eb6f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:54.581989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d632b86-02c3-4544-93ff-5d37516eb6f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:54.582818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d632b86-02c3-4544-93ff-5d37516eb6f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:54.667054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2d632b86-02c3-4544-93ff-5d37516eb6f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:54.676822 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2d632b86-02c3-4544-93ff-5d37516eb6f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:54.678404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2d632b86-02c3-4544-93ff-5d37516eb6f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:54.683202 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2d632b86-02c3-4544-93ff-5d37516eb6f0 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1339 microversion: 2.20 time: 0.117699 Sep 14 20:00:54.683202 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1232/2432] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:54 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1339 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:55.696607 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d9ca4905-f522-4b8c-acf5-b5a7411b5aca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:55.701667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d9ca4905-f522-4b8c-acf5-b5a7411b5aca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:55.703377 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9ca4905-f522-4b8c-acf5-b5a7411b5aca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:55.703828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9ca4905-f522-4b8c-acf5-b5a7411b5aca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:55.704603 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9ca4905-f522-4b8c-acf5-b5a7411b5aca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:55.705038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d9ca4905-f522-4b8c-acf5-b5a7411b5aca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:55.846894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d9ca4905-f522-4b8c-acf5-b5a7411b5aca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:55.855601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d9ca4905-f522-4b8c-acf5-b5a7411b5aca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:55.857641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d9ca4905-f522-4b8c-acf5-b5a7411b5aca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:55.859299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d9ca4905-f522-4b8c-acf5-b5a7411b5aca tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1407 microversion: 2.20 time: 0.166433 Sep 14 20:00:55.860959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1201/2433] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:55 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:56.095740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-a35fbc2e-dfad-4f3e-80d1-6bc34e9e3630 req-04a1f819-e3ed-494e-bf01-96d0d6a148f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad1f171-af6a-4426-911c-022a3216f1f6", "tag": "077796d9-a0ee-4177-8845-768d6c05b2b6"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:56.102917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:00:56.102917 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 20:00:56.111638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-a35fbc2e-dfad-4f3e-80d1-6bc34e9e3630 req-04a1f819-e3ed-494e-bf01-96d0d6a148f5 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:56.112381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-a35fbc2e-dfad-4f3e-80d1-6bc34e9e3630 req-04a1f819-e3ed-494e-bf01-96d0d6a148f5 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:56.123720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-a35fbc2e-dfad-4f3e-80d1-6bc34e9e3630 req-04a1f819-e3ed-494e-bf01-96d0d6a148f5 service nova] Creating event network-changed:077796d9-a0ee-4177-8845-768d6c05b2b6 for instance dad1f171-af6a-4426-911c-022a3216f1f6 on hv-cinder-80588 Sep 14 20:00:56.129207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-a35fbc2e-dfad-4f3e-80d1-6bc34e9e3630 req-04a1f819-e3ed-494e-bf01-96d0d6a148f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037323 Sep 14 20:00:56.129937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1233/2434] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:00:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:56.878126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-bd96f0bb-6ea4-43f8-ac68-1dbc97d10f6a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:56.878728 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-bd96f0bb-6ea4-43f8-ac68-1dbc97d10f6a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:56.884558 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd96f0bb-6ea4-43f8-ac68-1dbc97d10f6a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:56.884999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd96f0bb-6ea4-43f8-ac68-1dbc97d10f6a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:56.885793 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd96f0bb-6ea4-43f8-ac68-1dbc97d10f6a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:56.886220 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-bd96f0bb-6ea4-43f8-ac68-1dbc97d10f6a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:57.018936 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bd96f0bb-6ea4-43f8-ac68-1dbc97d10f6a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:57.031079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bd96f0bb-6ea4-43f8-ac68-1dbc97d10f6a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:57.032585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-bd96f0bb-6ea4-43f8-ac68-1dbc97d10f6a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:57.033744 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-bd96f0bb-6ea4-43f8-ac68-1dbc97d10f6a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1407 microversion: 2.20 time: 0.159896 Sep 14 20:00:57.034305 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1202/2435] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:56 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:58.052641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ca0bef14-cd2a-4451-a96b-928fecc12a2a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:58.053252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ca0bef14-cd2a-4451-a96b-928fecc12a2a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:58.059523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca0bef14-cd2a-4451-a96b-928fecc12a2a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:58.059980 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca0bef14-cd2a-4451-a96b-928fecc12a2a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:58.060760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca0bef14-cd2a-4451-a96b-928fecc12a2a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:58.061212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ca0bef14-cd2a-4451-a96b-928fecc12a2a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:58.189633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ca0bef14-cd2a-4451-a96b-928fecc12a2a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:58.197956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ca0bef14-cd2a-4451-a96b-928fecc12a2a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:58.199443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ca0bef14-cd2a-4451-a96b-928fecc12a2a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:58.200584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ca0bef14-cd2a-4451-a96b-928fecc12a2a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1407 microversion: 2.20 time: 0.152488 Sep 14 20:00:58.201149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1234/2436] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:58 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:59.219057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d3818999-1af6-4bb1-bbe5-583f23b6390f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:59.219659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d3818999-1af6-4bb1-bbe5-583f23b6390f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:00:59.225771 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3818999-1af6-4bb1-bbe5-583f23b6390f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:59.226217 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3818999-1af6-4bb1-bbe5-583f23b6390f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:59.226960 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3818999-1af6-4bb1-bbe5-583f23b6390f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:00:59.227386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d3818999-1af6-4bb1-bbe5-583f23b6390f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:00:59.352975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d3818999-1af6-4bb1-bbe5-583f23b6390f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:59.361984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d3818999-1af6-4bb1-bbe5-583f23b6390f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:59.366347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d3818999-1af6-4bb1-bbe5-583f23b6390f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:59.366347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d3818999-1af6-4bb1-bbe5-583f23b6390f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1407 microversion: 2.20 time: 0.149927 Sep 14 20:00:59.366347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1203/2437] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:00:59 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:00.382300 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c6bc2e5f-c445-41f8-b9be-b712c3ce1818 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:00.382911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c6bc2e5f-c445-41f8-b9be-b712c3ce1818 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:00.388946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6bc2e5f-c445-41f8-b9be-b712c3ce1818 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:00.389391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6bc2e5f-c445-41f8-b9be-b712c3ce1818 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:00.390203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6bc2e5f-c445-41f8-b9be-b712c3ce1818 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:00.390643 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6bc2e5f-c445-41f8-b9be-b712c3ce1818 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:00.516436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c6bc2e5f-c445-41f8-b9be-b712c3ce1818 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:00.524415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c6bc2e5f-c445-41f8-b9be-b712c3ce1818 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:00.525892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c6bc2e5f-c445-41f8-b9be-b712c3ce1818 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:00.527002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c6bc2e5f-c445-41f8-b9be-b712c3ce1818 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1407 microversion: 2.20 time: 0.148445 Sep 14 20:01:00.527557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1235/2438] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:01:00 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:01.422000 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-a83cc58d-d4b7-4553-8188-75cc14894318 req-4375bc5a-6f5c-4bfc-9b60-308cb7cd6182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad1f171-af6a-4426-911c-022a3216f1f6", "name": "network-vif-plugged", "status": "completed", "tag": "077796d9-a0ee-4177-8845-768d6c05b2b6"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:01.424607 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:01:01.424607 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:01:01.430764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-a83cc58d-d4b7-4553-8188-75cc14894318 req-4375bc5a-6f5c-4bfc-9b60-308cb7cd6182 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:01.431200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-a83cc58d-d4b7-4553-8188-75cc14894318 req-4375bc5a-6f5c-4bfc-9b60-308cb7cd6182 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:01.442577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-a83cc58d-d4b7-4553-8188-75cc14894318 req-4375bc5a-6f5c-4bfc-9b60-308cb7cd6182 service nova] Creating event network-vif-plugged:077796d9-a0ee-4177-8845-768d6c05b2b6 for instance dad1f171-af6a-4426-911c-022a3216f1f6 on hv-cinder-80588 Sep 14 20:01:01.447951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-a83cc58d-d4b7-4553-8188-75cc14894318 req-4375bc5a-6f5c-4bfc-9b60-308cb7cd6182 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089406 Sep 14 20:01:01.448725 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1204/2439] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:01:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:01.545807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a55612b3-129e-4348-924f-c59aa2e8a5b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:01.546833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a55612b3-129e-4348-924f-c59aa2e8a5b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:01.553320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a55612b3-129e-4348-924f-c59aa2e8a5b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:01.553797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a55612b3-129e-4348-924f-c59aa2e8a5b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:01.554578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a55612b3-129e-4348-924f-c59aa2e8a5b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:01.555018 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a55612b3-129e-4348-924f-c59aa2e8a5b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:01.677333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a55612b3-129e-4348-924f-c59aa2e8a5b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:01.685152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a55612b3-129e-4348-924f-c59aa2e8a5b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:01.687275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a55612b3-129e-4348-924f-c59aa2e8a5b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:01.688382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a55612b3-129e-4348-924f-c59aa2e8a5b9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1407 microversion: 2.20 time: 0.146517 Sep 14 20:01:01.689000 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1236/2440] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:01:01 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:02.707393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-48b61ea5-e798-4a18-b1f3-e57be7366d79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:02.708086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-48b61ea5-e798-4a18-b1f3-e57be7366d79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:02.714171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b61ea5-e798-4a18-b1f3-e57be7366d79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:02.714618 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b61ea5-e798-4a18-b1f3-e57be7366d79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:02.715377 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b61ea5-e798-4a18-b1f3-e57be7366d79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:02.715811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-48b61ea5-e798-4a18-b1f3-e57be7366d79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:02.836789 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-48b61ea5-e798-4a18-b1f3-e57be7366d79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:02.845168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-48b61ea5-e798-4a18-b1f3-e57be7366d79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:02.846883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-48b61ea5-e798-4a18-b1f3-e57be7366d79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:02.848092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-48b61ea5-e798-4a18-b1f3-e57be7366d79 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1407 microversion: 2.20 time: 0.144773 Sep 14 20:01:02.848724 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1205/2441] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:01:02 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1407 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:01:03.865765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bb22c1b3-4c84-4353-969f-36bd376aa4e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:03.866366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bb22c1b3-4c84-4353-969f-36bd376aa4e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:03.872265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bb22c1b3-4c84-4353-969f-36bd376aa4e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:03.872704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bb22c1b3-4c84-4353-969f-36bd376aa4e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:03.873569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bb22c1b3-4c84-4353-969f-36bd376aa4e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:03.874129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bb22c1b3-4c84-4353-969f-36bd376aa4e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:04.007409 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bb22c1b3-4c84-4353-969f-36bd376aa4e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:04.016215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bb22c1b3-4c84-4353-969f-36bd376aa4e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:04.017762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bb22c1b3-4c84-4353-969f-36bd376aa4e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:04.018930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bb22c1b3-4c84-4353-969f-36bd376aa4e7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1598 microversion: 2.20 time: 0.156850 Sep 14 20:01:04.019762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1237/2442] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:01:03 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:04.036228 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c40977f7-9856-4345-a23c-513a5e1e1304 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:04.036726 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c40977f7-9856-4345-a23c-513a5e1e1304 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:04.042743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c40977f7-9856-4345-a23c-513a5e1e1304 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:04.043474 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c40977f7-9856-4345-a23c-513a5e1e1304 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:04.044252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c40977f7-9856-4345-a23c-513a5e1e1304 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:04.044832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c40977f7-9856-4345-a23c-513a5e1e1304 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:04.128859 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c40977f7-9856-4345-a23c-513a5e1e1304 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096156 Sep 14 20:01:04.129459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1206/2443] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Sep 14 20:01:04 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 20:01:05.361970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c940d811-7652-40f7-9a18-7d5f59ed5a50 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:05.363097 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c940d811-7652-40f7-9a18-7d5f59ed5a50 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:05.383388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c940d811-7652-40f7-9a18-7d5f59ed5a50 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:05.383843 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c940d811-7652-40f7-9a18-7d5f59ed5a50 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:05.384633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c940d811-7652-40f7-9a18-7d5f59ed5a50 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:05.385070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c940d811-7652-40f7-9a18-7d5f59ed5a50 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:05.422405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-9505198b-e93c-4a32-aac6-211a1069f166 req-ecc15a2a-9060-4e64-94a1-3db2a1235e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad1f171-af6a-4426-911c-022a3216f1f6", "tag": "077796d9-a0ee-4177-8845-768d6c05b2b6"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:05.423973 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:01:05.423973 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:01:05.431217 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-9505198b-e93c-4a32-aac6-211a1069f166 req-ecc15a2a-9060-4e64-94a1-3db2a1235e32 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:05.431668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-9505198b-e93c-4a32-aac6-211a1069f166 req-ecc15a2a-9060-4e64-94a1-3db2a1235e32 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:05.443426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-9505198b-e93c-4a32-aac6-211a1069f166 req-ecc15a2a-9060-4e64-94a1-3db2a1235e32 service nova] Creating event network-changed:077796d9-a0ee-4177-8845-768d6c05b2b6 for instance dad1f171-af6a-4426-911c-022a3216f1f6 on hv-cinder-80588 Sep 14 20:01:05.447602 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c940d811-7652-40f7-9a18-7d5f59ed5a50 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 14 microversion: 2.20 time: 0.089801 Sep 14 20:01:05.448390 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1238/2444] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:05 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:05.448559 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-9505198b-e93c-4a32-aac6-211a1069f166 req-ecc15a2a-9060-4e64-94a1-3db2a1235e32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087815 Sep 14 20:01:05.449116 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1207/2445] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:01:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:06.459129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-eda40e91-b008-4846-bfe9-4ac6fc3e850b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:06.460124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-eda40e91-b008-4846-bfe9-4ac6fc3e850b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:06.466728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eda40e91-b008-4846-bfe9-4ac6fc3e850b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:06.467150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eda40e91-b008-4846-bfe9-4ac6fc3e850b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:06.467926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eda40e91-b008-4846-bfe9-4ac6fc3e850b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:06.468359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eda40e91-b008-4846-bfe9-4ac6fc3e850b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:06.528993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-eda40e91-b008-4846-bfe9-4ac6fc3e850b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 14 microversion: 2.20 time: 0.073712 Sep 14 20:01:06.530215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1239/2446] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:06 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:07.540936 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1153e1f9-2f6e-4ac6-967e-49fc342e04c6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:07.541993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1153e1f9-2f6e-4ac6-967e-49fc342e04c6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:07.548290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1153e1f9-2f6e-4ac6-967e-49fc342e04c6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:07.548731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1153e1f9-2f6e-4ac6-967e-49fc342e04c6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:07.549514 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1153e1f9-2f6e-4ac6-967e-49fc342e04c6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:07.550198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1153e1f9-2f6e-4ac6-967e-49fc342e04c6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:07.615090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1153e1f9-2f6e-4ac6-967e-49fc342e04c6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 14 microversion: 2.20 time: 0.077990 Sep 14 20:01:07.615738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1208/2447] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:07 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:08.626790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-72ad443a-420a-429c-b053-93097fe87ee8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:08.627793 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-72ad443a-420a-429c-b053-93097fe87ee8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:08.634856 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72ad443a-420a-429c-b053-93097fe87ee8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:08.635303 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72ad443a-420a-429c-b053-93097fe87ee8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:08.636090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72ad443a-420a-429c-b053-93097fe87ee8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:08.636528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72ad443a-420a-429c-b053-93097fe87ee8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:08.698624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-72ad443a-420a-429c-b053-93097fe87ee8 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 14 microversion: 2.20 time: 0.075759 Sep 14 20:01:08.699297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1240/2448] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:08 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:09.711357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dafc3d38-e05d-44c4-8220-55d7805efcd6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:09.712354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dafc3d38-e05d-44c4-8220-55d7805efcd6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:09.719283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dafc3d38-e05d-44c4-8220-55d7805efcd6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:09.719739 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dafc3d38-e05d-44c4-8220-55d7805efcd6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:09.720493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dafc3d38-e05d-44c4-8220-55d7805efcd6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:09.720929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dafc3d38-e05d-44c4-8220-55d7805efcd6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:09.778228 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dafc3d38-e05d-44c4-8220-55d7805efcd6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 14 microversion: 2.20 time: 0.070729 Sep 14 20:01:09.778871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1209/2449] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:09 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:10.790229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2c8b47cc-ffc3-4e49-97fb-cb8228251300 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:10.791233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2c8b47cc-ffc3-4e49-97fb-cb8228251300 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:10.798451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c8b47cc-ffc3-4e49-97fb-cb8228251300 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:10.798900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c8b47cc-ffc3-4e49-97fb-cb8228251300 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:10.799681 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c8b47cc-ffc3-4e49-97fb-cb8228251300 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:10.800377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2c8b47cc-ffc3-4e49-97fb-cb8228251300 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:10.861733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2c8b47cc-ffc3-4e49-97fb-cb8228251300 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 14 microversion: 2.20 time: 0.075459 Sep 14 20:01:10.862374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1241/2450] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:10 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:11.872661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-df761687-c13e-4f72-ba3f-216888cc64c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:11.874162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-df761687-c13e-4f72-ba3f-216888cc64c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:11.880634 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df761687-c13e-4f72-ba3f-216888cc64c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:11.881070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df761687-c13e-4f72-ba3f-216888cc64c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:11.881849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df761687-c13e-4f72-ba3f-216888cc64c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:11.882276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-df761687-c13e-4f72-ba3f-216888cc64c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:11.943577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-df761687-c13e-4f72-ba3f-216888cc64c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 14 microversion: 2.20 time: 0.074747 Sep 14 20:01:11.946706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1210/2451] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:11 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:12.955768 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-55677f50-9c70-4e5f-8061-279e76303ebe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:12.956762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-55677f50-9c70-4e5f-8061-279e76303ebe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:12.963429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55677f50-9c70-4e5f-8061-279e76303ebe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:12.963879 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55677f50-9c70-4e5f-8061-279e76303ebe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:12.964653 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55677f50-9c70-4e5f-8061-279e76303ebe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:12.965299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55677f50-9c70-4e5f-8061-279e76303ebe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:13.036759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-55677f50-9c70-4e5f-8061-279e76303ebe tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 14 microversion: 2.20 time: 0.073487 Sep 14 20:01:13.036759 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1242/2452] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:12 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:14.048411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c3af93f6-f0cd-4c9b-8615-161d43fc993b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:14.049325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c3af93f6-f0cd-4c9b-8615-161d43fc993b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:14.056108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3af93f6-f0cd-4c9b-8615-161d43fc993b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:14.056556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3af93f6-f0cd-4c9b-8615-161d43fc993b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:14.057326 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3af93f6-f0cd-4c9b-8615-161d43fc993b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:14.057787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c3af93f6-f0cd-4c9b-8615-161d43fc993b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:14.121630 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c3af93f6-f0cd-4c9b-8615-161d43fc993b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 14 microversion: 2.20 time: 0.077853 Sep 14 20:01:14.122356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1211/2453] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:14 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:15.133800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-24890d0d-c83d-4cb1-bf62-264885b5b314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:15.134834 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-24890d0d-c83d-4cb1-bf62-264885b5b314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:15.142448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-24890d0d-c83d-4cb1-bf62-264885b5b314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:15.142901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-24890d0d-c83d-4cb1-bf62-264885b5b314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:15.143696 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-24890d0d-c83d-4cb1-bf62-264885b5b314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:15.144359 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-24890d0d-c83d-4cb1-bf62-264885b5b314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:15.221514 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-24890d0d-c83d-4cb1-bf62-264885b5b314 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 10349 microversion: 2.20 time: 0.091780 Sep 14 20:01:15.222189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1243/2454] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:15 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 10349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:16.233988 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4921b042-9ca2-43e2-b16c-ba06dd2b4d0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:16.235002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4921b042-9ca2-43e2-b16c-ba06dd2b4d0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:16.241462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4921b042-9ca2-43e2-b16c-ba06dd2b4d0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:16.241939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4921b042-9ca2-43e2-b16c-ba06dd2b4d0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:16.242691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4921b042-9ca2-43e2-b16c-ba06dd2b4d0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:16.243122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4921b042-9ca2-43e2-b16c-ba06dd2b4d0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:16.315340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4921b042-9ca2-43e2-b16c-ba06dd2b4d0d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 17808 microversion: 2.20 time: 0.085260 Sep 14 20:01:16.316023 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1212/2455] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:16 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 17808 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 20:01:17.327246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-18a48fe0-7381-4901-ba4e-ac808359c84d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:17.328264 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-18a48fe0-7381-4901-ba4e-ac808359c84d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:17.334936 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18a48fe0-7381-4901-ba4e-ac808359c84d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:17.335377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18a48fe0-7381-4901-ba4e-ac808359c84d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:17.336147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18a48fe0-7381-4901-ba4e-ac808359c84d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:17.336576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18a48fe0-7381-4901-ba4e-ac808359c84d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:17.409586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-18a48fe0-7381-4901-ba4e-ac808359c84d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 18915 microversion: 2.20 time: 0.086065 Sep 14 20:01:17.410269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1244/2456] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:17 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 18915 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:18.422119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c08eec29-ebe2-4a09-9b13-009b6cf5a28b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:18.423210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c08eec29-ebe2-4a09-9b13-009b6cf5a28b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:18.430196 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c08eec29-ebe2-4a09-9b13-009b6cf5a28b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:18.430650 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c08eec29-ebe2-4a09-9b13-009b6cf5a28b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:18.431421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c08eec29-ebe2-4a09-9b13-009b6cf5a28b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:18.431889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c08eec29-ebe2-4a09-9b13-009b6cf5a28b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:18.505223 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c08eec29-ebe2-4a09-9b13-009b6cf5a28b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 21519 microversion: 2.20 time: 0.087649 Sep 14 20:01:18.505905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1213/2457] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:18 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 21519 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:19.518222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7b01003c-27ef-4a74-b335-25a2adaf231d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:19.519240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7b01003c-27ef-4a74-b335-25a2adaf231d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:19.525752 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b01003c-27ef-4a74-b335-25a2adaf231d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:19.526200 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b01003c-27ef-4a74-b335-25a2adaf231d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:19.526998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b01003c-27ef-4a74-b335-25a2adaf231d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:19.527432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7b01003c-27ef-4a74-b335-25a2adaf231d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:19.598799 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7b01003c-27ef-4a74-b335-25a2adaf231d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 23181 microversion: 2.20 time: 0.085130 Sep 14 20:01:19.599441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1245/2458] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:19 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 23181 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:20.611343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-40c88eaf-ff1a-414a-afc8-09dabbd4db75 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:20.612338 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-40c88eaf-ff1a-414a-afc8-09dabbd4db75 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:20.619872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40c88eaf-ff1a-414a-afc8-09dabbd4db75 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:20.620322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40c88eaf-ff1a-414a-afc8-09dabbd4db75 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:20.621110 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40c88eaf-ff1a-414a-afc8-09dabbd4db75 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:20.621577 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-40c88eaf-ff1a-414a-afc8-09dabbd4db75 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:20.698383 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-40c88eaf-ff1a-414a-afc8-09dabbd4db75 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 24432 microversion: 2.20 time: 0.091420 Sep 14 20:01:20.699106 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1214/2459] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:20 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 24432 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:21.710089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2dc77dbe-7df0-40fc-b493-c1fc775d5959 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:21.711013 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2dc77dbe-7df0-40fc-b493-c1fc775d5959 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:21.717454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2dc77dbe-7df0-40fc-b493-c1fc775d5959 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:21.717940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2dc77dbe-7df0-40fc-b493-c1fc775d5959 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:21.718709 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2dc77dbe-7df0-40fc-b493-c1fc775d5959 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:21.719145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2dc77dbe-7df0-40fc-b493-c1fc775d5959 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:21.788021 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2dc77dbe-7df0-40fc-b493-c1fc775d5959 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 26141 microversion: 2.20 time: 0.081929 Sep 14 20:01:21.788650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1246/2460] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:21 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 26141 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:22.800885 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d213d0d7-9a63-46d2-81b6-f75dbee541f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:22.801908 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d213d0d7-9a63-46d2-81b6-f75dbee541f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:22.808482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d213d0d7-9a63-46d2-81b6-f75dbee541f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:22.808930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d213d0d7-9a63-46d2-81b6-f75dbee541f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:22.809732 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d213d0d7-9a63-46d2-81b6-f75dbee541f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:22.810861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d213d0d7-9a63-46d2-81b6-f75dbee541f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:22.886405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d213d0d7-9a63-46d2-81b6-f75dbee541f4 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 27354 microversion: 2.20 time: 0.089619 Sep 14 20:01:22.887094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1215/2461] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:22 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 27354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:23.898875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a77bbbb5-9833-4001-842c-11ec07e1bc3d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:23.900139 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a77bbbb5-9833-4001-842c-11ec07e1bc3d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:23.907015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a77bbbb5-9833-4001-842c-11ec07e1bc3d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:23.907458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a77bbbb5-9833-4001-842c-11ec07e1bc3d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:23.908222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a77bbbb5-9833-4001-842c-11ec07e1bc3d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:23.908651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a77bbbb5-9833-4001-842c-11ec07e1bc3d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:23.990065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a77bbbb5-9833-4001-842c-11ec07e1bc3d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 28005 microversion: 2.20 time: 0.095330 Sep 14 20:01:23.990750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1247/2462] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:23 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 28005 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:25.002208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3cd06422-bb2f-49d1-ab79-dc2e01a7e85d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:25.003207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3cd06422-bb2f-49d1-ab79-dc2e01a7e85d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:25.009723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cd06422-bb2f-49d1-ab79-dc2e01a7e85d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:25.010166 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cd06422-bb2f-49d1-ab79-dc2e01a7e85d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:25.010956 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cd06422-bb2f-49d1-ab79-dc2e01a7e85d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:25.011390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3cd06422-bb2f-49d1-ab79-dc2e01a7e85d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:25.086606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3cd06422-bb2f-49d1-ab79-dc2e01a7e85d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 28192 microversion: 2.20 time: 0.088276 Sep 14 20:01:25.087511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1216/2463] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:24 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 28192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:26.098948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dd415bb9-165c-4538-b7ca-87f11810122b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:26.099951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dd415bb9-165c-4538-b7ca-87f11810122b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:26.106740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd415bb9-165c-4538-b7ca-87f11810122b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:26.107190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd415bb9-165c-4538-b7ca-87f11810122b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:26.107975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd415bb9-165c-4538-b7ca-87f11810122b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:26.108409 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd415bb9-165c-4538-b7ca-87f11810122b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:26.174324 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dd415bb9-165c-4538-b7ca-87f11810122b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 28192 microversion: 2.20 time: 0.078798 Sep 14 20:01:26.175675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1248/2464] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:26 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 28192 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:27.187627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-aef47cc1-8cde-4640-878e-bb4f415f4489 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:27.188632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-aef47cc1-8cde-4640-878e-bb4f415f4489 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:27.195567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aef47cc1-8cde-4640-878e-bb4f415f4489 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:27.196013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aef47cc1-8cde-4640-878e-bb4f415f4489 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:27.196803 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aef47cc1-8cde-4640-878e-bb4f415f4489 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:27.197244 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aef47cc1-8cde-4640-878e-bb4f415f4489 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:27.274803 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-aef47cc1-8cde-4640-878e-bb4f415f4489 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 28483 microversion: 2.20 time: 0.091005 Sep 14 20:01:27.275664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1217/2465] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:27 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 28483 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:28.287716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4f0ea8aa-c9ab-4f16-8438-c1990dd6a2c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:28.288948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4f0ea8aa-c9ab-4f16-8438-c1990dd6a2c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:28.296458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f0ea8aa-c9ab-4f16-8438-c1990dd6a2c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:28.297212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f0ea8aa-c9ab-4f16-8438-c1990dd6a2c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:28.298026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f0ea8aa-c9ab-4f16-8438-c1990dd6a2c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:28.298456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4f0ea8aa-c9ab-4f16-8438-c1990dd6a2c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:28.376494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4f0ea8aa-c9ab-4f16-8438-c1990dd6a2c5 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 28651 microversion: 2.20 time: 0.092537 Sep 14 20:01:28.378292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1249/2466] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:28 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 28651 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:29.388811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-54c9bc2a-2db9-4d52-a4f2-03a63ad8dea7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:29.389830 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-54c9bc2a-2db9-4d52-a4f2-03a63ad8dea7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:29.396235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54c9bc2a-2db9-4d52-a4f2-03a63ad8dea7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:29.396683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54c9bc2a-2db9-4d52-a4f2-03a63ad8dea7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:29.397449 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54c9bc2a-2db9-4d52-a4f2-03a63ad8dea7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:29.397943 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-54c9bc2a-2db9-4d52-a4f2-03a63ad8dea7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:29.458978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-54c9bc2a-2db9-4d52-a4f2-03a63ad8dea7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 28651 microversion: 2.20 time: 0.074068 Sep 14 20:01:29.459719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1218/2467] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:29 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 28651 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:30.471276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9ec889a7-1526-4209-82ca-52c564e414f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:30.473198 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9ec889a7-1526-4209-82ca-52c564e414f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:30.480142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ec889a7-1526-4209-82ca-52c564e414f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:30.480589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ec889a7-1526-4209-82ca-52c564e414f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:30.481601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ec889a7-1526-4209-82ca-52c564e414f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:30.482053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9ec889a7-1526-4209-82ca-52c564e414f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:30.547725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9ec889a7-1526-4209-82ca-52c564e414f6 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 28651 microversion: 2.20 time: 0.081191 Sep 14 20:01:30.548380 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1250/2468] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:30 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 28651 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:31.561594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b38b3d03-9d80-414a-b7a4-0892278a9f80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:31.563916 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b38b3d03-9d80-414a-b7a4-0892278a9f80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:31.572308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b38b3d03-9d80-414a-b7a4-0892278a9f80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:31.572906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b38b3d03-9d80-414a-b7a4-0892278a9f80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:31.573782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b38b3d03-9d80-414a-b7a4-0892278a9f80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:31.574809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b38b3d03-9d80-414a-b7a4-0892278a9f80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:31.653314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b38b3d03-9d80-414a-b7a4-0892278a9f80 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 30011 microversion: 2.20 time: 0.097183 Sep 14 20:01:31.656118 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1219/2469] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:31 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 30011 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:32.666053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fb725d0c-9bf4-402c-bb9d-d65fc9e87bea tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:32.667041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-fb725d0c-9bf4-402c-bb9d-d65fc9e87bea tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:32.673518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb725d0c-9bf4-402c-bb9d-d65fc9e87bea tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:32.674008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb725d0c-9bf4-402c-bb9d-d65fc9e87bea tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:32.674763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb725d0c-9bf4-402c-bb9d-d65fc9e87bea tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:32.675453 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-fb725d0c-9bf4-402c-bb9d-d65fc9e87bea tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:32.746292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fb725d0c-9bf4-402c-bb9d-d65fc9e87bea tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 32164 microversion: 2.20 time: 0.084133 Sep 14 20:01:32.746903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1251/2470] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:32 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 32164 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:33.759068 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8399e692-beb5-4e04-adaf-4382bcfb08b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:33.760165 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8399e692-beb5-4e04-adaf-4382bcfb08b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:33.767235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8399e692-beb5-4e04-adaf-4382bcfb08b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:33.767675 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8399e692-beb5-4e04-adaf-4382bcfb08b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:33.768452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8399e692-beb5-4e04-adaf-4382bcfb08b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:33.768882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8399e692-beb5-4e04-adaf-4382bcfb08b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:33.839761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8399e692-beb5-4e04-adaf-4382bcfb08b2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 33630 microversion: 2.20 time: 0.084564 Sep 14 20:01:33.840435 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1220/2471] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:33 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 33630 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 14 20:01:34.851587 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8399b41e-383f-4ca1-ab20-0589e7daa613 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:34.852625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8399b41e-383f-4ca1-ab20-0589e7daa613 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:34.859570 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8399b41e-383f-4ca1-ab20-0589e7daa613 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:34.860016 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8399b41e-383f-4ca1-ab20-0589e7daa613 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:34.860782 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8399b41e-383f-4ca1-ab20-0589e7daa613 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:34.861217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8399b41e-383f-4ca1-ab20-0589e7daa613 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:34.932127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8399b41e-383f-4ca1-ab20-0589e7daa613 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 34733 microversion: 2.20 time: 0.084469 Sep 14 20:01:34.932736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1252/2472] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:34 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 34733 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:35.944961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ea8229fa-b125-4ad2-bf48-aa5347a2f7ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:35.946015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ea8229fa-b125-4ad2-bf48-aa5347a2f7ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:35.953139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea8229fa-b125-4ad2-bf48-aa5347a2f7ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:35.953622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea8229fa-b125-4ad2-bf48-aa5347a2f7ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:35.954390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea8229fa-b125-4ad2-bf48-aa5347a2f7ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:35.954821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ea8229fa-b125-4ad2-bf48-aa5347a2f7ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:36.031877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ea8229fa-b125-4ad2-bf48-aa5347a2f7ff tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 35944 microversion: 2.20 time: 0.090748 Sep 14 20:01:36.032452 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1221/2473] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:35 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 35944 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:37.044217 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-eb1d7787-07b4-438a-8875-b7c6ebe7c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:37.045211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-eb1d7787-07b4-438a-8875-b7c6ebe7c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:37.051998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb1d7787-07b4-438a-8875-b7c6ebe7c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:37.052436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb1d7787-07b4-438a-8875-b7c6ebe7c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:37.053209 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb1d7787-07b4-438a-8875-b7c6ebe7c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:37.053685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb1d7787-07b4-438a-8875-b7c6ebe7c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:37.125766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-eb1d7787-07b4-438a-8875-b7c6ebe7c83d tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 37671 microversion: 2.20 time: 0.085416 Sep 14 20:01:37.126415 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1253/2474] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:37 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 37671 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:38.138071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-76953249-7903-4634-8acd-393a826ebef2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:38.139115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-76953249-7903-4634-8acd-393a826ebef2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:38.145576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-76953249-7903-4634-8acd-393a826ebef2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:38.146028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-76953249-7903-4634-8acd-393a826ebef2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:38.146799 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-76953249-7903-4634-8acd-393a826ebef2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:38.147234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-76953249-7903-4634-8acd-393a826ebef2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:38.219419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-76953249-7903-4634-8acd-393a826ebef2 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 38201 microversion: 2.20 time: 0.085247 Sep 14 20:01:38.220309 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1222/2475] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:38 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 38201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:39.231809 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d569e985-746c-434b-a9d2-f5a5bca0d558 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:39.233305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d569e985-746c-434b-a9d2-f5a5bca0d558 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:39.239771 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d569e985-746c-434b-a9d2-f5a5bca0d558 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:39.240220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d569e985-746c-434b-a9d2-f5a5bca0d558 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:39.240992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d569e985-746c-434b-a9d2-f5a5bca0d558 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:39.241439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d569e985-746c-434b-a9d2-f5a5bca0d558 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:39.302742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d569e985-746c-434b-a9d2-f5a5bca0d558 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 38201 microversion: 2.20 time: 0.074752 Sep 14 20:01:39.303394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1254/2476] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:39 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 38201 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:40.316042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c31bae02-acd0-4404-84db-5f3ff4668e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:40.317021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c31bae02-acd0-4404-84db-5f3ff4668e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:40.323837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c31bae02-acd0-4404-84db-5f3ff4668e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:40.324284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c31bae02-acd0-4404-84db-5f3ff4668e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:40.325021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c31bae02-acd0-4404-84db-5f3ff4668e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:40.325448 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c31bae02-acd0-4404-84db-5f3ff4668e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:40.386838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c31bae02-acd0-4404-84db-5f3ff4668e88 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 38201 microversion: 2.20 time: 0.074824 Sep 14 20:01:40.387738 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1223/2477] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:40 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 38201 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:41.400057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1b6f5e8d-adc1-4111-97a6-b7b3fb67c769 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:41.401057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1b6f5e8d-adc1-4111-97a6-b7b3fb67c769 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:41.408254 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b6f5e8d-adc1-4111-97a6-b7b3fb67c769 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:41.408703 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b6f5e8d-adc1-4111-97a6-b7b3fb67c769 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:41.409473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b6f5e8d-adc1-4111-97a6-b7b3fb67c769 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:41.409940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b6f5e8d-adc1-4111-97a6-b7b3fb67c769 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:41.469652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1b6f5e8d-adc1-4111-97a6-b7b3fb67c769 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 38201 microversion: 2.20 time: 0.073520 Sep 14 20:01:41.470566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1255/2478] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:41 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 38201 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:42.482562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b8bdf586-9bef-4d4b-a486-bbbc3b1268c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:42.483555 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b8bdf586-9bef-4d4b-a486-bbbc3b1268c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:42.490218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b8bdf586-9bef-4d4b-a486-bbbc3b1268c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:42.490659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b8bdf586-9bef-4d4b-a486-bbbc3b1268c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:42.491417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b8bdf586-9bef-4d4b-a486-bbbc3b1268c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:42.491850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b8bdf586-9bef-4d4b-a486-bbbc3b1268c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:42.564773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b8bdf586-9bef-4d4b-a486-bbbc3b1268c7 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action" status: 200 len: 38341 microversion: 2.20 time: 0.086303 Sep 14 20:01:42.565410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1224/2479] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Sep 14 20:01:42 2021] POST /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/action => generated 38341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:42.575706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9d073693-d690-45a0-bef6-1f37f23be60a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:42.576932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9d073693-d690-45a0-bef6-1f37f23be60a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:01:42.583435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9d073693-d690-45a0-bef6-1f37f23be60a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:42.583894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9d073693-d690-45a0-bef6-1f37f23be60a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:42.584656 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9d073693-d690-45a0-bef6-1f37f23be60a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:01:42.585093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9d073693-d690-45a0-bef6-1f37f23be60a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:01:42.607535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9d073693-d690-45a0-bef6-1f37f23be60a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/ips" status: 200 len: 150 microversion: 2.20 time: 0.035898 Sep 14 20:01:42.608096 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1256/2480] 10.222.0.58 () {60 vars in 1289 bytes} [Tue Sep 14 20:01:42 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 20:03:23.421986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:03:23.422584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:03:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:03:24.683523 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:03:24.684397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:03:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:03:34.362130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:03:34.362850 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:03:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:04:02.769563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5dfcc4a0-629d-43b9-a0d8-c62a998e08a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:02.770151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5dfcc4a0-629d-43b9-a0d8-c62a998e08a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:02.776618 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5dfcc4a0-629d-43b9-a0d8-c62a998e08a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:02.777059 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5dfcc4a0-629d-43b9-a0d8-c62a998e08a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:02.777842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5dfcc4a0-629d-43b9-a0d8-c62a998e08a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:02.778275 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5dfcc4a0-629d-43b9-a0d8-c62a998e08a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:02.804450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5dfcc4a0-629d-43b9-a0d8-c62a998e08a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Going to try to terminate instance {{(pid=115679) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 20:04:03.088113 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5dfcc4a0-629d-43b9-a0d8-c62a998e08a9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 204 len: 0 microversion: 2.1 time: 0.323349 Sep 14 20:04:03.093436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1225/2481] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:04:02 2021] DELETE /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:04:03.098520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-46850eec-010f-4822-9eac-6ab73dedf7c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:03.099141 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-46850eec-010f-4822-9eac-6ab73dedf7c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:03.105134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46850eec-010f-4822-9eac-6ab73dedf7c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:03.105630 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46850eec-010f-4822-9eac-6ab73dedf7c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:03.106411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46850eec-010f-4822-9eac-6ab73dedf7c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:03.106913 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-46850eec-010f-4822-9eac-6ab73dedf7c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:03.296510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-46850eec-010f-4822-9eac-6ab73dedf7c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:03.304730 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-46850eec-010f-4822-9eac-6ab73dedf7c0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1560 microversion: 2.1 time: 0.211836 Sep 14 20:04:03.305293 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1257/2482] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:03 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:04:04.323016 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-84f23534-b2a5-44b1-8f96-4e8a46d5627e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:04.323669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-84f23534-b2a5-44b1-8f96-4e8a46d5627e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:04.331806 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-84f23534-b2a5-44b1-8f96-4e8a46d5627e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:04.332577 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-84f23534-b2a5-44b1-8f96-4e8a46d5627e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:04.334041 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-84f23534-b2a5-44b1-8f96-4e8a46d5627e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:04.334186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-84f23534-b2a5-44b1-8f96-4e8a46d5627e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:04.382362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-2be07102-a6e2-4e36-af98-52c830d38eb5 req-f4fe80c6-afde-4884-ad0c-2436b22e396c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6", "name": "network-vif-deleted", "tag": "eca1d51d-fcb7-4c11-a66d-106f9d4745be"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:04:04.384051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:04:04.384051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:04:04.396450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-2be07102-a6e2-4e36-af98-52c830d38eb5 req-f4fe80c6-afde-4884-ad0c-2436b22e396c service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:04.396450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-2be07102-a6e2-4e36-af98-52c830d38eb5 req-f4fe80c6-afde-4884-ad0c-2436b22e396c service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:04.405098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-2be07102-a6e2-4e36-af98-52c830d38eb5 req-f4fe80c6-afde-4884-ad0c-2436b22e396c service nova] Creating event network-vif-deleted:eca1d51d-fcb7-4c11-a66d-106f9d4745be for instance 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 on hv-cinder-80588 Sep 14 20:04:04.408325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-84f23534-b2a5-44b1-8f96-4e8a46d5627e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:04.413579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-2be07102-a6e2-4e36-af98-52c830d38eb5 req-f4fe80c6-afde-4884-ad0c-2436b22e396c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095762 Sep 14 20:04:04.413579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1226/2483] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:04:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:04:04.418687 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-84f23534-b2a5-44b1-8f96-4e8a46d5627e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1518 microversion: 2.1 time: 0.099791 Sep 14 20:04:04.419333 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1258/2484] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:04 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1518 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:05.436387 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-aeb702fe-1324-46a9-839a-ae0e88bf0203 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:05.437167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-aeb702fe-1324-46a9-839a-ae0e88bf0203 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:05.443971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aeb702fe-1324-46a9-839a-ae0e88bf0203 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:05.444421 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aeb702fe-1324-46a9-839a-ae0e88bf0203 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:05.445213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aeb702fe-1324-46a9-839a-ae0e88bf0203 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:05.445694 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aeb702fe-1324-46a9-839a-ae0e88bf0203 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:05.571096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-aeb702fe-1324-46a9-839a-ae0e88bf0203 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:05.579038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-aeb702fe-1324-46a9-839a-ae0e88bf0203 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.146670 Sep 14 20:04:05.579592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1227/2485] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:05 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:06.596323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-13f88e09-775b-4971-a195-6da521e6cd2b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:06.596961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-13f88e09-775b-4971-a195-6da521e6cd2b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:06.604025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13f88e09-775b-4971-a195-6da521e6cd2b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:06.604479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13f88e09-775b-4971-a195-6da521e6cd2b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:06.605255 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13f88e09-775b-4971-a195-6da521e6cd2b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:06.605740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13f88e09-775b-4971-a195-6da521e6cd2b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:06.678875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-13f88e09-775b-4971-a195-6da521e6cd2b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:06.688119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-13f88e09-775b-4971-a195-6da521e6cd2b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.096335 Sep 14 20:04:06.688695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1259/2486] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:06 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:07.707312 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f59ccd9c-e15e-440c-8dc4-a2cbb86b7e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:07.707923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f59ccd9c-e15e-440c-8dc4-a2cbb86b7e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:07.714367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f59ccd9c-e15e-440c-8dc4-a2cbb86b7e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:07.714810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f59ccd9c-e15e-440c-8dc4-a2cbb86b7e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:07.715579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f59ccd9c-e15e-440c-8dc4-a2cbb86b7e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:07.716022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f59ccd9c-e15e-440c-8dc4-a2cbb86b7e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:07.780096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f59ccd9c-e15e-440c-8dc4-a2cbb86b7e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:07.789787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f59ccd9c-e15e-440c-8dc4-a2cbb86b7e4c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.086007 Sep 14 20:04:07.790370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1228/2487] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:07 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:08.806741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dec309f3-7b39-48ca-a985-48d4d3bcdfdb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:08.807392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dec309f3-7b39-48ca-a985-48d4d3bcdfdb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:08.813373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dec309f3-7b39-48ca-a985-48d4d3bcdfdb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:08.813853 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dec309f3-7b39-48ca-a985-48d4d3bcdfdb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:08.814625 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dec309f3-7b39-48ca-a985-48d4d3bcdfdb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:08.815066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dec309f3-7b39-48ca-a985-48d4d3bcdfdb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:08.876597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dec309f3-7b39-48ca-a985-48d4d3bcdfdb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:08.884770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dec309f3-7b39-48ca-a985-48d4d3bcdfdb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081666 Sep 14 20:04:08.885342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1260/2488] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:08 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:09.901239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0b8484a1-b773-4d67-af17-70b14bdfe55b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:09.901882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0b8484a1-b773-4d67-af17-70b14bdfe55b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:09.908137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b8484a1-b773-4d67-af17-70b14bdfe55b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:09.908584 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b8484a1-b773-4d67-af17-70b14bdfe55b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:09.909367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b8484a1-b773-4d67-af17-70b14bdfe55b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:09.909832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0b8484a1-b773-4d67-af17-70b14bdfe55b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:09.970647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0b8484a1-b773-4d67-af17-70b14bdfe55b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:09.978580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0b8484a1-b773-4d67-af17-70b14bdfe55b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081048 Sep 14 20:04:09.979159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1229/2489] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:09 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:10.995603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d4bd7f69-18fd-4ec9-8f97-735e51157fd8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:10.996214 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d4bd7f69-18fd-4ec9-8f97-735e51157fd8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:11.003162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4bd7f69-18fd-4ec9-8f97-735e51157fd8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:11.003603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4bd7f69-18fd-4ec9-8f97-735e51157fd8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:11.004374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4bd7f69-18fd-4ec9-8f97-735e51157fd8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:11.004800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d4bd7f69-18fd-4ec9-8f97-735e51157fd8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:11.066589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d4bd7f69-18fd-4ec9-8f97-735e51157fd8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:11.074411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d4bd7f69-18fd-4ec9-8f97-735e51157fd8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.082586 Sep 14 20:04:11.075982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1261/2490] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:10 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:12.091525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-56438463-3879-4a2c-86ae-701796e50cb9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:12.092080 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-56438463-3879-4a2c-86ae-701796e50cb9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:12.098618 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-56438463-3879-4a2c-86ae-701796e50cb9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:12.099062 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-56438463-3879-4a2c-86ae-701796e50cb9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:12.099817 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-56438463-3879-4a2c-86ae-701796e50cb9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:12.100246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-56438463-3879-4a2c-86ae-701796e50cb9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:12.162828 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-56438463-3879-4a2c-86ae-701796e50cb9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:12.170825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-56438463-3879-4a2c-86ae-701796e50cb9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.082957 Sep 14 20:04:12.171398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1230/2491] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:12 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:13.188133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-019a3c70-e297-4347-8464-2fc4402be877 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:13.188731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-019a3c70-e297-4347-8464-2fc4402be877 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:13.194817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-019a3c70-e297-4347-8464-2fc4402be877 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:13.195266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-019a3c70-e297-4347-8464-2fc4402be877 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:13.196043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-019a3c70-e297-4347-8464-2fc4402be877 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:13.196489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-019a3c70-e297-4347-8464-2fc4402be877 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:13.256007 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-019a3c70-e297-4347-8464-2fc4402be877 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:13.264052 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-019a3c70-e297-4347-8464-2fc4402be877 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080089 Sep 14 20:04:13.264628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1262/2492] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:13 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:14.283961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8607c011-d210-4227-98e3-7df1bea07b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:14.284760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8607c011-d210-4227-98e3-7df1bea07b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:14.290797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8607c011-d210-4227-98e3-7df1bea07b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:14.291245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8607c011-d210-4227-98e3-7df1bea07b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:14.292028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8607c011-d210-4227-98e3-7df1bea07b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:14.292463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8607c011-d210-4227-98e3-7df1bea07b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:14.352816 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8607c011-d210-4227-98e3-7df1bea07b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:14.360654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8607c011-d210-4227-98e3-7df1bea07b7a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081105 Sep 14 20:04:14.361221 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1231/2493] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:14 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:15.376460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-23f45075-ec34-4d46-97f1-47f267625935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:15.377075 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-23f45075-ec34-4d46-97f1-47f267625935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:15.383073 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-23f45075-ec34-4d46-97f1-47f267625935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:15.383528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-23f45075-ec34-4d46-97f1-47f267625935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:15.384308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-23f45075-ec34-4d46-97f1-47f267625935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:15.384746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-23f45075-ec34-4d46-97f1-47f267625935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:15.445725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-23f45075-ec34-4d46-97f1-47f267625935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:15.453641 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-23f45075-ec34-4d46-97f1-47f267625935 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080882 Sep 14 20:04:15.454203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1263/2494] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:15 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:16.470120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a67b3aa2-4f50-4348-a33c-f03997939c44 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:16.470734 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a67b3aa2-4f50-4348-a33c-f03997939c44 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:16.477143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a67b3aa2-4f50-4348-a33c-f03997939c44 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:16.477628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a67b3aa2-4f50-4348-a33c-f03997939c44 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:16.478420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a67b3aa2-4f50-4348-a33c-f03997939c44 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:16.478861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a67b3aa2-4f50-4348-a33c-f03997939c44 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:16.558745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a67b3aa2-4f50-4348-a33c-f03997939c44 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:16.567778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a67b3aa2-4f50-4348-a33c-f03997939c44 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.101167 Sep 14 20:04:16.568351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1232/2495] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:16 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:16.775346 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-22ea47bd-4234-4c54-b24d-4bec896f5f3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:16.775889 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-22ea47bd-4234-4c54-b24d-4bec896f5f3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:16.782112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22ea47bd-4234-4c54-b24d-4bec896f5f3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:16.782561 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22ea47bd-4234-4c54-b24d-4bec896f5f3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:16.783338 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22ea47bd-4234-4c54-b24d-4bec896f5f3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:16.783777 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-22ea47bd-4234-4c54-b24d-4bec896f5f3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:16.798677 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-22ea47bd-4234-4c54-b24d-4bec896f5f3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] HTTP exception thrown: Instance e617ad6d-c91d-4057-afb6-d220eb42ef28 could not be found. Sep 14 20:04:16.799294 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-22ea47bd-4234-4c54-b24d-4bec896f5f3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Returning 404 to user: Instance e617ad6d-c91d-4057-afb6-d220eb42ef28 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:04:16.800132 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-22ea47bd-4234-4c54-b24d-4bec896f5f3c tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 404 len: 111 microversion: 2.1 time: 0.028438 Sep 14 20:04:16.800937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1264/2496] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:04:16 2021] DELETE /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:04:16.808874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d5c7e53e-54f9-4e3a-89b9-1d9095c11560 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:16.809486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d5c7e53e-54f9-4e3a-89b9-1d9095c11560 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: e617ad6d-c91d-4057-afb6-d220eb42ef28] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:16.815564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d5c7e53e-54f9-4e3a-89b9-1d9095c11560 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:16.816013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d5c7e53e-54f9-4e3a-89b9-1d9095c11560 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:16.816787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d5c7e53e-54f9-4e3a-89b9-1d9095c11560 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:16.817228 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d5c7e53e-54f9-4e3a-89b9-1d9095c11560 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:16.830986 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-d5c7e53e-54f9-4e3a-89b9-1d9095c11560 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] HTTP exception thrown: Instance e617ad6d-c91d-4057-afb6-d220eb42ef28 could not be found. Sep 14 20:04:16.831493 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d5c7e53e-54f9-4e3a-89b9-1d9095c11560 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Returning 404 to user: Instance e617ad6d-c91d-4057-afb6-d220eb42ef28 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:04:16.832316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d5c7e53e-54f9-4e3a-89b9-1d9095c11560 tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28" status: 404 len: 111 microversion: 2.1 time: 0.026977 Sep 14 20:04:16.832879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1233/2497] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:16 2021] GET /compute/v2.1/servers/e617ad6d-c91d-4057-afb6-d220eb42ef28 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:04:17.583972 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1f91ab15-2ad4-4b01-975d-5642e6e27a28 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:17.584583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1f91ab15-2ad4-4b01-975d-5642e6e27a28 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:17.590579 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f91ab15-2ad4-4b01-975d-5642e6e27a28 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:17.591028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f91ab15-2ad4-4b01-975d-5642e6e27a28 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:17.591795 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f91ab15-2ad4-4b01-975d-5642e6e27a28 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:17.592240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1f91ab15-2ad4-4b01-975d-5642e6e27a28 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:17.656697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1f91ab15-2ad4-4b01-975d-5642e6e27a28 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:17.665927 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1f91ab15-2ad4-4b01-975d-5642e6e27a28 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.085568 Sep 14 20:04:17.666501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1265/2498] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:17 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:18.682351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-06fdd077-5ea0-4c04-88a4-4212ce60e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:18.689291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-06fdd077-5ea0-4c04-88a4-4212ce60e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:18.689291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06fdd077-5ea0-4c04-88a4-4212ce60e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:18.689291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06fdd077-5ea0-4c04-88a4-4212ce60e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:18.690157 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06fdd077-5ea0-4c04-88a4-4212ce60e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:18.690596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06fdd077-5ea0-4c04-88a4-4212ce60e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:18.750635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-06fdd077-5ea0-4c04-88a4-4212ce60e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:18.758423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-06fdd077-5ea0-4c04-88a4-4212ce60e0a3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079903 Sep 14 20:04:18.758979 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1234/2499] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:18 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:19.775304 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b3188d4f-8a1a-4582-b724-150680d62475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:19.775927 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b3188d4f-8a1a-4582-b724-150680d62475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:19.782433 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3188d4f-8a1a-4582-b724-150680d62475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:19.782888 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3188d4f-8a1a-4582-b724-150680d62475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:19.783669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3188d4f-8a1a-4582-b724-150680d62475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:19.784113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b3188d4f-8a1a-4582-b724-150680d62475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:19.845696 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b3188d4f-8a1a-4582-b724-150680d62475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:19.853579 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b3188d4f-8a1a-4582-b724-150680d62475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081852 Sep 14 20:04:19.854252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1266/2500] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:19 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:20.870605 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2f965406-0f59-459b-860a-0887357af09b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:20.871208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2f965406-0f59-459b-860a-0887357af09b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:20.877417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f965406-0f59-459b-860a-0887357af09b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:20.877898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f965406-0f59-459b-860a-0887357af09b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:20.878659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f965406-0f59-459b-860a-0887357af09b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:20.879091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2f965406-0f59-459b-860a-0887357af09b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:20.938471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2f965406-0f59-459b-860a-0887357af09b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:20.946126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2f965406-0f59-459b-860a-0887357af09b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079253 Sep 14 20:04:20.946688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1235/2501] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:20 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:04:21.962739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a3eeee1f-a2f8-4a00-b950-f4fe2f25bd3d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:21.963362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a3eeee1f-a2f8-4a00-b950-f4fe2f25bd3d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:21.969976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a3eeee1f-a2f8-4a00-b950-f4fe2f25bd3d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:21.970425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a3eeee1f-a2f8-4a00-b950-f4fe2f25bd3d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:21.971204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a3eeee1f-a2f8-4a00-b950-f4fe2f25bd3d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:21.971643 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a3eeee1f-a2f8-4a00-b950-f4fe2f25bd3d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:22.032275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a3eeee1f-a2f8-4a00-b950-f4fe2f25bd3d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:22.040650 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a3eeee1f-a2f8-4a00-b950-f4fe2f25bd3d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081585 Sep 14 20:04:22.041224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1267/2502] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:21 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:23.057353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-14442014-ded9-424f-ac92-d6e4c50e0c3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:23.057974 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-14442014-ded9-424f-ac92-d6e4c50e0c3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:23.064191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14442014-ded9-424f-ac92-d6e4c50e0c3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:23.064632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14442014-ded9-424f-ac92-d6e4c50e0c3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:23.065410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14442014-ded9-424f-ac92-d6e4c50e0c3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:23.065868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-14442014-ded9-424f-ac92-d6e4c50e0c3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:23.127758 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-14442014-ded9-424f-ac92-d6e4c50e0c3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:23.137174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-14442014-ded9-424f-ac92-d6e4c50e0c3b tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.083461 Sep 14 20:04:23.137955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1236/2503] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:23 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:04:24.154277 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4dff64b1-964a-47d0-880d-4caee947c672 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:24.154924 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-4dff64b1-964a-47d0-880d-4caee947c672 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:24.160851 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4dff64b1-964a-47d0-880d-4caee947c672 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:24.161388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4dff64b1-964a-47d0-880d-4caee947c672 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:24.162404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4dff64b1-964a-47d0-880d-4caee947c672 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:24.162981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-4dff64b1-964a-47d0-880d-4caee947c672 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:24.224800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-4dff64b1-964a-47d0-880d-4caee947c672 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:24.232873 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4dff64b1-964a-47d0-880d-4caee947c672 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.082197 Sep 14 20:04:24.233994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1268/2504] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:24 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:25.249900 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-be90600c-4903-4412-8b3a-2b6a6122d07f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:25.250509 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-be90600c-4903-4412-8b3a-2b6a6122d07f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:25.256780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be90600c-4903-4412-8b3a-2b6a6122d07f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:25.257225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be90600c-4903-4412-8b3a-2b6a6122d07f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:25.258034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be90600c-4903-4412-8b3a-2b6a6122d07f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:25.258467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-be90600c-4903-4412-8b3a-2b6a6122d07f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:25.324093 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-be90600c-4903-4412-8b3a-2b6a6122d07f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:25.331720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-be90600c-4903-4412-8b3a-2b6a6122d07f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.085463 Sep 14 20:04:25.332326 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1237/2505] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:25 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:26.348679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b483020f-1feb-4edd-96da-afe5bc5c091e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:26.349236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b483020f-1feb-4edd-96da-afe5bc5c091e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:26.355504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b483020f-1feb-4edd-96da-afe5bc5c091e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:26.355951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b483020f-1feb-4edd-96da-afe5bc5c091e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:26.356724 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b483020f-1feb-4edd-96da-afe5bc5c091e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:26.357159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b483020f-1feb-4edd-96da-afe5bc5c091e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:26.419072 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b483020f-1feb-4edd-96da-afe5bc5c091e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:26.427683 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b483020f-1feb-4edd-96da-afe5bc5c091e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.082713 Sep 14 20:04:26.428329 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1269/2506] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:26 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:27.444436 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3e6584ee-985c-4e86-a7f2-b6e80dbf1475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:27.445074 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3e6584ee-985c-4e86-a7f2-b6e80dbf1475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:27.451089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e6584ee-985c-4e86-a7f2-b6e80dbf1475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:27.451573 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e6584ee-985c-4e86-a7f2-b6e80dbf1475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:27.452933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e6584ee-985c-4e86-a7f2-b6e80dbf1475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:27.453376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3e6584ee-985c-4e86-a7f2-b6e80dbf1475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:27.512100 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3e6584ee-985c-4e86-a7f2-b6e80dbf1475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:27.520636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3e6584ee-985c-4e86-a7f2-b6e80dbf1475 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079843 Sep 14 20:04:27.521204 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1238/2507] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:27 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:28.537039 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3653b634-a635-4681-8d05-017d69b9e5fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:28.542443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3653b634-a635-4681-8d05-017d69b9e5fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:28.544504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3653b634-a635-4681-8d05-017d69b9e5fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:28.544504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3653b634-a635-4681-8d05-017d69b9e5fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:28.544789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3653b634-a635-4681-8d05-017d69b9e5fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:28.545216 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3653b634-a635-4681-8d05-017d69b9e5fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:28.605934 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3653b634-a635-4681-8d05-017d69b9e5fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:28.613948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3653b634-a635-4681-8d05-017d69b9e5fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080484 Sep 14 20:04:28.614510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1270/2508] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:28 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:29.629683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-262d9b3b-3de2-42d9-a8b1-4102a58d1ef6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:29.630290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-262d9b3b-3de2-42d9-a8b1-4102a58d1ef6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:29.636174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-262d9b3b-3de2-42d9-a8b1-4102a58d1ef6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:29.636614 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-262d9b3b-3de2-42d9-a8b1-4102a58d1ef6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:29.637369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-262d9b3b-3de2-42d9-a8b1-4102a58d1ef6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:29.637826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-262d9b3b-3de2-42d9-a8b1-4102a58d1ef6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:29.697546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-262d9b3b-3de2-42d9-a8b1-4102a58d1ef6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:29.705478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-262d9b3b-3de2-42d9-a8b1-4102a58d1ef6 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079412 Sep 14 20:04:29.706064 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1239/2509] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:29 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:30.722302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-878198cb-8672-4c6b-b6eb-a4079601960f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:30.723001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-878198cb-8672-4c6b-b6eb-a4079601960f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:30.729023 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-878198cb-8672-4c6b-b6eb-a4079601960f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:30.729569 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-878198cb-8672-4c6b-b6eb-a4079601960f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:30.730364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-878198cb-8672-4c6b-b6eb-a4079601960f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:30.730804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-878198cb-8672-4c6b-b6eb-a4079601960f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:30.800211 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-878198cb-8672-4c6b-b6eb-a4079601960f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:30.812961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-878198cb-8672-4c6b-b6eb-a4079601960f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.094254 Sep 14 20:04:30.813566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1271/2510] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:30 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:31.831390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-09addefa-2149-4cba-8354-f65cb18123e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:31.832002 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-09addefa-2149-4cba-8354-f65cb18123e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:31.838157 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09addefa-2149-4cba-8354-f65cb18123e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:31.838932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09addefa-2149-4cba-8354-f65cb18123e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:31.839355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09addefa-2149-4cba-8354-f65cb18123e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:31.839785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-09addefa-2149-4cba-8354-f65cb18123e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:31.907927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-09addefa-2149-4cba-8354-f65cb18123e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:31.915990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-09addefa-2149-4cba-8354-f65cb18123e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.089023 Sep 14 20:04:31.916564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1240/2511] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:31 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:32.932426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-daea769d-d1c5-475b-92e5-6be073f9b4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:32.933045 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-daea769d-d1c5-475b-92e5-6be073f9b4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:32.939101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-daea769d-d1c5-475b-92e5-6be073f9b4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:32.939551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-daea769d-d1c5-475b-92e5-6be073f9b4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:32.940331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-daea769d-d1c5-475b-92e5-6be073f9b4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:32.940770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-daea769d-d1c5-475b-92e5-6be073f9b4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:33.001288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-daea769d-d1c5-475b-92e5-6be073f9b4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:33.009981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-daea769d-d1c5-475b-92e5-6be073f9b4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081154 Sep 14 20:04:33.010555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1272/2512] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:32 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:34.026861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6d5eb666-5362-44e5-bcb9-76826006c4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:34.027415 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6d5eb666-5362-44e5-bcb9-76826006c4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:34.033929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d5eb666-5362-44e5-bcb9-76826006c4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:34.034383 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d5eb666-5362-44e5-bcb9-76826006c4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:34.035155 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d5eb666-5362-44e5-bcb9-76826006c4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:34.035592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6d5eb666-5362-44e5-bcb9-76826006c4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:34.104251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6d5eb666-5362-44e5-bcb9-76826006c4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:34.112794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6d5eb666-5362-44e5-bcb9-76826006c4b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.089624 Sep 14 20:04:34.113401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1241/2513] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:34 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:35.129672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-022147f5-0386-4941-b6b0-0654a3a492d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:35.130265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-022147f5-0386-4941-b6b0-0654a3a492d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:35.136134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-022147f5-0386-4941-b6b0-0654a3a492d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:35.136586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-022147f5-0386-4941-b6b0-0654a3a492d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:35.137353 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-022147f5-0386-4941-b6b0-0654a3a492d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:35.137820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-022147f5-0386-4941-b6b0-0654a3a492d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:35.197905 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-022147f5-0386-4941-b6b0-0654a3a492d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:35.206056 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-022147f5-0386-4941-b6b0-0654a3a492d3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079999 Sep 14 20:04:35.206633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1273/2514] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:35 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:36.223046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2027a2a3-0c19-48ae-b939-ca951469e627 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:36.223680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2027a2a3-0c19-48ae-b939-ca951469e627 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:36.229476 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2027a2a3-0c19-48ae-b939-ca951469e627 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:36.229948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2027a2a3-0c19-48ae-b939-ca951469e627 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:36.230710 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2027a2a3-0c19-48ae-b939-ca951469e627 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:36.231146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2027a2a3-0c19-48ae-b939-ca951469e627 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:36.290225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2027a2a3-0c19-48ae-b939-ca951469e627 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:36.298282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2027a2a3-0c19-48ae-b939-ca951469e627 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078812 Sep 14 20:04:36.298866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1242/2515] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:36 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:37.315126 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8cd9980e-7f71-4af1-80c8-8063e38d9bf3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:37.315683 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8cd9980e-7f71-4af1-80c8-8063e38d9bf3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:37.321521 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cd9980e-7f71-4af1-80c8-8063e38d9bf3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:37.321982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cd9980e-7f71-4af1-80c8-8063e38d9bf3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:37.322741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cd9980e-7f71-4af1-80c8-8063e38d9bf3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:37.323176 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8cd9980e-7f71-4af1-80c8-8063e38d9bf3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:37.381322 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8cd9980e-7f71-4af1-80c8-8063e38d9bf3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:37.388898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8cd9980e-7f71-4af1-80c8-8063e38d9bf3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.077576 Sep 14 20:04:37.389452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1274/2516] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:37 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:38.404911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5c73a1af-e1b5-4eb8-b2a0-70e36f8f2473 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:38.405648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5c73a1af-e1b5-4eb8-b2a0-70e36f8f2473 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:38.411323 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c73a1af-e1b5-4eb8-b2a0-70e36f8f2473 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:38.411776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c73a1af-e1b5-4eb8-b2a0-70e36f8f2473 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:38.412634 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c73a1af-e1b5-4eb8-b2a0-70e36f8f2473 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:38.413077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5c73a1af-e1b5-4eb8-b2a0-70e36f8f2473 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:38.476399 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5c73a1af-e1b5-4eb8-b2a0-70e36f8f2473 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:38.484990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5c73a1af-e1b5-4eb8-b2a0-70e36f8f2473 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.083758 Sep 14 20:04:38.485579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1243/2517] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:38 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:39.502877 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-531dd80b-4266-4c55-9c11-924c05e7d6c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:39.503475 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-531dd80b-4266-4c55-9c11-924c05e7d6c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:39.509416 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-531dd80b-4266-4c55-9c11-924c05e7d6c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:39.509896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-531dd80b-4266-4c55-9c11-924c05e7d6c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:39.510679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-531dd80b-4266-4c55-9c11-924c05e7d6c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:39.511121 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-531dd80b-4266-4c55-9c11-924c05e7d6c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:39.570665 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-531dd80b-4266-4c55-9c11-924c05e7d6c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:39.579125 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-531dd80b-4266-4c55-9c11-924c05e7d6c4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080525 Sep 14 20:04:39.579699 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1275/2518] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:39 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:40.596207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2b7b7108-7967-4158-b58e-f3ed2b11ad05 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:40.596827 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2b7b7108-7967-4158-b58e-f3ed2b11ad05 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:40.602876 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b7b7108-7967-4158-b58e-f3ed2b11ad05 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:40.603358 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b7b7108-7967-4158-b58e-f3ed2b11ad05 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:40.604135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b7b7108-7967-4158-b58e-f3ed2b11ad05 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:40.604591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2b7b7108-7967-4158-b58e-f3ed2b11ad05 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:40.664693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2b7b7108-7967-4158-b58e-f3ed2b11ad05 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:40.672746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2b7b7108-7967-4158-b58e-f3ed2b11ad05 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080889 Sep 14 20:04:40.673316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1244/2519] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:40 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:41.690053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-8617b377-020b-40b5-b619-97c0080921ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:41.690791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-8617b377-020b-40b5-b619-97c0080921ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:41.696739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8617b377-020b-40b5-b619-97c0080921ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:41.697195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8617b377-020b-40b5-b619-97c0080921ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:41.698000 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8617b377-020b-40b5-b619-97c0080921ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:41.698442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-8617b377-020b-40b5-b619-97c0080921ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:41.758687 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-8617b377-020b-40b5-b619-97c0080921ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:41.767327 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-8617b377-020b-40b5-b619-97c0080921ef tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081573 Sep 14 20:04:41.767910 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1276/2520] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:41 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:42.783780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b002d369-63a4-41a3-a385-73cb374e09fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:42.784395 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b002d369-63a4-41a3-a385-73cb374e09fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:42.790296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b002d369-63a4-41a3-a385-73cb374e09fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:42.790747 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b002d369-63a4-41a3-a385-73cb374e09fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:42.791523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b002d369-63a4-41a3-a385-73cb374e09fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:42.791963 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b002d369-63a4-41a3-a385-73cb374e09fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:42.852159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b002d369-63a4-41a3-a385-73cb374e09fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:42.860541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b002d369-63a4-41a3-a385-73cb374e09fd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080549 Sep 14 20:04:42.861124 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1245/2521] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:42 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:43.877355 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dcc103e5-677b-41c8-a9f5-4659d21fd874 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:43.877992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dcc103e5-677b-41c8-a9f5-4659d21fd874 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:43.884220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcc103e5-677b-41c8-a9f5-4659d21fd874 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:43.884671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcc103e5-677b-41c8-a9f5-4659d21fd874 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:43.885435 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcc103e5-677b-41c8-a9f5-4659d21fd874 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:43.885963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dcc103e5-677b-41c8-a9f5-4659d21fd874 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:43.947284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dcc103e5-677b-41c8-a9f5-4659d21fd874 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:43.955750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dcc103e5-677b-41c8-a9f5-4659d21fd874 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.082579 Sep 14 20:04:43.956328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1277/2522] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:43 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:44.972407 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3d34a877-e27b-416a-9d9e-0d2290030b03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:44.973005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3d34a877-e27b-416a-9d9e-0d2290030b03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:44.978818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d34a877-e27b-416a-9d9e-0d2290030b03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:44.979240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d34a877-e27b-416a-9d9e-0d2290030b03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:44.979990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d34a877-e27b-416a-9d9e-0d2290030b03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:44.980419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3d34a877-e27b-416a-9d9e-0d2290030b03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:45.039575 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3d34a877-e27b-416a-9d9e-0d2290030b03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:45.047674 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3d34a877-e27b-416a-9d9e-0d2290030b03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078894 Sep 14 20:04:45.048236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1246/2523] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:44 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:46.063030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-51070d2d-e964-4005-a775-ff801e255219 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:46.063654 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-51070d2d-e964-4005-a775-ff801e255219 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:46.069362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51070d2d-e964-4005-a775-ff801e255219 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:46.069845 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51070d2d-e964-4005-a775-ff801e255219 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:46.070620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51070d2d-e964-4005-a775-ff801e255219 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:46.071057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-51070d2d-e964-4005-a775-ff801e255219 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:46.129468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-51070d2d-e964-4005-a775-ff801e255219 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:46.137146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-51070d2d-e964-4005-a775-ff801e255219 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.077696 Sep 14 20:04:46.137744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1278/2524] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:46 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:47.153754 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2efd2b24-e153-4db0-933a-9f309fb0b76a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:47.154509 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2efd2b24-e153-4db0-933a-9f309fb0b76a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:47.160391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2efd2b24-e153-4db0-933a-9f309fb0b76a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:47.160845 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2efd2b24-e153-4db0-933a-9f309fb0b76a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:47.161648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2efd2b24-e153-4db0-933a-9f309fb0b76a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:47.162088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2efd2b24-e153-4db0-933a-9f309fb0b76a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:47.220704 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2efd2b24-e153-4db0-933a-9f309fb0b76a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:47.228410 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2efd2b24-e153-4db0-933a-9f309fb0b76a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078514 Sep 14 20:04:47.228976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1247/2525] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:47 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:48.244367 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ea8fddaa-ab3d-434c-b606-4c29e0a211dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:48.244975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ea8fddaa-ab3d-434c-b606-4c29e0a211dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:48.251562 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea8fddaa-ab3d-434c-b606-4c29e0a211dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:48.252001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea8fddaa-ab3d-434c-b606-4c29e0a211dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:48.252760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea8fddaa-ab3d-434c-b606-4c29e0a211dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:48.253207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea8fddaa-ab3d-434c-b606-4c29e0a211dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:48.314739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ea8fddaa-ab3d-434c-b606-4c29e0a211dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:48.322709 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ea8fddaa-ab3d-434c-b606-4c29e0a211dc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081939 Sep 14 20:04:48.323272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1279/2526] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:48 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:49.339950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-346c5cd1-4dac-4ab9-aa3a-9b735c6c4d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:49.340541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-346c5cd1-4dac-4ab9-aa3a-9b735c6c4d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:49.346344 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-346c5cd1-4dac-4ab9-aa3a-9b735c6c4d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:49.349743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-346c5cd1-4dac-4ab9-aa3a-9b735c6c4d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:49.349743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-346c5cd1-4dac-4ab9-aa3a-9b735c6c4d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:49.349743 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-346c5cd1-4dac-4ab9-aa3a-9b735c6c4d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:49.408342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-346c5cd1-4dac-4ab9-aa3a-9b735c6c4d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:49.416164 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-346c5cd1-4dac-4ab9-aa3a-9b735c6c4d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079832 Sep 14 20:04:49.416737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1248/2527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:49 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:04:50.433427 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-acca86f5-3371-42f8-b197-6191a8e13c08 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:50.434140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-acca86f5-3371-42f8-b197-6191a8e13c08 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:50.440240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-acca86f5-3371-42f8-b197-6191a8e13c08 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:50.440688 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-acca86f5-3371-42f8-b197-6191a8e13c08 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:50.441461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-acca86f5-3371-42f8-b197-6191a8e13c08 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:50.441929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-acca86f5-3371-42f8-b197-6191a8e13c08 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:50.503461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-acca86f5-3371-42f8-b197-6191a8e13c08 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:50.511452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-acca86f5-3371-42f8-b197-6191a8e13c08 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081788 Sep 14 20:04:50.512025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1280/2528] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:50 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:51.529005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-560c2bba-6fe6-4af9-8662-698136a2943c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:51.530284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-560c2bba-6fe6-4af9-8662-698136a2943c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:51.536585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-560c2bba-6fe6-4af9-8662-698136a2943c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:51.537038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-560c2bba-6fe6-4af9-8662-698136a2943c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:51.537834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-560c2bba-6fe6-4af9-8662-698136a2943c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:51.538277 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-560c2bba-6fe6-4af9-8662-698136a2943c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:51.600092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-560c2bba-6fe6-4af9-8662-698136a2943c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:51.613440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-560c2bba-6fe6-4af9-8662-698136a2943c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.088927 Sep 14 20:04:51.614061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1249/2529] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:51 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:52.630203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-283871a7-4a0b-4de4-a967-6ffe361247d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:52.630740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-283871a7-4a0b-4de4-a967-6ffe361247d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:52.636499 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-283871a7-4a0b-4de4-a967-6ffe361247d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:52.636944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-283871a7-4a0b-4de4-a967-6ffe361247d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:52.637733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-283871a7-4a0b-4de4-a967-6ffe361247d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:52.638171 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-283871a7-4a0b-4de4-a967-6ffe361247d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:52.696742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-283871a7-4a0b-4de4-a967-6ffe361247d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:52.704578 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-283871a7-4a0b-4de4-a967-6ffe361247d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078081 Sep 14 20:04:52.705149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1281/2530] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:52 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:53.721088 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c6aa664d-9a24-492f-b8a6-1d10b4438097 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:53.721640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c6aa664d-9a24-492f-b8a6-1d10b4438097 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:53.727563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6aa664d-9a24-492f-b8a6-1d10b4438097 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:53.728010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6aa664d-9a24-492f-b8a6-1d10b4438097 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:53.728776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6aa664d-9a24-492f-b8a6-1d10b4438097 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:53.729207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6aa664d-9a24-492f-b8a6-1d10b4438097 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:53.790663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c6aa664d-9a24-492f-b8a6-1d10b4438097 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:53.798683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c6aa664d-9a24-492f-b8a6-1d10b4438097 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081336 Sep 14 20:04:53.799375 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1250/2531] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:53 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:54.815797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d33f7438-6a65-4100-815a-d7dc774d7e49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:54.816343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d33f7438-6a65-4100-815a-d7dc774d7e49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:54.822620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d33f7438-6a65-4100-815a-d7dc774d7e49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:54.823094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d33f7438-6a65-4100-815a-d7dc774d7e49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:54.823785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d33f7438-6a65-4100-815a-d7dc774d7e49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:54.824218 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d33f7438-6a65-4100-815a-d7dc774d7e49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:54.884129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d33f7438-6a65-4100-815a-d7dc774d7e49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:54.892570 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d33f7438-6a65-4100-815a-d7dc774d7e49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080447 Sep 14 20:04:54.893132 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1282/2532] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:54 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:55.908511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d584ddb3-a7f7-4dee-b979-ec17e5de7333 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:55.909121 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d584ddb3-a7f7-4dee-b979-ec17e5de7333 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:55.915406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d584ddb3-a7f7-4dee-b979-ec17e5de7333 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:55.915813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d584ddb3-a7f7-4dee-b979-ec17e5de7333 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:55.916549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d584ddb3-a7f7-4dee-b979-ec17e5de7333 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:55.916985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d584ddb3-a7f7-4dee-b979-ec17e5de7333 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:55.976987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d584ddb3-a7f7-4dee-b979-ec17e5de7333 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:55.985400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d584ddb3-a7f7-4dee-b979-ec17e5de7333 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081037 Sep 14 20:04:55.985997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1251/2533] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:55 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:57.002770 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ea021d17-3a5c-4786-a8a2-b6f46cec8279 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:57.003411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ea021d17-3a5c-4786-a8a2-b6f46cec8279 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:57.009412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea021d17-3a5c-4786-a8a2-b6f46cec8279 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:57.009930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea021d17-3a5c-4786-a8a2-b6f46cec8279 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:57.010706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea021d17-3a5c-4786-a8a2-b6f46cec8279 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:57.011145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea021d17-3a5c-4786-a8a2-b6f46cec8279 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:57.074288 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ea021d17-3a5c-4786-a8a2-b6f46cec8279 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:57.082112 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ea021d17-3a5c-4786-a8a2-b6f46cec8279 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.083642 Sep 14 20:04:57.082678 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1283/2534] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:56 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:04:58.099549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b7103018-a592-4db5-a3c6-c9b2bbcbc349 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:58.100154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b7103018-a592-4db5-a3c6-c9b2bbcbc349 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:58.106573 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7103018-a592-4db5-a3c6-c9b2bbcbc349 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:58.107014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7103018-a592-4db5-a3c6-c9b2bbcbc349 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:58.107830 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7103018-a592-4db5-a3c6-c9b2bbcbc349 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:58.108259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7103018-a592-4db5-a3c6-c9b2bbcbc349 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:58.178063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b7103018-a592-4db5-a3c6-c9b2bbcbc349 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:58.186365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b7103018-a592-4db5-a3c6-c9b2bbcbc349 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.090083 Sep 14 20:04:58.186933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1252/2535] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:58 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:59.202710 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c6d8e076-0666-4b80-9604-538c7f0d914c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:59.203276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c6d8e076-0666-4b80-9604-538c7f0d914c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:04:59.209363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6d8e076-0666-4b80-9604-538c7f0d914c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:59.209849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6d8e076-0666-4b80-9604-538c7f0d914c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:59.210621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6d8e076-0666-4b80-9604-538c7f0d914c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:04:59.211060 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c6d8e076-0666-4b80-9604-538c7f0d914c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:04:59.270585 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c6d8e076-0666-4b80-9604-538c7f0d914c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:59.278434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c6d8e076-0666-4b80-9604-538c7f0d914c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079429 Sep 14 20:04:59.278998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1284/2536] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:04:59 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:00.295552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-de8db498-4a5f-4430-b4b3-5b726e378a29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:00.298933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-de8db498-4a5f-4430-b4b3-5b726e378a29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:00.306058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de8db498-4a5f-4430-b4b3-5b726e378a29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:00.306506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de8db498-4a5f-4430-b4b3-5b726e378a29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:00.307288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de8db498-4a5f-4430-b4b3-5b726e378a29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:00.307712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-de8db498-4a5f-4430-b4b3-5b726e378a29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:00.368054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-de8db498-4a5f-4430-b4b3-5b726e378a29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:00.376923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-de8db498-4a5f-4430-b4b3-5b726e378a29 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.085064 Sep 14 20:05:00.377510 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1253/2537] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:00 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:01.392981 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-da64646e-01a1-4c05-a5ba-778f327a2595 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:01.393635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-da64646e-01a1-4c05-a5ba-778f327a2595 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:01.399481 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da64646e-01a1-4c05-a5ba-778f327a2595 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:01.399925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da64646e-01a1-4c05-a5ba-778f327a2595 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:01.400688 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da64646e-01a1-4c05-a5ba-778f327a2595 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:01.401136 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da64646e-01a1-4c05-a5ba-778f327a2595 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:01.460898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-da64646e-01a1-4c05-a5ba-778f327a2595 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:01.469305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-da64646e-01a1-4c05-a5ba-778f327a2595 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080608 Sep 14 20:05:01.469898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1285/2538] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:01 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:02.486401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-45d98b7e-547d-40b7-af80-11620ac4aa26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:02.486958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-45d98b7e-547d-40b7-af80-11620ac4aa26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:02.492695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-45d98b7e-547d-40b7-af80-11620ac4aa26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:02.493142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-45d98b7e-547d-40b7-af80-11620ac4aa26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:02.493939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-45d98b7e-547d-40b7-af80-11620ac4aa26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:02.494374 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-45d98b7e-547d-40b7-af80-11620ac4aa26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:02.554948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-45d98b7e-547d-40b7-af80-11620ac4aa26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:02.562267 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-45d98b7e-547d-40b7-af80-11620ac4aa26 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080147 Sep 14 20:05:02.562831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1254/2539] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:02 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:05:03.578101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-eb58808d-cd33-4799-b29e-baf85017a23c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:03.578707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-eb58808d-cd33-4799-b29e-baf85017a23c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:03.584447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb58808d-cd33-4799-b29e-baf85017a23c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:03.584884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb58808d-cd33-4799-b29e-baf85017a23c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:03.585666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb58808d-cd33-4799-b29e-baf85017a23c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:03.586098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eb58808d-cd33-4799-b29e-baf85017a23c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:03.651623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-eb58808d-cd33-4799-b29e-baf85017a23c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:03.659519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-eb58808d-cd33-4799-b29e-baf85017a23c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.085649 Sep 14 20:05:03.660123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1286/2540] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:03 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:04.676184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-446e387f-d642-4766-9cf7-7231a9b01f8c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:04.676825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-446e387f-d642-4766-9cf7-7231a9b01f8c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:04.682906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-446e387f-d642-4766-9cf7-7231a9b01f8c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:04.683340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-446e387f-d642-4766-9cf7-7231a9b01f8c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:04.684086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-446e387f-d642-4766-9cf7-7231a9b01f8c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:04.684511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-446e387f-d642-4766-9cf7-7231a9b01f8c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:04.745341 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-446e387f-d642-4766-9cf7-7231a9b01f8c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:04.753759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-446e387f-d642-4766-9cf7-7231a9b01f8c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081475 Sep 14 20:05:04.754336 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1255/2541] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:04 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:05.769358 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0afc37af-ba18-45f1-a55a-2efd15c6f592 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:05.770020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0afc37af-ba18-45f1-a55a-2efd15c6f592 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:05.776024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0afc37af-ba18-45f1-a55a-2efd15c6f592 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:05.776682 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0afc37af-ba18-45f1-a55a-2efd15c6f592 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:05.777247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0afc37af-ba18-45f1-a55a-2efd15c6f592 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:05.777713 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0afc37af-ba18-45f1-a55a-2efd15c6f592 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:05.837475 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0afc37af-ba18-45f1-a55a-2efd15c6f592 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:05.845815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0afc37af-ba18-45f1-a55a-2efd15c6f592 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080066 Sep 14 20:05:05.846356 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1287/2542] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:05 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:06.862231 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-36cc9858-ddf4-41a6-b1b0-425591c3f641 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:06.862846 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-36cc9858-ddf4-41a6-b1b0-425591c3f641 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:06.868905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36cc9858-ddf4-41a6-b1b0-425591c3f641 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:06.869350 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36cc9858-ddf4-41a6-b1b0-425591c3f641 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:06.870158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36cc9858-ddf4-41a6-b1b0-425591c3f641 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:06.870596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-36cc9858-ddf4-41a6-b1b0-425591c3f641 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:06.930317 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-36cc9858-ddf4-41a6-b1b0-425591c3f641 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:06.939353 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-36cc9858-ddf4-41a6-b1b0-425591c3f641 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080683 Sep 14 20:05:06.939932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1256/2543] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:06 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:05:07.956454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-18cbdf2b-4eb5-4158-9b6e-7a0abe4cd285 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:07.957074 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-18cbdf2b-4eb5-4158-9b6e-7a0abe4cd285 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:07.962976 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18cbdf2b-4eb5-4158-9b6e-7a0abe4cd285 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:07.963424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18cbdf2b-4eb5-4158-9b6e-7a0abe4cd285 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:07.964192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18cbdf2b-4eb5-4158-9b6e-7a0abe4cd285 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:07.964634 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-18cbdf2b-4eb5-4158-9b6e-7a0abe4cd285 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:08.028252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-18cbdf2b-4eb5-4158-9b6e-7a0abe4cd285 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:08.035984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-18cbdf2b-4eb5-4158-9b6e-7a0abe4cd285 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.083302 Sep 14 20:05:08.036552 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1288/2544] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:07 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:09.052400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a7c5efe0-b791-45fd-89e2-f95528c78d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:09.053009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a7c5efe0-b791-45fd-89e2-f95528c78d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:09.059170 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7c5efe0-b791-45fd-89e2-f95528c78d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:09.059622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7c5efe0-b791-45fd-89e2-f95528c78d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:09.060388 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7c5efe0-b791-45fd-89e2-f95528c78d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:09.060833 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a7c5efe0-b791-45fd-89e2-f95528c78d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:09.119249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a7c5efe0-b791-45fd-89e2-f95528c78d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:09.126920 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a7c5efe0-b791-45fd-89e2-f95528c78d4e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078450 Sep 14 20:05:09.127484 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1257/2545] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:09 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:10.143233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-41eded9d-b77d-41db-b1da-f618f665d6d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:10.143878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-41eded9d-b77d-41db-b1da-f618f665d6d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:10.149761 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41eded9d-b77d-41db-b1da-f618f665d6d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:10.150208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41eded9d-b77d-41db-b1da-f618f665d6d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:10.150971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41eded9d-b77d-41db-b1da-f618f665d6d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:10.151401 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-41eded9d-b77d-41db-b1da-f618f665d6d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:10.213757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-41eded9d-b77d-41db-b1da-f618f665d6d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:10.221938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-41eded9d-b77d-41db-b1da-f618f665d6d4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.082386 Sep 14 20:05:10.222494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1289/2546] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:10 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:11.238812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ba08c5ca-c4d7-4019-a486-5b7fa4b9cc80 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:11.239425 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ba08c5ca-c4d7-4019-a486-5b7fa4b9cc80 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:11.245243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba08c5ca-c4d7-4019-a486-5b7fa4b9cc80 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:11.245728 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba08c5ca-c4d7-4019-a486-5b7fa4b9cc80 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:11.246491 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba08c5ca-c4d7-4019-a486-5b7fa4b9cc80 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:11.246930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba08c5ca-c4d7-4019-a486-5b7fa4b9cc80 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:11.306491 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ba08c5ca-c4d7-4019-a486-5b7fa4b9cc80 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:11.314863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ba08c5ca-c4d7-4019-a486-5b7fa4b9cc80 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079941 Sep 14 20:05:11.315463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1258/2547] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:11 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:12.331863 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a879ec5d-8dcc-453b-94c2-ea53bdf0de0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:12.332476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a879ec5d-8dcc-453b-94c2-ea53bdf0de0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:12.338360 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a879ec5d-8dcc-453b-94c2-ea53bdf0de0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:12.338810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a879ec5d-8dcc-453b-94c2-ea53bdf0de0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:12.339572 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a879ec5d-8dcc-453b-94c2-ea53bdf0de0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:12.340010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a879ec5d-8dcc-453b-94c2-ea53bdf0de0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:12.399113 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a879ec5d-8dcc-453b-94c2-ea53bdf0de0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:12.406941 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a879ec5d-8dcc-453b-94c2-ea53bdf0de0d tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078758 Sep 14 20:05:12.407492 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1290/2548] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:12 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:13.423063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ed142142-c51d-4bff-84d0-01a237230caa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:13.423736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ed142142-c51d-4bff-84d0-01a237230caa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:13.429553 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed142142-c51d-4bff-84d0-01a237230caa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:13.432560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed142142-c51d-4bff-84d0-01a237230caa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:13.432560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed142142-c51d-4bff-84d0-01a237230caa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:13.432560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ed142142-c51d-4bff-84d0-01a237230caa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:13.490941 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ed142142-c51d-4bff-84d0-01a237230caa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:13.498659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ed142142-c51d-4bff-84d0-01a237230caa tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079283 Sep 14 20:05:13.499216 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1259/2549] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:13 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:14.514697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a6146f13-ef5e-4ef3-8b58-6f4d586b2e88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:14.515315 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a6146f13-ef5e-4ef3-8b58-6f4d586b2e88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:14.521079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6146f13-ef5e-4ef3-8b58-6f4d586b2e88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:14.521559 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6146f13-ef5e-4ef3-8b58-6f4d586b2e88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:14.522329 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6146f13-ef5e-4ef3-8b58-6f4d586b2e88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:14.522768 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6146f13-ef5e-4ef3-8b58-6f4d586b2e88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:14.581061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a6146f13-ef5e-4ef3-8b58-6f4d586b2e88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:14.588727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a6146f13-ef5e-4ef3-8b58-6f4d586b2e88 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.077701 Sep 14 20:05:14.589284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1291/2550] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:14 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:15.605484 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ce74d448-a1b6-4bdc-a825-3d6097092ee9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:15.606136 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ce74d448-a1b6-4bdc-a825-3d6097092ee9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:15.611896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce74d448-a1b6-4bdc-a825-3d6097092ee9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:15.612337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce74d448-a1b6-4bdc-a825-3d6097092ee9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:15.613091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce74d448-a1b6-4bdc-a825-3d6097092ee9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:15.613545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce74d448-a1b6-4bdc-a825-3d6097092ee9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:15.678393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ce74d448-a1b6-4bdc-a825-3d6097092ee9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:15.686878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ce74d448-a1b6-4bdc-a825-3d6097092ee9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.084914 Sep 14 20:05:15.687250 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1260/2551] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:15 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:16.704351 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-143e5570-6165-432e-87ab-a31a4d7ad87f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:16.704957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-143e5570-6165-432e-87ab-a31a4d7ad87f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:16.710824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-143e5570-6165-432e-87ab-a31a4d7ad87f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:16.711266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-143e5570-6165-432e-87ab-a31a4d7ad87f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:16.712020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-143e5570-6165-432e-87ab-a31a4d7ad87f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:16.712451 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-143e5570-6165-432e-87ab-a31a4d7ad87f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:16.772873 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-143e5570-6165-432e-87ab-a31a4d7ad87f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:16.780762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-143e5570-6165-432e-87ab-a31a4d7ad87f tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080519 Sep 14 20:05:16.781411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1292/2552] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:16 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:17.797299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e48d8af6-efde-417c-89b1-024f16d505eb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:17.797934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e48d8af6-efde-417c-89b1-024f16d505eb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:17.804119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e48d8af6-efde-417c-89b1-024f16d505eb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:17.804748 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e48d8af6-efde-417c-89b1-024f16d505eb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:17.805535 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e48d8af6-efde-417c-89b1-024f16d505eb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:17.805976 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e48d8af6-efde-417c-89b1-024f16d505eb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:17.867674 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e48d8af6-efde-417c-89b1-024f16d505eb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:17.876168 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e48d8af6-efde-417c-89b1-024f16d505eb tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.082878 Sep 14 20:05:17.876741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1261/2553] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:17 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:18.892446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1c590314-b289-4be6-ae58-bb9622ad3f0e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:18.893061 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1c590314-b289-4be6-ae58-bb9622ad3f0e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:18.898808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c590314-b289-4be6-ae58-bb9622ad3f0e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:18.899257 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c590314-b289-4be6-ae58-bb9622ad3f0e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:18.900024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c590314-b289-4be6-ae58-bb9622ad3f0e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:18.900466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1c590314-b289-4be6-ae58-bb9622ad3f0e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:18.959152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1c590314-b289-4be6-ae58-bb9622ad3f0e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:18.970170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1c590314-b289-4be6-ae58-bb9622ad3f0e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081551 Sep 14 20:05:18.970729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1293/2554] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:18 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:19.987119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-50595f39-0045-4e82-b2c4-0ac38fb26ad8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:19.987703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-50595f39-0045-4e82-b2c4-0ac38fb26ad8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:19.993489 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50595f39-0045-4e82-b2c4-0ac38fb26ad8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:19.993953 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50595f39-0045-4e82-b2c4-0ac38fb26ad8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:19.994796 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50595f39-0045-4e82-b2c4-0ac38fb26ad8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:19.995129 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-50595f39-0045-4e82-b2c4-0ac38fb26ad8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:20.053546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-50595f39-0045-4e82-b2c4-0ac38fb26ad8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:20.061592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-50595f39-0045-4e82-b2c4-0ac38fb26ad8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078172 Sep 14 20:05:20.062163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1262/2555] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:19 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:21.077377 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2cab61b7-188b-453f-b603-527b34e0a46e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:21.077942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2cab61b7-188b-453f-b603-527b34e0a46e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:21.083735 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2cab61b7-188b-453f-b603-527b34e0a46e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:21.084188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2cab61b7-188b-453f-b603-527b34e0a46e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:21.084956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2cab61b7-188b-453f-b603-527b34e0a46e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:21.085394 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2cab61b7-188b-453f-b603-527b34e0a46e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:21.145328 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2cab61b7-188b-453f-b603-527b34e0a46e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:21.153321 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2cab61b7-188b-453f-b603-527b34e0a46e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079722 Sep 14 20:05:21.153903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1294/2556] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:21 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:22.169424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b55b56f8-7ebb-4d6c-96ab-2a8140b81598 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:22.171423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b55b56f8-7ebb-4d6c-96ab-2a8140b81598 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:22.176262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b55b56f8-7ebb-4d6c-96ab-2a8140b81598 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:22.176706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b55b56f8-7ebb-4d6c-96ab-2a8140b81598 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:22.177464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b55b56f8-7ebb-4d6c-96ab-2a8140b81598 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:22.177924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b55b56f8-7ebb-4d6c-96ab-2a8140b81598 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:22.245850 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b55b56f8-7ebb-4d6c-96ab-2a8140b81598 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:22.252523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b55b56f8-7ebb-4d6c-96ab-2a8140b81598 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.086703 Sep 14 20:05:22.253114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1263/2557] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:22 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:23.269272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-319c1b75-ff53-4d7b-858e-235ca677b43a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:23.269898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-319c1b75-ff53-4d7b-858e-235ca677b43a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:23.275893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-319c1b75-ff53-4d7b-858e-235ca677b43a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:23.276382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-319c1b75-ff53-4d7b-858e-235ca677b43a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:23.277145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-319c1b75-ff53-4d7b-858e-235ca677b43a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:23.277728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-319c1b75-ff53-4d7b-858e-235ca677b43a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:23.339629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-319c1b75-ff53-4d7b-858e-235ca677b43a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:23.347888 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-319c1b75-ff53-4d7b-858e-235ca677b43a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.082249 Sep 14 20:05:23.348438 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1295/2558] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:23 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:24.363679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-96b0d5c3-da9b-45e4-856b-1c8df42ab06a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:24.364293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-96b0d5c3-da9b-45e4-856b-1c8df42ab06a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:24.370314 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-96b0d5c3-da9b-45e4-856b-1c8df42ab06a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:24.370665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-96b0d5c3-da9b-45e4-856b-1c8df42ab06a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:24.371432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-96b0d5c3-da9b-45e4-856b-1c8df42ab06a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:24.371876 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-96b0d5c3-da9b-45e4-856b-1c8df42ab06a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:24.431427 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-96b0d5c3-da9b-45e4-856b-1c8df42ab06a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:24.439561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-96b0d5c3-da9b-45e4-856b-1c8df42ab06a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079471 Sep 14 20:05:24.440145 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1264/2559] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:24 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:25.456003 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5436d16d-6e67-423f-bf67-13a8278de5b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:25.457050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5436d16d-6e67-423f-bf67-13a8278de5b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:25.462616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5436d16d-6e67-423f-bf67-13a8278de5b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:25.463067 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5436d16d-6e67-423f-bf67-13a8278de5b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:25.463838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5436d16d-6e67-423f-bf67-13a8278de5b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:25.464274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5436d16d-6e67-423f-bf67-13a8278de5b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:25.522636 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5436d16d-6e67-423f-bf67-13a8278de5b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:25.530253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5436d16d-6e67-423f-bf67-13a8278de5b8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078141 Sep 14 20:05:25.530814 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1296/2560] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:25 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:26.546891 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a4214b24-1ef3-4245-a3db-2b4691caa5a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:26.547496 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a4214b24-1ef3-4245-a3db-2b4691caa5a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:26.553666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4214b24-1ef3-4245-a3db-2b4691caa5a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:26.554107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4214b24-1ef3-4245-a3db-2b4691caa5a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:26.554878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4214b24-1ef3-4245-a3db-2b4691caa5a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:26.555301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a4214b24-1ef3-4245-a3db-2b4691caa5a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:26.613909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a4214b24-1ef3-4245-a3db-2b4691caa5a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:26.621581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a4214b24-1ef3-4245-a3db-2b4691caa5a1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078473 Sep 14 20:05:26.622798 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1265/2561] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:26 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:27.638680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9b2c1ef3-7cba-43fe-b73f-6fd6e064ab7c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:27.639305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9b2c1ef3-7cba-43fe-b73f-6fd6e064ab7c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:27.645214 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b2c1ef3-7cba-43fe-b73f-6fd6e064ab7c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:27.645702 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b2c1ef3-7cba-43fe-b73f-6fd6e064ab7c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:27.646487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b2c1ef3-7cba-43fe-b73f-6fd6e064ab7c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:27.646930 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9b2c1ef3-7cba-43fe-b73f-6fd6e064ab7c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:27.706447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9b2c1ef3-7cba-43fe-b73f-6fd6e064ab7c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:27.714151 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9b2c1ef3-7cba-43fe-b73f-6fd6e064ab7c tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079612 Sep 14 20:05:27.714715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1297/2562] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:27 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:28.731719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9de923cd-a7a6-49f2-b233-c4f412b38518 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:28.732266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9de923cd-a7a6-49f2-b233-c4f412b38518 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:28.738061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9de923cd-a7a6-49f2-b233-c4f412b38518 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:28.738497 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9de923cd-a7a6-49f2-b233-c4f412b38518 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:28.739248 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9de923cd-a7a6-49f2-b233-c4f412b38518 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:28.739672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9de923cd-a7a6-49f2-b233-c4f412b38518 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:28.798980 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9de923cd-a7a6-49f2-b233-c4f412b38518 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:28.807176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9de923cd-a7a6-49f2-b233-c4f412b38518 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079877 Sep 14 20:05:28.807735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1266/2563] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:28 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:29.826267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7acd9879-cf71-4de5-af11-23af8696bd87 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:29.826267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7acd9879-cf71-4de5-af11-23af8696bd87 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:29.829686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7acd9879-cf71-4de5-af11-23af8696bd87 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:29.830142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7acd9879-cf71-4de5-af11-23af8696bd87 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:29.830914 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7acd9879-cf71-4de5-af11-23af8696bd87 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:29.831378 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7acd9879-cf71-4de5-af11-23af8696bd87 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:29.891937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7acd9879-cf71-4de5-af11-23af8696bd87 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:29.899707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7acd9879-cf71-4de5-af11-23af8696bd87 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080820 Sep 14 20:05:29.900265 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1298/2564] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:29 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:30.916265 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cf5d011e-fcf0-4b27-bcbc-3838a6cfada5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:30.917207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cf5d011e-fcf0-4b27-bcbc-3838a6cfada5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:30.923058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cf5d011e-fcf0-4b27-bcbc-3838a6cfada5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:30.923509 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cf5d011e-fcf0-4b27-bcbc-3838a6cfada5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:30.924273 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cf5d011e-fcf0-4b27-bcbc-3838a6cfada5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:30.924713 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cf5d011e-fcf0-4b27-bcbc-3838a6cfada5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:30.986357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cf5d011e-fcf0-4b27-bcbc-3838a6cfada5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:30.994069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cf5d011e-fcf0-4b27-bcbc-3838a6cfada5 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081500 Sep 14 20:05:30.994628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1267/2565] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:30 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:32.010888 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-aad6031d-0599-4ee8-a12c-e2482e3d8167 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:32.011548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-aad6031d-0599-4ee8-a12c-e2482e3d8167 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:32.017741 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aad6031d-0599-4ee8-a12c-e2482e3d8167 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:32.018241 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aad6031d-0599-4ee8-a12c-e2482e3d8167 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:32.019101 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aad6031d-0599-4ee8-a12c-e2482e3d8167 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:32.019547 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-aad6031d-0599-4ee8-a12c-e2482e3d8167 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:32.084715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-aad6031d-0599-4ee8-a12c-e2482e3d8167 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:32.093057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-aad6031d-0599-4ee8-a12c-e2482e3d8167 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.085792 Sep 14 20:05:32.093645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1299/2566] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:32 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:33.110601 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4a4bb430-2a63-4f97-b712-0f2fab4ed684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:33.111628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4a4bb430-2a63-4f97-b712-0f2fab4ed684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:33.118896 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a4bb430-2a63-4f97-b712-0f2fab4ed684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:33.119335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a4bb430-2a63-4f97-b712-0f2fab4ed684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:33.120213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a4bb430-2a63-4f97-b712-0f2fab4ed684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:33.120520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4a4bb430-2a63-4f97-b712-0f2fab4ed684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:33.178861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4a4bb430-2a63-4f97-b712-0f2fab4ed684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:33.187017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4a4bb430-2a63-4f97-b712-0f2fab4ed684 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080961 Sep 14 20:05:33.187570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1268/2567] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:33 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:34.203912 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2da3e95c-7231-4c40-a612-da5dca3cdc89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:34.204531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2da3e95c-7231-4c40-a612-da5dca3cdc89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:34.210425 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2da3e95c-7231-4c40-a612-da5dca3cdc89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:34.210878 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2da3e95c-7231-4c40-a612-da5dca3cdc89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:34.211646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2da3e95c-7231-4c40-a612-da5dca3cdc89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:34.212087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2da3e95c-7231-4c40-a612-da5dca3cdc89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:34.270735 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2da3e95c-7231-4c40-a612-da5dca3cdc89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:34.282226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2da3e95c-7231-4c40-a612-da5dca3cdc89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.082601 Sep 14 20:05:34.282797 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1300/2568] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:34 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:35.299256 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-625cb1a5-be2f-4c13-baba-649a0af14045 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:35.299868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-625cb1a5-be2f-4c13-baba-649a0af14045 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:35.306083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-625cb1a5-be2f-4c13-baba-649a0af14045 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:35.306523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-625cb1a5-be2f-4c13-baba-649a0af14045 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:35.307291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-625cb1a5-be2f-4c13-baba-649a0af14045 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:35.307712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-625cb1a5-be2f-4c13-baba-649a0af14045 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:35.366719 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-625cb1a5-be2f-4c13-baba-649a0af14045 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:35.374348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-625cb1a5-be2f-4c13-baba-649a0af14045 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078769 Sep 14 20:05:35.374898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1269/2569] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:35 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:36.390590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2d2f37ff-a11f-4c4a-bef0-f219035dd298 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:36.391203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2d2f37ff-a11f-4c4a-bef0-f219035dd298 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:36.397048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d2f37ff-a11f-4c4a-bef0-f219035dd298 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:36.397553 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d2f37ff-a11f-4c4a-bef0-f219035dd298 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:36.398283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d2f37ff-a11f-4c4a-bef0-f219035dd298 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:36.398721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2d2f37ff-a11f-4c4a-bef0-f219035dd298 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:36.459344 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2d2f37ff-a11f-4c4a-bef0-f219035dd298 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:36.467542 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2d2f37ff-a11f-4c4a-bef0-f219035dd298 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080760 Sep 14 20:05:36.468089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1301/2570] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:36 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:37.484238 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f7fa7531-fbc2-472e-be61-5d5f54ff4dd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:37.484870 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f7fa7531-fbc2-472e-be61-5d5f54ff4dd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:37.490720 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7fa7531-fbc2-472e-be61-5d5f54ff4dd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:37.491169 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7fa7531-fbc2-472e-be61-5d5f54ff4dd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:37.491961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7fa7531-fbc2-472e-be61-5d5f54ff4dd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:37.492397 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f7fa7531-fbc2-472e-be61-5d5f54ff4dd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:37.569401 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f7fa7531-fbc2-472e-be61-5d5f54ff4dd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:37.577219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f7fa7531-fbc2-472e-be61-5d5f54ff4dd1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.097151 Sep 14 20:05:37.577825 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1270/2571] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:37 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:38.593548 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c1554879-69e7-471c-bd20-c14c00b4bdc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:38.594163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c1554879-69e7-471c-bd20-c14c00b4bdc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:38.600004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1554879-69e7-471c-bd20-c14c00b4bdc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:38.600454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1554879-69e7-471c-bd20-c14c00b4bdc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:38.601219 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1554879-69e7-471c-bd20-c14c00b4bdc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:38.601690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1554879-69e7-471c-bd20-c14c00b4bdc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:38.660781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c1554879-69e7-471c-bd20-c14c00b4bdc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:38.670208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c1554879-69e7-471c-bd20-c14c00b4bdc0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080421 Sep 14 20:05:38.670785 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1302/2572] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:38 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:39.687636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-87758dd7-b463-45c3-b63d-2e9899e9b649 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:39.688325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-87758dd7-b463-45c3-b63d-2e9899e9b649 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:39.694102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-87758dd7-b463-45c3-b63d-2e9899e9b649 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:39.694544 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-87758dd7-b463-45c3-b63d-2e9899e9b649 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:39.695304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-87758dd7-b463-45c3-b63d-2e9899e9b649 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:39.695737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-87758dd7-b463-45c3-b63d-2e9899e9b649 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:39.754665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-87758dd7-b463-45c3-b63d-2e9899e9b649 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:39.762416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-87758dd7-b463-45c3-b63d-2e9899e9b649 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079228 Sep 14 20:05:39.762968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1271/2573] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:39 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:40.778529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0f8eada8-82a1-4d37-8c86-8467138a8020 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:40.779143 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0f8eada8-82a1-4d37-8c86-8467138a8020 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:40.785206 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f8eada8-82a1-4d37-8c86-8467138a8020 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:40.785691 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f8eada8-82a1-4d37-8c86-8467138a8020 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:40.786462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f8eada8-82a1-4d37-8c86-8467138a8020 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:40.786898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f8eada8-82a1-4d37-8c86-8467138a8020 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:40.846954 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0f8eada8-82a1-4d37-8c86-8467138a8020 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:40.854772 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0f8eada8-82a1-4d37-8c86-8467138a8020 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079922 Sep 14 20:05:40.855334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1303/2574] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:40 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:41.871369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6ede178b-90d4-4ac8-9bde-3fae521a2141 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:41.871978 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6ede178b-90d4-4ac8-9bde-3fae521a2141 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:41.877993 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ede178b-90d4-4ac8-9bde-3fae521a2141 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:41.878438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ede178b-90d4-4ac8-9bde-3fae521a2141 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:41.879203 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ede178b-90d4-4ac8-9bde-3fae521a2141 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:41.879634 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6ede178b-90d4-4ac8-9bde-3fae521a2141 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:41.938996 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6ede178b-90d4-4ac8-9bde-3fae521a2141 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:41.947125 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6ede178b-90d4-4ac8-9bde-3fae521a2141 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079587 Sep 14 20:05:41.947754 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1272/2575] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:41 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:42.963707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3c5a3435-dd50-4f31-b65e-cbc599e8de71 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:42.964319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3c5a3435-dd50-4f31-b65e-cbc599e8de71 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:42.970144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c5a3435-dd50-4f31-b65e-cbc599e8de71 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:42.970597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c5a3435-dd50-4f31-b65e-cbc599e8de71 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:42.971364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c5a3435-dd50-4f31-b65e-cbc599e8de71 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:42.971808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c5a3435-dd50-4f31-b65e-cbc599e8de71 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:43.031591 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3c5a3435-dd50-4f31-b65e-cbc599e8de71 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:43.039375 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3c5a3435-dd50-4f31-b65e-cbc599e8de71 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079291 Sep 14 20:05:43.039929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1304/2576] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:42 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:05:44.056160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b3998cbd-d062-42b2-89de-04d231ac4418 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:44.057063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b3998cbd-d062-42b2-89de-04d231ac4418 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:44.063312 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b3998cbd-d062-42b2-89de-04d231ac4418 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:44.063759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b3998cbd-d062-42b2-89de-04d231ac4418 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:44.064522 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b3998cbd-d062-42b2-89de-04d231ac4418 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:44.064959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b3998cbd-d062-42b2-89de-04d231ac4418 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:44.126690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b3998cbd-d062-42b2-89de-04d231ac4418 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:44.134610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b3998cbd-d062-42b2-89de-04d231ac4418 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.082115 Sep 14 20:05:44.135172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1273/2577] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:44 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:45.151775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-97a14c95-67ad-43a6-a9f3-0637387d8946 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:45.153037 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-97a14c95-67ad-43a6-a9f3-0637387d8946 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:45.158922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-97a14c95-67ad-43a6-a9f3-0637387d8946 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:45.159374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-97a14c95-67ad-43a6-a9f3-0637387d8946 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:45.160137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-97a14c95-67ad-43a6-a9f3-0637387d8946 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:45.160575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-97a14c95-67ad-43a6-a9f3-0637387d8946 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:45.219449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-97a14c95-67ad-43a6-a9f3-0637387d8946 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:45.227224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-97a14c95-67ad-43a6-a9f3-0637387d8946 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079061 Sep 14 20:05:45.227789 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1305/2578] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:45 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:46.243089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-16caae91-a051-4640-8061-7ebd080435a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:46.243692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-16caae91-a051-4640-8061-7ebd080435a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:46.249682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16caae91-a051-4640-8061-7ebd080435a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:46.250118 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16caae91-a051-4640-8061-7ebd080435a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:46.250868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16caae91-a051-4640-8061-7ebd080435a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:46.251293 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-16caae91-a051-4640-8061-7ebd080435a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:46.311278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-16caae91-a051-4640-8061-7ebd080435a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:46.319022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-16caae91-a051-4640-8061-7ebd080435a7 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079854 Sep 14 20:05:46.319580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1274/2579] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:46 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:47.334975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-188950cd-98a4-4ebc-8b52-50ac8020ca49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:47.335592 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-188950cd-98a4-4ebc-8b52-50ac8020ca49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:47.341526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-188950cd-98a4-4ebc-8b52-50ac8020ca49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:47.341925 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-188950cd-98a4-4ebc-8b52-50ac8020ca49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:47.342695 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-188950cd-98a4-4ebc-8b52-50ac8020ca49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:47.343136 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-188950cd-98a4-4ebc-8b52-50ac8020ca49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:47.403473 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-188950cd-98a4-4ebc-8b52-50ac8020ca49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:47.411504 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-188950cd-98a4-4ebc-8b52-50ac8020ca49 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080421 Sep 14 20:05:47.412238 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1306/2580] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:47 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:48.428657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9ad4f7f3-f1d5-4e0b-be9d-9c701b7d0064 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:48.429224 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9ad4f7f3-f1d5-4e0b-be9d-9c701b7d0064 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:48.435832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ad4f7f3-f1d5-4e0b-be9d-9c701b7d0064 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:48.436300 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ad4f7f3-f1d5-4e0b-be9d-9c701b7d0064 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:48.437075 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ad4f7f3-f1d5-4e0b-be9d-9c701b7d0064 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:48.437541 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ad4f7f3-f1d5-4e0b-be9d-9c701b7d0064 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:48.500787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9ad4f7f3-f1d5-4e0b-be9d-9c701b7d0064 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:48.508824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9ad4f7f3-f1d5-4e0b-be9d-9c701b7d0064 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.084126 Sep 14 20:05:48.510933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1275/2581] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:48 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:49.526024 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dfffe3b0-8368-4114-8565-bee3a80a29c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:49.526649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dfffe3b0-8368-4114-8565-bee3a80a29c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:49.533267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dfffe3b0-8368-4114-8565-bee3a80a29c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:49.533755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dfffe3b0-8368-4114-8565-bee3a80a29c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:49.534562 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dfffe3b0-8368-4114-8565-bee3a80a29c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:49.534999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dfffe3b0-8368-4114-8565-bee3a80a29c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:49.600683 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dfffe3b0-8368-4114-8565-bee3a80a29c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:49.608956 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dfffe3b0-8368-4114-8565-bee3a80a29c8 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.086563 Sep 14 20:05:49.609560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1307/2582] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:49 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:50.624987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a36f5a67-c2d3-4f55-b87d-981cc934cc50 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:50.625717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a36f5a67-c2d3-4f55-b87d-981cc934cc50 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:50.631652 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a36f5a67-c2d3-4f55-b87d-981cc934cc50 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:50.632084 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a36f5a67-c2d3-4f55-b87d-981cc934cc50 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:50.632842 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a36f5a67-c2d3-4f55-b87d-981cc934cc50 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:50.633270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a36f5a67-c2d3-4f55-b87d-981cc934cc50 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:50.694304 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a36f5a67-c2d3-4f55-b87d-981cc934cc50 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:50.702296 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a36f5a67-c2d3-4f55-b87d-981cc934cc50 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080905 Sep 14 20:05:50.702873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1276/2583] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:50 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:51.718855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-55834147-4296-4e40-9956-71e3c1de1f9a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:51.719478 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-55834147-4296-4e40-9956-71e3c1de1f9a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:51.725368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55834147-4296-4e40-9956-71e3c1de1f9a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:51.725848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55834147-4296-4e40-9956-71e3c1de1f9a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:51.726618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55834147-4296-4e40-9956-71e3c1de1f9a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:51.727048 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-55834147-4296-4e40-9956-71e3c1de1f9a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:51.786494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-55834147-4296-4e40-9956-71e3c1de1f9a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:51.795085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-55834147-4296-4e40-9956-71e3c1de1f9a tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079819 Sep 14 20:05:51.795672 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1308/2584] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:51 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:52.813051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8a0fd328-bb97-45dd-9e2a-4fdb59058b89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:52.813649 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8a0fd328-bb97-45dd-9e2a-4fdb59058b89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:52.820239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a0fd328-bb97-45dd-9e2a-4fdb59058b89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:52.820692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a0fd328-bb97-45dd-9e2a-4fdb59058b89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:52.821461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a0fd328-bb97-45dd-9e2a-4fdb59058b89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:52.821928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8a0fd328-bb97-45dd-9e2a-4fdb59058b89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:52.887391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8a0fd328-bb97-45dd-9e2a-4fdb59058b89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:52.893244 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8a0fd328-bb97-45dd-9e2a-4fdb59058b89 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.085395 Sep 14 20:05:52.893851 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1277/2585] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:52 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:53.909624 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-da38974d-980e-4cfb-a91d-2031871b24fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:53.910231 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-da38974d-980e-4cfb-a91d-2031871b24fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:53.916161 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da38974d-980e-4cfb-a91d-2031871b24fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:53.916603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da38974d-980e-4cfb-a91d-2031871b24fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:53.917882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da38974d-980e-4cfb-a91d-2031871b24fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:53.918322 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da38974d-980e-4cfb-a91d-2031871b24fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:53.976748 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-da38974d-980e-4cfb-a91d-2031871b24fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:53.985031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-da38974d-980e-4cfb-a91d-2031871b24fc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078989 Sep 14 20:05:53.985622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1309/2586] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:53 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:55.001954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8fc6e02c-339d-4f24-96a1-ce434f4fcb03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:55.002557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8fc6e02c-339d-4f24-96a1-ce434f4fcb03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:55.008480 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8fc6e02c-339d-4f24-96a1-ce434f4fcb03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:55.008923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8fc6e02c-339d-4f24-96a1-ce434f4fcb03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:55.009712 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8fc6e02c-339d-4f24-96a1-ce434f4fcb03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:55.010147 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8fc6e02c-339d-4f24-96a1-ce434f4fcb03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:55.068479 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8fc6e02c-339d-4f24-96a1-ce434f4fcb03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:55.076322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8fc6e02c-339d-4f24-96a1-ce434f4fcb03 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.077987 Sep 14 20:05:55.076985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1278/2587] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:54 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:56.092479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-eac04bad-69be-4923-8999-b52a001c6318 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:56.093020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-eac04bad-69be-4923-8999-b52a001c6318 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:56.098902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eac04bad-69be-4923-8999-b52a001c6318 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:56.099352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eac04bad-69be-4923-8999-b52a001c6318 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:56.100127 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eac04bad-69be-4923-8999-b52a001c6318 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:56.100565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-eac04bad-69be-4923-8999-b52a001c6318 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:56.159817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-eac04bad-69be-4923-8999-b52a001c6318 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:56.168194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-eac04bad-69be-4923-8999-b52a001c6318 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078830 Sep 14 20:05:56.168763 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1310/2588] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:56 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:57.184961 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4fb9a6e4-8965-496a-a680-869dc615dce3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:57.185619 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4fb9a6e4-8965-496a-a680-869dc615dce3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:57.191390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fb9a6e4-8965-496a-a680-869dc615dce3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:57.191831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fb9a6e4-8965-496a-a680-869dc615dce3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:57.192585 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fb9a6e4-8965-496a-a680-869dc615dce3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:57.193014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4fb9a6e4-8965-496a-a680-869dc615dce3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:57.254567 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4fb9a6e4-8965-496a-a680-869dc615dce3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:57.262953 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4fb9a6e4-8965-496a-a680-869dc615dce3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081031 Sep 14 20:05:57.263529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1279/2589] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:57 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:58.280026 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c41f0224-9fc2-433e-932c-53848115d936 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:58.280593 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c41f0224-9fc2-433e-932c-53848115d936 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:58.286608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c41f0224-9fc2-433e-932c-53848115d936 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:58.287060 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c41f0224-9fc2-433e-932c-53848115d936 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:58.287828 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c41f0224-9fc2-433e-932c-53848115d936 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:58.288268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c41f0224-9fc2-433e-932c-53848115d936 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:58.347316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c41f0224-9fc2-433e-932c-53848115d936 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:58.355601 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c41f0224-9fc2-433e-932c-53848115d936 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079435 Sep 14 20:05:58.356159 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1311/2590] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:58 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:59.372587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6f7f7df5-d228-40b9-a34e-d7b67f16d3cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:59.373187 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6f7f7df5-d228-40b9-a34e-d7b67f16d3cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:05:59.379067 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f7f7df5-d228-40b9-a34e-d7b67f16d3cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:59.379485 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f7f7df5-d228-40b9-a34e-d7b67f16d3cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:59.380264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f7f7df5-d228-40b9-a34e-d7b67f16d3cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:05:59.380692 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f7f7df5-d228-40b9-a34e-d7b67f16d3cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:05:59.441081 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6f7f7df5-d228-40b9-a34e-d7b67f16d3cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:59.449013 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6f7f7df5-d228-40b9-a34e-d7b67f16d3cc tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.080647 Sep 14 20:05:59.450070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1280/2591] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:05:59 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:00.465477 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-89cb474c-4c6e-49e6-ac86-012f6d6ef5d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:00.466124 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-89cb474c-4c6e-49e6-ac86-012f6d6ef5d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:06:00.472103 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89cb474c-4c6e-49e6-ac86-012f6d6ef5d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:00.472551 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89cb474c-4c6e-49e6-ac86-012f6d6ef5d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:00.473357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89cb474c-4c6e-49e6-ac86-012f6d6ef5d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:00.473804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-89cb474c-4c6e-49e6-ac86-012f6d6ef5d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:00.533236 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-89cb474c-4c6e-49e6-ac86-012f6d6ef5d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:00.541035 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-89cb474c-4c6e-49e6-ac86-012f6d6ef5d1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079366 Sep 14 20:06:00.541623 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1312/2592] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:06:00 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:01.557691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2970cb1a-710b-43e1-af80-6ed7a4090240 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:01.558288 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2970cb1a-710b-43e1-af80-6ed7a4090240 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:06:01.564112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2970cb1a-710b-43e1-af80-6ed7a4090240 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:01.564561 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2970cb1a-710b-43e1-af80-6ed7a4090240 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:01.565325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2970cb1a-710b-43e1-af80-6ed7a4090240 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:01.565790 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2970cb1a-710b-43e1-af80-6ed7a4090240 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:01.624905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2970cb1a-710b-43e1-af80-6ed7a4090240 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:01.632778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2970cb1a-710b-43e1-af80-6ed7a4090240 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.078739 Sep 14 20:06:01.633376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1281/2593] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:06:01 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:02.649728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e386113f-911d-4ddd-a9dc-10d25cc64685 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:02.650381 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e386113f-911d-4ddd-a9dc-10d25cc64685 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:06:02.656812 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e386113f-911d-4ddd-a9dc-10d25cc64685 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:02.657262 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e386113f-911d-4ddd-a9dc-10d25cc64685 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:02.658069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e386113f-911d-4ddd-a9dc-10d25cc64685 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:02.658513 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e386113f-911d-4ddd-a9dc-10d25cc64685 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:02.719517 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e386113f-911d-4ddd-a9dc-10d25cc64685 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:02.727341 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e386113f-911d-4ddd-a9dc-10d25cc64685 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.081272 Sep 14 20:06:02.727911 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1313/2594] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:06:02 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:03.743946 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1408f159-3134-4e64-9d65-f0311e307ed3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:03.744560 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1408f159-3134-4e64-9d65-f0311e307ed3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:06:03.751255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1408f159-3134-4e64-9d65-f0311e307ed3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:03.751703 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1408f159-3134-4e64-9d65-f0311e307ed3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:03.752473 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1408f159-3134-4e64-9d65-f0311e307ed3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:03.752909 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1408f159-3134-4e64-9d65-f0311e307ed3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:03.812095 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1408f159-3134-4e64-9d65-f0311e307ed3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:03.819809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1408f159-3134-4e64-9d65-f0311e307ed3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1348 microversion: 2.1 time: 0.079544 Sep 14 20:06:03.820394 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1282/2595] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:06:03 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1348 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:04.835501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:04.836156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:06:04.842491 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:04.842948 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:04.843711 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:04.844145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:04.873446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:04.873916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:04.874364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lazy-loading 'fault' on Instance uuid 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 20:06:04.914648 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:04.926674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-72e254fa-415e-4e4b-8630-b0a4a8b23d06 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 200 len: 1442 microversion: 2.1 time: 0.094817 Sep 14 20:06:04.927253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1314/2596] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:06:04 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 1442 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:05.944753 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-79919c5a-ba6b-4c25-902c-4ef321e1d0e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:05.945348 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-79919c5a-ba6b-4c25-902c-4ef321e1d0e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:06:05.951531 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79919c5a-ba6b-4c25-902c-4ef321e1d0e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:05.951977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79919c5a-ba6b-4c25-902c-4ef321e1d0e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:05.952741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79919c5a-ba6b-4c25-902c-4ef321e1d0e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:06:05.953173 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-79919c5a-ba6b-4c25-902c-4ef321e1d0e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:06:05.966290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-79919c5a-ba6b-4c25-902c-4ef321e1d0e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] HTTP exception thrown: Instance 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 could not be found. Sep 14 20:06:05.966883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-79919c5a-ba6b-4c25-902c-4ef321e1d0e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Returning 404 to user: Instance 9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:06:05.967717 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-79919c5a-ba6b-4c25-902c-4ef321e1d0e4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6" status: 404 len: 111 microversion: 2.1 time: 0.027332 Sep 14 20:06:05.968256 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1283/2597] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:06:05 2021] GET /compute/v2.1/servers/9d95ebf1-d92d-42dd-b910-2d8e2b1f09b6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:06:42.648049 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:06:42.648776 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:06:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:06:43.440072 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:06:43.440325 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:06:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:06:44.702529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:06:44.703146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:06:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:06:54.379543 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:06:54.380225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:06:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:07:00.417408 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:07:00.418160 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:07:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:07:12.816814 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:07:12.817411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:07:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:07:43.075908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 20:07:43.079291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0f3d206e-7dd1-4a1f-83df-735080428d61 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:07:43.079788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0f3d206e-7dd1-4a1f-83df-735080428d61 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:07:43.086105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f3d206e-7dd1-4a1f-83df-735080428d61 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:43.086560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f3d206e-7dd1-4a1f-83df-735080428d61 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:43.087336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f3d206e-7dd1-4a1f-83df-735080428d61 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:43.088903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0f3d206e-7dd1-4a1f-83df-735080428d61 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:43.116230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0f3d206e-7dd1-4a1f-83df-735080428d61 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Going to try to terminate instance {{(pid=115678) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 20:07:43.419766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0f3d206e-7dd1-4a1f-83df-735080428d61 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 204 len: 0 microversion: 2.20 time: 0.345283 Sep 14 20:07:43.420369 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1315/2598] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Sep 14 20:07:43 2021] DELETE /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 20:07:43.427224 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 20:07:43.431540 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1820dd1d-3fce-4ba1-9f6a-cc7d40abe062 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:07:43.432147 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1820dd1d-3fce-4ba1-9f6a-cc7d40abe062 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:07:43.439572 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1820dd1d-3fce-4ba1-9f6a-cc7d40abe062 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:43.440015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1820dd1d-3fce-4ba1-9f6a-cc7d40abe062 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:43.440779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1820dd1d-3fce-4ba1-9f6a-cc7d40abe062 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:43.441213 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1820dd1d-3fce-4ba1-9f6a-cc7d40abe062 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:43.564243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1820dd1d-3fce-4ba1-9f6a-cc7d40abe062 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:07:43.572811 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1820dd1d-3fce-4ba1-9f6a-cc7d40abe062 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:07:43.574321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1820dd1d-3fce-4ba1-9f6a-cc7d40abe062 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:07:43.580243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1820dd1d-3fce-4ba1-9f6a-cc7d40abe062 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1722 microversion: 2.20 time: 0.150656 Sep 14 20:07:43.580243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1284/2599] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:07:43 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:07:44.594494 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e10dc6de-e443-4a55-a0e4-9796edc5d99a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:07:44.595208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e10dc6de-e443-4a55-a0e4-9796edc5d99a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:07:44.612366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e10dc6de-e443-4a55-a0e4-9796edc5d99a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:44.612790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e10dc6de-e443-4a55-a0e4-9796edc5d99a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:44.613626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e10dc6de-e443-4a55-a0e4-9796edc5d99a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:44.614291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e10dc6de-e443-4a55-a0e4-9796edc5d99a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:44.630931 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 38292. Sep 14 20:07:44.956015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e10dc6de-e443-4a55-a0e4-9796edc5d99a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:07:44.965462 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e10dc6de-e443-4a55-a0e4-9796edc5d99a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:07:44.967063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e10dc6de-e443-4a55-a0e4-9796edc5d99a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:07:44.968283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e10dc6de-e443-4a55-a0e4-9796edc5d99a tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1654 microversion: 2.20 time: 0.377881 Sep 14 20:07:44.968848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1316/2600] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:07:44 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1654 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:07:45.095777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-fdbbeea7-e880-44ba-a1e6-01b01f20c1d5 req-0c447ca4-e8ce-4500-a4d3-962b4f065678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad1f171-af6a-4426-911c-022a3216f1f6", "name": "network-vif-deleted", "tag": "077796d9-a0ee-4177-8845-768d6c05b2b6"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:07:45.095777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:07:45.095777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:07:45.103063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-fdbbeea7-e880-44ba-a1e6-01b01f20c1d5 req-0c447ca4-e8ce-4500-a4d3-962b4f065678 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:45.104046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-fdbbeea7-e880-44ba-a1e6-01b01f20c1d5 req-0c447ca4-e8ce-4500-a4d3-962b4f065678 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:45.115352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 38300. Sep 14 20:07:45.117486 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-fdbbeea7-e880-44ba-a1e6-01b01f20c1d5 req-0c447ca4-e8ce-4500-a4d3-962b4f065678 service nova] Creating event network-vif-deleted:077796d9-a0ee-4177-8845-768d6c05b2b6 for instance dad1f171-af6a-4426-911c-022a3216f1f6 on hv-cinder-80588 Sep 14 20:07:45.124523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-fdbbeea7-e880-44ba-a1e6-01b01f20c1d5 req-0c447ca4-e8ce-4500-a4d3-962b4f065678 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045003 Sep 14 20:07:45.125132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1285/2601] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:07:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:07:45.986457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:07:45.988423 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:07:45.993466 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:45.994522 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:45.995326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:45.995837 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:46.031964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:46.032374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:46.032916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lazy-loading 'fault' on Instance uuid dad1f171-af6a-4426-911c-022a3216f1f6 {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 20:07:46.086314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:07:46.094158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:07:46.095658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '732d822c6c8141c8a51dd509cf560da0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbba3e0792bf41beb30a9f910ff28269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:07:46.096841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e47c3564-fb3f-449f-b94e-f8308435a23b tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 200 len: 1371 microversion: 2.20 time: 0.114361 Sep 14 20:07:46.097424 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1317/2602] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:07:45 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:07:47.118411 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-15ac3176-4690-426a-b8a4-d627ce16d982 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:07:47.119203 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-15ac3176-4690-426a-b8a4-d627ce16d982 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:07:47.125092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15ac3176-4690-426a-b8a4-d627ce16d982 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:47.125580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15ac3176-4690-426a-b8a4-d627ce16d982 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:47.126357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15ac3176-4690-426a-b8a4-d627ce16d982 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:07:47.126790 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-15ac3176-4690-426a-b8a4-d627ce16d982 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:07:47.140975 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-15ac3176-4690-426a-b8a4-d627ce16d982 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] HTTP exception thrown: Instance dad1f171-af6a-4426-911c-022a3216f1f6 could not be found. Sep 14 20:07:47.141632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-15ac3176-4690-426a-b8a4-d627ce16d982 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Returning 404 to user: Instance dad1f171-af6a-4426-911c-022a3216f1f6 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:07:47.142463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-15ac3176-4690-426a-b8a4-d627ce16d982 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 404 len: 111 microversion: 2.20 time: 0.028146 Sep 14 20:07:47.142999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1286/2603] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Sep 14 20:07:47 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 20:07:47.151621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-4aa7fd54-aa24-49df-b72c-2eaa65998d40 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '.version_select at 0x7fd0ccb50c10>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:07:47.225957 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-4aa7fd54-aa24-49df-b72c-2eaa65998d40 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929869716" status: 204 len: 0 microversion: 2.20 time: 0.078476 Sep 14 20:07:47.226528 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1318/2604] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Sep 14 20:07:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929869716 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 20:09:13.764599 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c1ec7346-e9cc-48bf-82c7-48fb227761df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:13.764599 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c1ec7346-e9cc-48bf-82c7-48fb227761df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:13.769443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c1ec7346-e9cc-48bf-82c7-48fb227761df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:13.769922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c1ec7346-e9cc-48bf-82c7-48fb227761df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:13.770689 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c1ec7346-e9cc-48bf-82c7-48fb227761df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:13.771120 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c1ec7346-e9cc-48bf-82c7-48fb227761df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:13.798935 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c1ec7346-e9cc-48bf-82c7-48fb227761df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Going to try to terminate instance {{(pid=115679) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 20:09:14.109301 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c1ec7346-e9cc-48bf-82c7-48fb227761df tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 204 len: 0 microversion: 2.1 time: 0.350405 Sep 14 20:09:14.109928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1287/2605] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:09:13 2021] DELETE /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:09:14.119517 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-94f7b8fb-a2c4-461c-a8ba-afe9ae805de7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:14.120162 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-94f7b8fb-a2c4-461c-a8ba-afe9ae805de7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:14.126961 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94f7b8fb-a2c4-461c-a8ba-afe9ae805de7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:14.127404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94f7b8fb-a2c4-461c-a8ba-afe9ae805de7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:14.128180 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94f7b8fb-a2c4-461c-a8ba-afe9ae805de7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:14.128620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94f7b8fb-a2c4-461c-a8ba-afe9ae805de7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:14.442158 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-94f7b8fb-a2c4-461c-a8ba-afe9ae805de7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:14.450075 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-94f7b8fb-a2c4-461c-a8ba-afe9ae805de7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1507 microversion: 2.1 time: 0.335566 Sep 14 20:09:14.450658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1319/2606] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:14 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:15.308200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-ea00324b-a4e0-4e88-b162-52cfa1a7afa0 req-106cdfa5-e785-4073-9962-062e6c62970a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be387eb-e7de-4f9f-b3ee-23068e618bf4", "name": "network-vif-deleted", "tag": "aed2c83a-d427-4091-9962-b9bcc094af29"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:09:15.317270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:09:15.317270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:09:15.317270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-ea00324b-a4e0-4e88-b162-52cfa1a7afa0 req-106cdfa5-e785-4073-9962-062e6c62970a service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:15.317270 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-ea00324b-a4e0-4e88-b162-52cfa1a7afa0 req-106cdfa5-e785-4073-9962-062e6c62970a service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:15.327819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-ea00324b-a4e0-4e88-b162-52cfa1a7afa0 req-106cdfa5-e785-4073-9962-062e6c62970a service nova] Creating event network-vif-deleted:aed2c83a-d427-4091-9962-b9bcc094af29 for instance 0be387eb-e7de-4f9f-b3ee-23068e618bf4 on hv-cinder-80588 Sep 14 20:09:15.332637 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-ea00324b-a4e0-4e88-b162-52cfa1a7afa0 req-106cdfa5-e785-4073-9962-062e6c62970a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080379 Sep 14 20:09:15.333381 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1288/2607] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:09:15.466935 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-9a943c15-3776-409b-8bbb-30deb331c1f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:15.467901 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-9a943c15-3776-409b-8bbb-30deb331c1f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:15.473820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a943c15-3776-409b-8bbb-30deb331c1f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:15.474273 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a943c15-3776-409b-8bbb-30deb331c1f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:15.475055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a943c15-3776-409b-8bbb-30deb331c1f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:15.475497 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-9a943c15-3776-409b-8bbb-30deb331c1f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:15.537426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-9a943c15-3776-409b-8bbb-30deb331c1f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:15.545746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-9a943c15-3776-409b-8bbb-30deb331c1f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 200 len: 1293 microversion: 2.1 time: 0.082360 Sep 14 20:09:15.546339 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1320/2608] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:15 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:16.563160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-235247b9-1f37-462a-89e7-52c11d5787c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:16.563862 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-235247b9-1f37-462a-89e7-52c11d5787c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0be387eb-e7de-4f9f-b3ee-23068e618bf4] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:16.570096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-235247b9-1f37-462a-89e7-52c11d5787c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:16.571149 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-235247b9-1f37-462a-89e7-52c11d5787c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:16.572352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-235247b9-1f37-462a-89e7-52c11d5787c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:16.572352 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-235247b9-1f37-462a-89e7-52c11d5787c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:16.585609 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-235247b9-1f37-462a-89e7-52c11d5787c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] HTTP exception thrown: Instance 0be387eb-e7de-4f9f-b3ee-23068e618bf4 could not be found. Sep 14 20:09:16.586240 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-235247b9-1f37-462a-89e7-52c11d5787c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Returning 404 to user: Instance 0be387eb-e7de-4f9f-b3ee-23068e618bf4 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:09:16.587097 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-235247b9-1f37-462a-89e7-52c11d5787c6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4" status: 404 len: 111 microversion: 2.1 time: 0.028148 Sep 14 20:09:16.587642 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1289/2609] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:16 2021] GET /compute/v2.1/servers/0be387eb-e7de-4f9f-b3ee-23068e618bf4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:09:16.595700 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-971679f5-d2fe-4757-a964-83e37a4ce5f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:16.596250 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-971679f5-d2fe-4757-a964-83e37a4ce5f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:16.602194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-971679f5-d2fe-4757-a964-83e37a4ce5f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:16.602651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-971679f5-d2fe-4757-a964-83e37a4ce5f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:16.603429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-971679f5-d2fe-4757-a964-83e37a4ce5f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:16.603870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-971679f5-d2fe-4757-a964-83e37a4ce5f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:16.628692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-971679f5-d2fe-4757-a964-83e37a4ce5f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Going to try to terminate instance {{(pid=115678) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 20:09:16.949163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-971679f5-d2fe-4757-a964-83e37a4ce5f7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 204 len: 0 microversion: 2.1 time: 0.356800 Sep 14 20:09:16.949818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1321/2610] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:09:16 2021] DELETE /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:09:16.958247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8d78878e-9e81-4f1c-885f-047ba5109ab3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:16.965891 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8d78878e-9e81-4f1c-885f-047ba5109ab3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:16.971460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d78878e-9e81-4f1c-885f-047ba5109ab3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:16.971912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d78878e-9e81-4f1c-885f-047ba5109ab3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:16.972701 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d78878e-9e81-4f1c-885f-047ba5109ab3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:16.973136 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8d78878e-9e81-4f1c-885f-047ba5109ab3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:17.161524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8d78878e-9e81-4f1c-885f-047ba5109ab3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:17.169528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8d78878e-9e81-4f1c-885f-047ba5109ab3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1568 microversion: 2.1 time: 0.215288 Sep 14 20:09:17.170118 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1290/2611] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:16 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:18.158652 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-94ac7673-3a39-47b8-9d78-f17891ea5148 req-1fb077bf-e872-4378-846f-0dcf6a03ae28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9185a2-5afd-4c39-bb28-beb531d58eb0", "name": "network-vif-deleted", "tag": "45334afa-e55a-4177-a70b-0d423fb28ae1"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:09:18.160181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:09:18.160181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 20:09:18.167080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-94ac7673-3a39-47b8-9d78-f17891ea5148 req-1fb077bf-e872-4378-846f-0dcf6a03ae28 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:18.171222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-94ac7673-3a39-47b8-9d78-f17891ea5148 req-1fb077bf-e872-4378-846f-0dcf6a03ae28 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:18.178530 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-94ac7673-3a39-47b8-9d78-f17891ea5148 req-1fb077bf-e872-4378-846f-0dcf6a03ae28 service nova] Creating event network-vif-deleted:45334afa-e55a-4177-a70b-0d423fb28ae1 for instance 0b9185a2-5afd-4c39-bb28-beb531d58eb0 on hv-cinder-80588 Sep 14 20:09:18.183463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-94ac7673-3a39-47b8-9d78-f17891ea5148 req-1fb077bf-e872-4378-846f-0dcf6a03ae28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028687 Sep 14 20:09:18.184038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1322/2612] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:09:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:09:18.187076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1c707ac2-aacc-4eb5-a910-f36c6e2b04cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:18.187679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1c707ac2-aacc-4eb5-a910-f36c6e2b04cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:18.193773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c707ac2-aacc-4eb5-a910-f36c6e2b04cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:18.194207 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c707ac2-aacc-4eb5-a910-f36c6e2b04cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:18.194969 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c707ac2-aacc-4eb5-a910-f36c6e2b04cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:18.195922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1c707ac2-aacc-4eb5-a910-f36c6e2b04cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:18.269948 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1c707ac2-aacc-4eb5-a910-f36c6e2b04cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:18.279831 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1c707ac2-aacc-4eb5-a910-f36c6e2b04cb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1526 microversion: 2.1 time: 0.096653 Sep 14 20:09:18.280400 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1291/2613] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:18 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1526 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:09:19.298822 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-94472094-c27a-42bc-8a81-f1c73788b599 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:19.299529 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-94472094-c27a-42bc-8a81-f1c73788b599 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:19.305986 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94472094-c27a-42bc-8a81-f1c73788b599 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:19.306404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94472094-c27a-42bc-8a81-f1c73788b599 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:19.307180 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94472094-c27a-42bc-8a81-f1c73788b599 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:19.307618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-94472094-c27a-42bc-8a81-f1c73788b599 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:19.372776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-94472094-c27a-42bc-8a81-f1c73788b599 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:19.380478 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-94472094-c27a-42bc-8a81-f1c73788b599 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.085611 Sep 14 20:09:19.381038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1323/2614] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:20.396785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-32bad38e-b5da-4e06-a18f-50c2e48c2d1c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:20.397525 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-32bad38e-b5da-4e06-a18f-50c2e48c2d1c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:20.403924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32bad38e-b5da-4e06-a18f-50c2e48c2d1c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:20.404363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32bad38e-b5da-4e06-a18f-50c2e48c2d1c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:20.405118 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32bad38e-b5da-4e06-a18f-50c2e48c2d1c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:20.405574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-32bad38e-b5da-4e06-a18f-50c2e48c2d1c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:20.464958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-32bad38e-b5da-4e06-a18f-50c2e48c2d1c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:20.472639 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-32bad38e-b5da-4e06-a18f-50c2e48c2d1c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.079419 Sep 14 20:09:20.473200 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1292/2615] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:20 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:21.489163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a6e4afc4-6595-469f-8402-8dce493893e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:21.489807 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a6e4afc4-6595-469f-8402-8dce493893e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:21.496405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6e4afc4-6595-469f-8402-8dce493893e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:21.496855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6e4afc4-6595-469f-8402-8dce493893e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:21.497661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6e4afc4-6595-469f-8402-8dce493893e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:21.498107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a6e4afc4-6595-469f-8402-8dce493893e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:21.560575 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a6e4afc4-6595-469f-8402-8dce493893e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:21.568512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a6e4afc4-6595-469f-8402-8dce493893e7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082985 Sep 14 20:09:21.569454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1324/2616] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:21 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:22.585383 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e4b2b95c-8e3a-4bf5-b4fa-f3f42c4b80d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:22.586033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e4b2b95c-8e3a-4bf5-b4fa-f3f42c4b80d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:22.591918 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4b2b95c-8e3a-4bf5-b4fa-f3f42c4b80d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:22.592367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4b2b95c-8e3a-4bf5-b4fa-f3f42c4b80d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:22.593132 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4b2b95c-8e3a-4bf5-b4fa-f3f42c4b80d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:22.593668 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e4b2b95c-8e3a-4bf5-b4fa-f3f42c4b80d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:22.653999 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e4b2b95c-8e3a-4bf5-b4fa-f3f42c4b80d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:22.661883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e4b2b95c-8e3a-4bf5-b4fa-f3f42c4b80d7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.080194 Sep 14 20:09:22.662447 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1293/2617] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:22 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:23.679309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-924517f2-81ec-42e7-abb9-65af4015fa67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:23.679989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-924517f2-81ec-42e7-abb9-65af4015fa67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:23.685903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-924517f2-81ec-42e7-abb9-65af4015fa67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:23.686357 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-924517f2-81ec-42e7-abb9-65af4015fa67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:23.687133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-924517f2-81ec-42e7-abb9-65af4015fa67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:23.687583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-924517f2-81ec-42e7-abb9-65af4015fa67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:23.747062 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-924517f2-81ec-42e7-abb9-65af4015fa67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:23.754904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-924517f2-81ec-42e7-abb9-65af4015fa67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.079635 Sep 14 20:09:23.755396 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1325/2618] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:23 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:24.772239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-93e4d8cc-8fa0-4a37-ae22-f270f1d549eb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:24.773343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-93e4d8cc-8fa0-4a37-ae22-f270f1d549eb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:24.780005 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93e4d8cc-8fa0-4a37-ae22-f270f1d549eb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:24.780444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93e4d8cc-8fa0-4a37-ae22-f270f1d549eb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:24.781254 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93e4d8cc-8fa0-4a37-ae22-f270f1d549eb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:24.781715 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-93e4d8cc-8fa0-4a37-ae22-f270f1d549eb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:24.845412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-93e4d8cc-8fa0-4a37-ae22-f270f1d549eb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:24.853915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-93e4d8cc-8fa0-4a37-ae22-f270f1d549eb tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.085284 Sep 14 20:09:24.854539 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1294/2619] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:24 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:09:25.870735 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7d40ecb8-ac5f-444a-816c-d5e94c40f49c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:25.871352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7d40ecb8-ac5f-444a-816c-d5e94c40f49c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:25.877443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d40ecb8-ac5f-444a-816c-d5e94c40f49c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:25.877929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d40ecb8-ac5f-444a-816c-d5e94c40f49c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:25.878706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d40ecb8-ac5f-444a-816c-d5e94c40f49c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:25.879150 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7d40ecb8-ac5f-444a-816c-d5e94c40f49c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:25.939969 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7d40ecb8-ac5f-444a-816c-d5e94c40f49c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:25.947737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7d40ecb8-ac5f-444a-816c-d5e94c40f49c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081294 Sep 14 20:09:25.948290 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1326/2620] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:25 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:26.963985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4013934b-cd80-471a-970f-1db6e107c19d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:26.964587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4013934b-cd80-471a-970f-1db6e107c19d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:26.970727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4013934b-cd80-471a-970f-1db6e107c19d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:26.971171 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4013934b-cd80-471a-970f-1db6e107c19d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:26.971930 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4013934b-cd80-471a-970f-1db6e107c19d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:26.972363 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4013934b-cd80-471a-970f-1db6e107c19d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:27.031503 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4013934b-cd80-471a-970f-1db6e107c19d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:27.039337 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4013934b-cd80-471a-970f-1db6e107c19d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.078989 Sep 14 20:09:27.039884 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1295/2621] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:26 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:28.055646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-195d1d79-7190-4915-bf7d-06dc2be44009 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:28.056259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-195d1d79-7190-4915-bf7d-06dc2be44009 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:28.063358 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-195d1d79-7190-4915-bf7d-06dc2be44009 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:28.063811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-195d1d79-7190-4915-bf7d-06dc2be44009 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:28.064589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-195d1d79-7190-4915-bf7d-06dc2be44009 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:28.065031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-195d1d79-7190-4915-bf7d-06dc2be44009 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:28.123533 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-195d1d79-7190-4915-bf7d-06dc2be44009 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:28.131104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-195d1d79-7190-4915-bf7d-06dc2be44009 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.079029 Sep 14 20:09:28.131658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1327/2622] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:28 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:29.148529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ce4eb8ff-5ffd-49ae-86a2-d493ba531f78 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:29.149146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ce4eb8ff-5ffd-49ae-86a2-d493ba531f78 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:29.155033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce4eb8ff-5ffd-49ae-86a2-d493ba531f78 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:29.155483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce4eb8ff-5ffd-49ae-86a2-d493ba531f78 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:29.156253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce4eb8ff-5ffd-49ae-86a2-d493ba531f78 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:29.156691 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce4eb8ff-5ffd-49ae-86a2-d493ba531f78 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:29.218682 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ce4eb8ff-5ffd-49ae-86a2-d493ba531f78 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:29.227303 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ce4eb8ff-5ffd-49ae-86a2-d493ba531f78 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.083266 Sep 14 20:09:29.227863 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1296/2623] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:29 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:30.244286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-dd762678-7bbb-47f6-9db4-1c156c6e29a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:30.244885 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-dd762678-7bbb-47f6-9db4-1c156c6e29a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:30.250716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd762678-7bbb-47f6-9db4-1c156c6e29a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:30.251174 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd762678-7bbb-47f6-9db4-1c156c6e29a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:30.251944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd762678-7bbb-47f6-9db4-1c156c6e29a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:30.252387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-dd762678-7bbb-47f6-9db4-1c156c6e29a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:30.312496 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-dd762678-7bbb-47f6-9db4-1c156c6e29a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:30.320373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-dd762678-7bbb-47f6-9db4-1c156c6e29a6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.080309 Sep 14 20:09:30.320944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1328/2624] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:30 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:31.335924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-897bb40d-ed42-4342-8d37-ba804939fa37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:31.336520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-897bb40d-ed42-4342-8d37-ba804939fa37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:31.342514 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-897bb40d-ed42-4342-8d37-ba804939fa37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:31.342897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-897bb40d-ed42-4342-8d37-ba804939fa37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:31.343662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-897bb40d-ed42-4342-8d37-ba804939fa37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:31.344094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-897bb40d-ed42-4342-8d37-ba804939fa37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:31.404050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-897bb40d-ed42-4342-8d37-ba804939fa37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:31.412437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-897bb40d-ed42-4342-8d37-ba804939fa37 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.080143 Sep 14 20:09:31.413010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1297/2625] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:31 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:32.429332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2636a19a-1514-44bd-b9e3-d7fd66ac137b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:32.430001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2636a19a-1514-44bd-b9e3-d7fd66ac137b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:32.436012 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2636a19a-1514-44bd-b9e3-d7fd66ac137b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:32.436463 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2636a19a-1514-44bd-b9e3-d7fd66ac137b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:32.437266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2636a19a-1514-44bd-b9e3-d7fd66ac137b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:32.437754 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2636a19a-1514-44bd-b9e3-d7fd66ac137b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:32.499430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2636a19a-1514-44bd-b9e3-d7fd66ac137b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:32.507449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2636a19a-1514-44bd-b9e3-d7fd66ac137b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081942 Sep 14 20:09:32.508720 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1329/2626] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:32 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:33.525454 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e0151ab0-c56b-4a89-92e8-946033d31ee0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:33.526355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e0151ab0-c56b-4a89-92e8-946033d31ee0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:33.533101 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e0151ab0-c56b-4a89-92e8-946033d31ee0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:33.533579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e0151ab0-c56b-4a89-92e8-946033d31ee0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:33.534355 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e0151ab0-c56b-4a89-92e8-946033d31ee0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:33.534991 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e0151ab0-c56b-4a89-92e8-946033d31ee0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:33.597365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e0151ab0-c56b-4a89-92e8-946033d31ee0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:33.606138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e0151ab0-c56b-4a89-92e8-946033d31ee0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084777 Sep 14 20:09:33.606707 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1298/2627] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:33 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:34.623607 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5443a5e2-4006-4aae-b91a-974198d9b562 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:34.624220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5443a5e2-4006-4aae-b91a-974198d9b562 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:34.630086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5443a5e2-4006-4aae-b91a-974198d9b562 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:34.630541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5443a5e2-4006-4aae-b91a-974198d9b562 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:34.631308 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5443a5e2-4006-4aae-b91a-974198d9b562 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:34.631749 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5443a5e2-4006-4aae-b91a-974198d9b562 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:34.695870 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5443a5e2-4006-4aae-b91a-974198d9b562 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:34.704306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5443a5e2-4006-4aae-b91a-974198d9b562 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084332 Sep 14 20:09:34.704902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1330/2628] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:34 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:35.720968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-61ec64c0-ae38-43e6-887a-8cebb2e33daf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:35.721614 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-61ec64c0-ae38-43e6-887a-8cebb2e33daf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:35.727759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61ec64c0-ae38-43e6-887a-8cebb2e33daf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:35.728260 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61ec64c0-ae38-43e6-887a-8cebb2e33daf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:35.729071 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61ec64c0-ae38-43e6-887a-8cebb2e33daf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:35.729546 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61ec64c0-ae38-43e6-887a-8cebb2e33daf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:35.792027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-61ec64c0-ae38-43e6-887a-8cebb2e33daf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:35.800041 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-61ec64c0-ae38-43e6-887a-8cebb2e33daf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082679 Sep 14 20:09:35.800853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1299/2629] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:35 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:36.816331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-91924417-dc57-42e6-8ca4-32fffc483aab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:36.816819 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-91924417-dc57-42e6-8ca4-32fffc483aab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:36.822740 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91924417-dc57-42e6-8ca4-32fffc483aab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:36.823193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91924417-dc57-42e6-8ca4-32fffc483aab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:36.823975 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91924417-dc57-42e6-8ca4-32fffc483aab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:36.824412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-91924417-dc57-42e6-8ca4-32fffc483aab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:36.889599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-91924417-dc57-42e6-8ca4-32fffc483aab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:36.897239 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-91924417-dc57-42e6-8ca4-32fffc483aab tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084723 Sep 14 20:09:36.898104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1331/2630] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:36 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:37.913972 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-0635ea9c-3809-42fd-9b17-301404c04a68 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:37.915189 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-0635ea9c-3809-42fd-9b17-301404c04a68 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:37.921214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0635ea9c-3809-42fd-9b17-301404c04a68 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:37.921695 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0635ea9c-3809-42fd-9b17-301404c04a68 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:37.922460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0635ea9c-3809-42fd-9b17-301404c04a68 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:37.922890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-0635ea9c-3809-42fd-9b17-301404c04a68 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:37.986903 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-0635ea9c-3809-42fd-9b17-301404c04a68 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:37.995032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-0635ea9c-3809-42fd-9b17-301404c04a68 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084562 Sep 14 20:09:37.995664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1300/2631] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:37 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:39.014246 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0b8b5c39-0708-41dd-820d-256bc2f7b2a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:39.014916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0b8b5c39-0708-41dd-820d-256bc2f7b2a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:39.020940 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b8b5c39-0708-41dd-820d-256bc2f7b2a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:39.021386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b8b5c39-0708-41dd-820d-256bc2f7b2a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:39.022196 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b8b5c39-0708-41dd-820d-256bc2f7b2a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:39.022679 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0b8b5c39-0708-41dd-820d-256bc2f7b2a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:39.087891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0b8b5c39-0708-41dd-820d-256bc2f7b2a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:39.101001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0b8b5c39-0708-41dd-820d-256bc2f7b2a3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.090220 Sep 14 20:09:39.102988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1332/2632] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:39 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:40.121014 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4f716e2b-a99a-4724-9863-12ad4dff85b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:40.121741 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4f716e2b-a99a-4724-9863-12ad4dff85b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:40.127580 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4f716e2b-a99a-4724-9863-12ad4dff85b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:40.128033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4f716e2b-a99a-4724-9863-12ad4dff85b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:40.128803 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4f716e2b-a99a-4724-9863-12ad4dff85b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:40.129243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4f716e2b-a99a-4724-9863-12ad4dff85b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:40.192834 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4f716e2b-a99a-4724-9863-12ad4dff85b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:40.203922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4f716e2b-a99a-4724-9863-12ad4dff85b6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.086623 Sep 14 20:09:40.204502 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1301/2633] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:40 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:41.220213 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-bffa2dce-7b55-4b4a-b992-e9247958eaae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:41.220839 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-bffa2dce-7b55-4b4a-b992-e9247958eaae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:41.226750 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bffa2dce-7b55-4b4a-b992-e9247958eaae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:41.227203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bffa2dce-7b55-4b4a-b992-e9247958eaae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:41.228589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bffa2dce-7b55-4b4a-b992-e9247958eaae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:41.229028 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-bffa2dce-7b55-4b4a-b992-e9247958eaae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:41.288621 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-bffa2dce-7b55-4b4a-b992-e9247958eaae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:41.297291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-bffa2dce-7b55-4b4a-b992-e9247958eaae tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.080703 Sep 14 20:09:41.297916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1333/2634] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:41 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:42.314555 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6aa36fe3-1fae-4ff7-a52f-087137882ed7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:42.315163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6aa36fe3-1fae-4ff7-a52f-087137882ed7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:42.321044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6aa36fe3-1fae-4ff7-a52f-087137882ed7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:42.322016 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6aa36fe3-1fae-4ff7-a52f-087137882ed7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:42.322777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6aa36fe3-1fae-4ff7-a52f-087137882ed7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:42.323210 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6aa36fe3-1fae-4ff7-a52f-087137882ed7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:42.381672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6aa36fe3-1fae-4ff7-a52f-087137882ed7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:42.390090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6aa36fe3-1fae-4ff7-a52f-087137882ed7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.079154 Sep 14 20:09:42.390654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1302/2635] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:42 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:43.406691 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-286b24a4-a130-487b-9fcf-b0cf724e99ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:43.407302 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-286b24a4-a130-487b-9fcf-b0cf724e99ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:43.413400 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-286b24a4-a130-487b-9fcf-b0cf724e99ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:43.413875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-286b24a4-a130-487b-9fcf-b0cf724e99ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:43.414643 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-286b24a4-a130-487b-9fcf-b0cf724e99ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:43.415670 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-286b24a4-a130-487b-9fcf-b0cf724e99ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:43.481376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-286b24a4-a130-487b-9fcf-b0cf724e99ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:43.483984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-286b24a4-a130-487b-9fcf-b0cf724e99ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.080810 Sep 14 20:09:43.485001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1334/2636] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:43 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:44.501177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d55e2b6d-c5af-47f6-9fc2-add84de5ddda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:44.501792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d55e2b6d-c5af-47f6-9fc2-add84de5ddda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:44.508272 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d55e2b6d-c5af-47f6-9fc2-add84de5ddda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:44.508766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d55e2b6d-c5af-47f6-9fc2-add84de5ddda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:44.509597 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d55e2b6d-c5af-47f6-9fc2-add84de5ddda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:44.510039 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d55e2b6d-c5af-47f6-9fc2-add84de5ddda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:44.577151 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d55e2b6d-c5af-47f6-9fc2-add84de5ddda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:44.585681 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d55e2b6d-c5af-47f6-9fc2-add84de5ddda tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.088384 Sep 14 20:09:44.586278 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1303/2637] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:44 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:45.603123 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-137406eb-a30d-429c-9bd9-a976cdc77094 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:45.603725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-137406eb-a30d-429c-9bd9-a976cdc77094 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:45.610038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-137406eb-a30d-429c-9bd9-a976cdc77094 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:45.610645 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-137406eb-a30d-429c-9bd9-a976cdc77094 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:45.611256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-137406eb-a30d-429c-9bd9-a976cdc77094 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:45.611700 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-137406eb-a30d-429c-9bd9-a976cdc77094 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:45.676004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-137406eb-a30d-429c-9bd9-a976cdc77094 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:45.684362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-137406eb-a30d-429c-9bd9-a976cdc77094 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.085683 Sep 14 20:09:45.684950 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1335/2638] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:45 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:46.708332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a2e648fc-d597-4edb-ae17-b29551e31c7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:46.708949 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-a2e648fc-d597-4edb-ae17-b29551e31c7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:46.714767 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2e648fc-d597-4edb-ae17-b29551e31c7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:46.715341 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2e648fc-d597-4edb-ae17-b29551e31c7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:46.715981 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2e648fc-d597-4edb-ae17-b29551e31c7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:46.716438 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-a2e648fc-d597-4edb-ae17-b29551e31c7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:46.777135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-a2e648fc-d597-4edb-ae17-b29551e31c7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:46.791443 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a2e648fc-d597-4edb-ae17-b29551e31c7f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.086671 Sep 14 20:09:46.792057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1304/2639] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:46 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:47.809104 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2f0b76a3-3333-48f4-8e24-8668afde5e2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:47.810277 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2f0b76a3-3333-48f4-8e24-8668afde5e2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:47.817373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f0b76a3-3333-48f4-8e24-8668afde5e2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:47.817857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f0b76a3-3333-48f4-8e24-8668afde5e2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:47.818631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f0b76a3-3333-48f4-8e24-8668afde5e2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:47.819076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2f0b76a3-3333-48f4-8e24-8668afde5e2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:47.877882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2f0b76a3-3333-48f4-8e24-8668afde5e2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:47.886439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2f0b76a3-3333-48f4-8e24-8668afde5e2a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082139 Sep 14 20:09:47.886993 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1336/2640] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:47 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:48.903506 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b281ac96-7be5-4f60-a473-63c428bf232e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:48.904096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b281ac96-7be5-4f60-a473-63c428bf232e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:48.910306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b281ac96-7be5-4f60-a473-63c428bf232e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:48.910756 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b281ac96-7be5-4f60-a473-63c428bf232e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:48.911524 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b281ac96-7be5-4f60-a473-63c428bf232e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:48.911959 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b281ac96-7be5-4f60-a473-63c428bf232e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:48.971096 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b281ac96-7be5-4f60-a473-63c428bf232e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:48.979271 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b281ac96-7be5-4f60-a473-63c428bf232e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.080097 Sep 14 20:09:48.979843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1305/2641] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:48 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:49.995297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-98065501-f012-4dfc-8b83-a04383d698d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:49.995909 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-98065501-f012-4dfc-8b83-a04383d698d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:50.001798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98065501-f012-4dfc-8b83-a04383d698d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:50.002275 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98065501-f012-4dfc-8b83-a04383d698d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:50.003037 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98065501-f012-4dfc-8b83-a04383d698d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:50.003471 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98065501-f012-4dfc-8b83-a04383d698d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:50.062526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-98065501-f012-4dfc-8b83-a04383d698d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:50.070318 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-98065501-f012-4dfc-8b83-a04383d698d1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.078657 Sep 14 20:09:50.070816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1337/2642] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:49 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:51.086822 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-41a004ad-3e8b-4e16-953f-176d19f02328 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:51.087414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-41a004ad-3e8b-4e16-953f-176d19f02328 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:51.093442 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41a004ad-3e8b-4e16-953f-176d19f02328 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:51.093927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41a004ad-3e8b-4e16-953f-176d19f02328 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:51.094731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41a004ad-3e8b-4e16-953f-176d19f02328 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:51.095167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-41a004ad-3e8b-4e16-953f-176d19f02328 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:51.159646 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-41a004ad-3e8b-4e16-953f-176d19f02328 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:51.167883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-41a004ad-3e8b-4e16-953f-176d19f02328 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084951 Sep 14 20:09:51.168439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1306/2643] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:51 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:52.184165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-86555ce0-5b0c-4460-b3aa-4bf54155cdf0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:52.184898 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-86555ce0-5b0c-4460-b3aa-4bf54155cdf0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:52.190685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86555ce0-5b0c-4460-b3aa-4bf54155cdf0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:52.191134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86555ce0-5b0c-4460-b3aa-4bf54155cdf0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:52.191919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86555ce0-5b0c-4460-b3aa-4bf54155cdf0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:52.192348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-86555ce0-5b0c-4460-b3aa-4bf54155cdf0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:52.253410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-86555ce0-5b0c-4460-b3aa-4bf54155cdf0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:52.262334 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-86555ce0-5b0c-4460-b3aa-4bf54155cdf0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081498 Sep 14 20:09:52.262922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1338/2644] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:52 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:53.278745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-fd7e0439-da0f-454a-8d19-81d9c4142d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:53.279345 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-fd7e0439-da0f-454a-8d19-81d9c4142d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:53.285306 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd7e0439-da0f-454a-8d19-81d9c4142d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:53.285778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd7e0439-da0f-454a-8d19-81d9c4142d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:53.286537 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd7e0439-da0f-454a-8d19-81d9c4142d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:53.286964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-fd7e0439-da0f-454a-8d19-81d9c4142d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:53.348910 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-fd7e0439-da0f-454a-8d19-81d9c4142d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:53.357099 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-fd7e0439-da0f-454a-8d19-81d9c4142d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081838 Sep 14 20:09:53.357661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1307/2645] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:53 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:54.381971 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c14a7867-0978-47b7-baf6-70b81e7790f0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:54.382609 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c14a7867-0978-47b7-baf6-70b81e7790f0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:54.388531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c14a7867-0978-47b7-baf6-70b81e7790f0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:54.388989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c14a7867-0978-47b7-baf6-70b81e7790f0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:54.389802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c14a7867-0978-47b7-baf6-70b81e7790f0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:54.390242 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c14a7867-0978-47b7-baf6-70b81e7790f0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:54.456487 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c14a7867-0978-47b7-baf6-70b81e7790f0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:54.464951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c14a7867-0978-47b7-baf6-70b81e7790f0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.086704 Sep 14 20:09:54.465536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1339/2646] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:54 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:55.481750 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-05141655-6911-449e-9cc9-01d9219e9f28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:55.482359 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-05141655-6911-449e-9cc9-01d9219e9f28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:55.488232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05141655-6911-449e-9cc9-01d9219e9f28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:55.488679 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05141655-6911-449e-9cc9-01d9219e9f28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:55.489444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05141655-6911-449e-9cc9-01d9219e9f28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:55.489915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-05141655-6911-449e-9cc9-01d9219e9f28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:55.560416 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-05141655-6911-449e-9cc9-01d9219e9f28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:55.569459 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-05141655-6911-449e-9cc9-01d9219e9f28 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.091328 Sep 14 20:09:55.570062 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1308/2647] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:55 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:56.587598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d7041363-e80c-4c18-afe8-a66511c32a43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:56.588163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d7041363-e80c-4c18-afe8-a66511c32a43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:56.594545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d7041363-e80c-4c18-afe8-a66511c32a43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:56.594998 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d7041363-e80c-4c18-afe8-a66511c32a43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:56.595791 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d7041363-e80c-4c18-afe8-a66511c32a43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:56.596229 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d7041363-e80c-4c18-afe8-a66511c32a43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:56.657186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d7041363-e80c-4c18-afe8-a66511c32a43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:56.665032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d7041363-e80c-4c18-afe8-a66511c32a43 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081834 Sep 14 20:09:56.665627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1340/2648] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:56 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:57.681616 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ba96b269-6ec2-42ef-8fcb-f291979c2071 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:57.682253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ba96b269-6ec2-42ef-8fcb-f291979c2071 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:57.688218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba96b269-6ec2-42ef-8fcb-f291979c2071 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:57.688663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba96b269-6ec2-42ef-8fcb-f291979c2071 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:57.689439 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba96b269-6ec2-42ef-8fcb-f291979c2071 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:57.689905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ba96b269-6ec2-42ef-8fcb-f291979c2071 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:57.750414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ba96b269-6ec2-42ef-8fcb-f291979c2071 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:57.759029 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ba96b269-6ec2-42ef-8fcb-f291979c2071 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081148 Sep 14 20:09:57.759615 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1309/2649] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:57 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:58.776292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-60a8f101-a088-4f7c-8d90-5cf5e6978e87 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:58.776904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-60a8f101-a088-4f7c-8d90-5cf5e6978e87 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:58.782736 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60a8f101-a088-4f7c-8d90-5cf5e6978e87 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:58.783186 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60a8f101-a088-4f7c-8d90-5cf5e6978e87 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:58.783952 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60a8f101-a088-4f7c-8d90-5cf5e6978e87 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:58.784391 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-60a8f101-a088-4f7c-8d90-5cf5e6978e87 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:58.846589 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-60a8f101-a088-4f7c-8d90-5cf5e6978e87 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:58.854498 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-60a8f101-a088-4f7c-8d90-5cf5e6978e87 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082505 Sep 14 20:09:58.855059 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1341/2650] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:58 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:59.870714 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9b3e0281-8772-4cee-ae4f-96921285dc7b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:59.871362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9b3e0281-8772-4cee-ae4f-96921285dc7b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:09:59.877219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b3e0281-8772-4cee-ae4f-96921285dc7b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:59.877708 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b3e0281-8772-4cee-ae4f-96921285dc7b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:59.878482 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b3e0281-8772-4cee-ae4f-96921285dc7b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:09:59.878923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9b3e0281-8772-4cee-ae4f-96921285dc7b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:09:59.943491 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9b3e0281-8772-4cee-ae4f-96921285dc7b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:59.951184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9b3e0281-8772-4cee-ae4f-96921285dc7b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084235 Sep 14 20:09:59.952322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1310/2651] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:09:59 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:00.967471 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-146ade93-e9e4-40aa-84b7-19c7f4c229e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:00.968084 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-146ade93-e9e4-40aa-84b7-19c7f4c229e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:00.973833 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-146ade93-e9e4-40aa-84b7-19c7f4c229e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:00.974272 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-146ade93-e9e4-40aa-84b7-19c7f4c229e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:00.975025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-146ade93-e9e4-40aa-84b7-19c7f4c229e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:00.975456 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-146ade93-e9e4-40aa-84b7-19c7f4c229e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:01.033755 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-146ade93-e9e4-40aa-84b7-19c7f4c229e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:01.041918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-146ade93-e9e4-40aa-84b7-19c7f4c229e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.078011 Sep 14 20:10:01.042482 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1342/2652] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:00 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:02.059050 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cc67a923-675c-4932-97d9-803ccaafa42d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:02.060423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cc67a923-675c-4932-97d9-803ccaafa42d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:02.065579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cc67a923-675c-4932-97d9-803ccaafa42d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:02.066038 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cc67a923-675c-4932-97d9-803ccaafa42d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:02.066812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cc67a923-675c-4932-97d9-803ccaafa42d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:02.067249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cc67a923-675c-4932-97d9-803ccaafa42d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:02.125836 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cc67a923-675c-4932-97d9-803ccaafa42d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:02.136423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cc67a923-675c-4932-97d9-803ccaafa42d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081500 Sep 14 20:10:02.137018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1311/2653] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:02 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:02.666143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:10:02.666417 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:10:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:10:03.152443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a200a86c-f8ca-416a-be92-e8132c17e39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:03.153059 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a200a86c-f8ca-416a-be92-e8132c17e39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:03.159476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a200a86c-f8ca-416a-be92-e8132c17e39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:03.159922 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a200a86c-f8ca-416a-be92-e8132c17e39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:03.160703 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a200a86c-f8ca-416a-be92-e8132c17e39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:03.161144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a200a86c-f8ca-416a-be92-e8132c17e39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:03.220629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a200a86c-f8ca-416a-be92-e8132c17e39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:03.228622 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a200a86c-f8ca-416a-be92-e8132c17e39c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.080134 Sep 14 20:10:03.229429 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1343/2654] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:03 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:03.457683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:10:03.458261 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:10:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:10:04.245042 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e1a559b1-29cf-452f-9790-d9eb3f627706 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:04.245640 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e1a559b1-29cf-452f-9790-d9eb3f627706 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:04.251604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1a559b1-29cf-452f-9790-d9eb3f627706 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:04.252047 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1a559b1-29cf-452f-9790-d9eb3f627706 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:04.252843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1a559b1-29cf-452f-9790-d9eb3f627706 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:04.253274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e1a559b1-29cf-452f-9790-d9eb3f627706 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:04.329907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e1a559b1-29cf-452f-9790-d9eb3f627706 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:04.338516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e1a559b1-29cf-452f-9790-d9eb3f627706 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.097126 Sep 14 20:10:04.339091 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1312/2655] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:04 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:04.720476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:10:04.721073 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:10:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:10:05.355445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-de4c0cda-1b2c-41af-bd9d-f94afaab09b1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:05.356055 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-de4c0cda-1b2c-41af-bd9d-f94afaab09b1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:05.362076 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de4c0cda-1b2c-41af-bd9d-f94afaab09b1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:05.362531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de4c0cda-1b2c-41af-bd9d-f94afaab09b1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:05.363317 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de4c0cda-1b2c-41af-bd9d-f94afaab09b1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:05.363754 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-de4c0cda-1b2c-41af-bd9d-f94afaab09b1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:05.423506 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-de4c0cda-1b2c-41af-bd9d-f94afaab09b1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:05.431573 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-de4c0cda-1b2c-41af-bd9d-f94afaab09b1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.079879 Sep 14 20:10:05.432134 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1344/2656] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:05 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:06.448331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5f0fb9a8-6908-414a-a774-e47d146fe234 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:06.448970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5f0fb9a8-6908-414a-a774-e47d146fe234 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:06.454929 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f0fb9a8-6908-414a-a774-e47d146fe234 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:06.455369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f0fb9a8-6908-414a-a774-e47d146fe234 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:06.456128 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f0fb9a8-6908-414a-a774-e47d146fe234 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:06.456556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5f0fb9a8-6908-414a-a774-e47d146fe234 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:06.728159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5f0fb9a8-6908-414a-a774-e47d146fe234 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:06.735919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5f0fb9a8-6908-414a-a774-e47d146fe234 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.291259 Sep 14 20:10:06.736470 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1313/2657] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:06 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:07.756191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-76dfdc67-5356-4a50-bb06-70ce410b5d65 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:07.756191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-76dfdc67-5356-4a50-bb06-70ce410b5d65 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:07.760520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76dfdc67-5356-4a50-bb06-70ce410b5d65 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:07.761031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76dfdc67-5356-4a50-bb06-70ce410b5d65 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:07.761832 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76dfdc67-5356-4a50-bb06-70ce410b5d65 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:07.762274 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-76dfdc67-5356-4a50-bb06-70ce410b5d65 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:07.822781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-76dfdc67-5356-4a50-bb06-70ce410b5d65 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:07.830629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-76dfdc67-5356-4a50-bb06-70ce410b5d65 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081706 Sep 14 20:10:07.831195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1345/2658] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:07 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:08.847107 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-184fffca-aede-47da-a711-1bd4e4ea28ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:08.847716 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-184fffca-aede-47da-a711-1bd4e4ea28ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:08.853683 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-184fffca-aede-47da-a711-1bd4e4ea28ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:08.854138 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-184fffca-aede-47da-a711-1bd4e4ea28ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:08.854899 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-184fffca-aede-47da-a711-1bd4e4ea28ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:08.855328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-184fffca-aede-47da-a711-1bd4e4ea28ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:08.919422 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-184fffca-aede-47da-a711-1bd4e4ea28ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:08.927586 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-184fffca-aede-47da-a711-1bd4e4ea28ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084102 Sep 14 20:10:08.928142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1314/2659] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:08 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:09.944485 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a60ebbdd-858d-4c79-9f80-725c8e0d3555 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:09.945721 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a60ebbdd-858d-4c79-9f80-725c8e0d3555 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:09.951619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a60ebbdd-858d-4c79-9f80-725c8e0d3555 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:09.952068 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a60ebbdd-858d-4c79-9f80-725c8e0d3555 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:09.952841 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a60ebbdd-858d-4c79-9f80-725c8e0d3555 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:09.953281 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a60ebbdd-858d-4c79-9f80-725c8e0d3555 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:10.014131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a60ebbdd-858d-4c79-9f80-725c8e0d3555 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:10.022306 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a60ebbdd-858d-4c79-9f80-725c8e0d3555 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081438 Sep 14 20:10:10.022886 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1346/2660] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:09 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:11.040161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-039d70df-4f9b-4837-b1a4-309947059394 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:11.040775 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-039d70df-4f9b-4837-b1a4-309947059394 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:11.046502 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-039d70df-4f9b-4837-b1a4-309947059394 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:11.046950 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-039d70df-4f9b-4837-b1a4-309947059394 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:11.047794 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-039d70df-4f9b-4837-b1a4-309947059394 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:11.048142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-039d70df-4f9b-4837-b1a4-309947059394 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:11.107873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-039d70df-4f9b-4837-b1a4-309947059394 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:11.115872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-039d70df-4f9b-4837-b1a4-309947059394 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.080202 Sep 14 20:10:11.116440 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1315/2661] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:12.132729 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a96d2f42-d9d4-4327-9604-f62031ad6692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:12.133323 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a96d2f42-d9d4-4327-9604-f62031ad6692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:12.139226 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a96d2f42-d9d4-4327-9604-f62031ad6692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:12.139668 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a96d2f42-d9d4-4327-9604-f62031ad6692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:12.140440 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a96d2f42-d9d4-4327-9604-f62031ad6692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:12.140874 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a96d2f42-d9d4-4327-9604-f62031ad6692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:12.203030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a96d2f42-d9d4-4327-9604-f62031ad6692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:12.211129 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a96d2f42-d9d4-4327-9604-f62031ad6692 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082077 Sep 14 20:10:12.211706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1347/2662] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:12 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:13.228315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e82ba255-8bea-4f0d-b994-ecffd3cdda2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:13.229033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e82ba255-8bea-4f0d-b994-ecffd3cdda2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:13.234857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e82ba255-8bea-4f0d-b994-ecffd3cdda2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:13.235291 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e82ba255-8bea-4f0d-b994-ecffd3cdda2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:13.236056 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e82ba255-8bea-4f0d-b994-ecffd3cdda2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:13.236483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e82ba255-8bea-4f0d-b994-ecffd3cdda2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:13.299090 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e82ba255-8bea-4f0d-b994-ecffd3cdda2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:13.307664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e82ba255-8bea-4f0d-b994-ecffd3cdda2c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.083828 Sep 14 20:10:13.308251 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1316/2663] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:13 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:14.325526 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6442ce88-9551-4e23-8434-0e2e8cd00126 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:14.326111 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6442ce88-9551-4e23-8434-0e2e8cd00126 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:14.331983 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6442ce88-9551-4e23-8434-0e2e8cd00126 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:14.332430 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6442ce88-9551-4e23-8434-0e2e8cd00126 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:14.333227 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6442ce88-9551-4e23-8434-0e2e8cd00126 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:14.333704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6442ce88-9551-4e23-8434-0e2e8cd00126 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:14.397110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6442ce88-9551-4e23-8434-0e2e8cd00126 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:14.406133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Traceback (most recent call last): Sep 14 20:10:14.406133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 14 20:10:14.406133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: timer() Sep 14 20:10:14.406133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 14 20:10:14.406133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: cb(*args, **kw) Sep 14 20:10:14.406133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 152, in _do_acquire Sep 14 20:10:14.406133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: waiter.switch() Sep 14 20:10:14.406133 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: greenlet.error: cannot switch to a different thread Sep 14 20:10:14.412286 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6442ce88-9551-4e23-8434-0e2e8cd00126 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.092025 Sep 14 20:10:14.412857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1348/2664] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:14 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:15.429671 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-28735851-0bc5-4c68-8140-f13ce8a94fe6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:15.430302 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-28735851-0bc5-4c68-8140-f13ce8a94fe6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:15.436123 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28735851-0bc5-4c68-8140-f13ce8a94fe6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:15.436564 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28735851-0bc5-4c68-8140-f13ce8a94fe6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:15.437316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28735851-0bc5-4c68-8140-f13ce8a94fe6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:15.437769 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-28735851-0bc5-4c68-8140-f13ce8a94fe6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:15.503924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-28735851-0bc5-4c68-8140-f13ce8a94fe6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:15.515335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-28735851-0bc5-4c68-8140-f13ce8a94fe6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.089510 Sep 14 20:10:15.516751 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1317/2665] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:15 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:16.190192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1e0ba80d-4dc7-48e9-abd1-4f7672de205b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:16.190701 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1e0ba80d-4dc7-48e9-abd1-4f7672de205b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:16.196769 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e0ba80d-4dc7-48e9-abd1-4f7672de205b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:16.197224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e0ba80d-4dc7-48e9-abd1-4f7672de205b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:16.198022 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e0ba80d-4dc7-48e9-abd1-4f7672de205b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:16.198478 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1e0ba80d-4dc7-48e9-abd1-4f7672de205b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:16.212732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-1e0ba80d-4dc7-48e9-abd1-4f7672de205b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] HTTP exception thrown: Instance 1719e572-6299-43f2-a47b-f1774166a3a6 could not be found. Sep 14 20:10:16.213343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1e0ba80d-4dc7-48e9-abd1-4f7672de205b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Returning 404 to user: Instance 1719e572-6299-43f2-a47b-f1774166a3a6 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:10:16.214233 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1e0ba80d-4dc7-48e9-abd1-4f7672de205b tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 404 len: 111 microversion: 2.1 time: 0.027962 Sep 14 20:10:16.214799 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1349/2666] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:10:16 2021] DELETE /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:10:16.223069 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f9b53b41-f98a-4d92-b512-136865f3bdfb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:16.223667 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f9b53b41-f98a-4d92-b512-136865f3bdfb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] [instance: 1719e572-6299-43f2-a47b-f1774166a3a6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:16.230057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f9b53b41-f98a-4d92-b512-136865f3bdfb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:16.230495 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f9b53b41-f98a-4d92-b512-136865f3bdfb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:16.231249 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f9b53b41-f98a-4d92-b512-136865f3bdfb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:16.231672 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f9b53b41-f98a-4d92-b512-136865f3bdfb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:16.244600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-f9b53b41-f98a-4d92-b512-136865f3bdfb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] HTTP exception thrown: Instance 1719e572-6299-43f2-a47b-f1774166a3a6 could not be found. Sep 14 20:10:16.245182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f9b53b41-f98a-4d92-b512-136865f3bdfb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] Returning 404 to user: Instance 1719e572-6299-43f2-a47b-f1774166a3a6 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:10:16.246034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f9b53b41-f98a-4d92-b512-136865f3bdfb tempest-AttachVolumeTestJSON-1065965593 tempest-AttachVolumeTestJSON-1065965593-project] 10.222.0.58 "GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6" status: 404 len: 111 microversion: 2.1 time: 0.026937 Sep 14 20:10:16.246563 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1318/2667] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:16 2021] GET /compute/v2.1/servers/1719e572-6299-43f2-a47b-f1774166a3a6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:10:16.532419 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-28d77ca8-8434-4990-94c9-8dae2994da02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:16.533086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-28d77ca8-8434-4990-94c9-8dae2994da02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:16.539343 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-28d77ca8-8434-4990-94c9-8dae2994da02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:16.539801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-28d77ca8-8434-4990-94c9-8dae2994da02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:16.540599 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-28d77ca8-8434-4990-94c9-8dae2994da02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:16.541042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-28d77ca8-8434-4990-94c9-8dae2994da02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:16.628707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-28d77ca8-8434-4990-94c9-8dae2994da02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:16.637436 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-28d77ca8-8434-4990-94c9-8dae2994da02 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.108786 Sep 14 20:10:16.638050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1350/2668] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:16 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:17.664019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7d7416a9-c260-4bff-b461-aaa71c5fc147 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:17.664724 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7d7416a9-c260-4bff-b461-aaa71c5fc147 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:17.670913 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d7416a9-c260-4bff-b461-aaa71c5fc147 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:17.671365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d7416a9-c260-4bff-b461-aaa71c5fc147 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:17.672141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d7416a9-c260-4bff-b461-aaa71c5fc147 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:17.672574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7d7416a9-c260-4bff-b461-aaa71c5fc147 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:17.737274 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7d7416a9-c260-4bff-b461-aaa71c5fc147 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:17.746415 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7d7416a9-c260-4bff-b461-aaa71c5fc147 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.086052 Sep 14 20:10:17.747256 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1319/2669] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:17 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:18.762668 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ae5b516f-49e1-4c95-a76a-900bca7bc518 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:18.763723 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ae5b516f-49e1-4c95-a76a-900bca7bc518 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:18.769929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae5b516f-49e1-4c95-a76a-900bca7bc518 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:18.770694 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae5b516f-49e1-4c95-a76a-900bca7bc518 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:18.771666 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae5b516f-49e1-4c95-a76a-900bca7bc518 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:18.773489 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ae5b516f-49e1-4c95-a76a-900bca7bc518 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:18.841620 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ae5b516f-49e1-4c95-a76a-900bca7bc518 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:18.849662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ae5b516f-49e1-4c95-a76a-900bca7bc518 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.090869 Sep 14 20:10:18.850312 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1351/2670] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:18 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:19.866467 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f76d7441-a31d-457d-a20b-9622a695620b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:19.868432 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f76d7441-a31d-457d-a20b-9622a695620b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:19.874898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f76d7441-a31d-457d-a20b-9622a695620b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:19.875342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f76d7441-a31d-457d-a20b-9622a695620b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:19.876394 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f76d7441-a31d-457d-a20b-9622a695620b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:19.877060 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f76d7441-a31d-457d-a20b-9622a695620b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:19.957665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f76d7441-a31d-457d-a20b-9622a695620b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:19.966320 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f76d7441-a31d-457d-a20b-9622a695620b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.103643 Sep 14 20:10:19.967539 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1320/2671] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:20.982089 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f4737109-1c99-470b-8ee9-eb5c6fcb9d16 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:20.982764 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f4737109-1c99-470b-8ee9-eb5c6fcb9d16 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:20.988618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4737109-1c99-470b-8ee9-eb5c6fcb9d16 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:20.989063 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4737109-1c99-470b-8ee9-eb5c6fcb9d16 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:20.989873 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4737109-1c99-470b-8ee9-eb5c6fcb9d16 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:20.990305 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4737109-1c99-470b-8ee9-eb5c6fcb9d16 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:21.059739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f4737109-1c99-470b-8ee9-eb5c6fcb9d16 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:21.072044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f4737109-1c99-470b-8ee9-eb5c6fcb9d16 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.089364 Sep 14 20:10:21.072044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1352/2672] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:20 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:22.085139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c6f04379-5361-4319-94eb-4fea0886e962 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:22.086406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c6f04379-5361-4319-94eb-4fea0886e962 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:22.092532 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6f04379-5361-4319-94eb-4fea0886e962 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:22.092926 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6f04379-5361-4319-94eb-4fea0886e962 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:22.093777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6f04379-5361-4319-94eb-4fea0886e962 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:22.094246 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c6f04379-5361-4319-94eb-4fea0886e962 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:22.197721 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c6f04379-5361-4319-94eb-4fea0886e962 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:22.206606 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c6f04379-5361-4319-94eb-4fea0886e962 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.125126 Sep 14 20:10:22.207333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1321/2673] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:22 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:23.226677 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e74c24d9-402f-4f92-8384-e05c4c8ac94b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:23.227776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e74c24d9-402f-4f92-8384-e05c4c8ac94b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:23.237616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e74c24d9-402f-4f92-8384-e05c4c8ac94b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:23.237616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e74c24d9-402f-4f92-8384-e05c4c8ac94b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:23.237865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e74c24d9-402f-4f92-8384-e05c4c8ac94b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:23.238467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e74c24d9-402f-4f92-8384-e05c4c8ac94b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:23.326868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e74c24d9-402f-4f92-8384-e05c4c8ac94b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:23.337179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e74c24d9-402f-4f92-8384-e05c4c8ac94b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.116565 Sep 14 20:10:23.337788 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1353/2674] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:23 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:24.359571 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c927e985-d0e4-4a42-af7c-e25cb92ddaa8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:24.360648 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c927e985-d0e4-4a42-af7c-e25cb92ddaa8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:24.370194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c927e985-d0e4-4a42-af7c-e25cb92ddaa8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:24.370884 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c927e985-d0e4-4a42-af7c-e25cb92ddaa8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:24.371925 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c927e985-d0e4-4a42-af7c-e25cb92ddaa8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:24.372702 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c927e985-d0e4-4a42-af7c-e25cb92ddaa8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:24.451764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c927e985-d0e4-4a42-af7c-e25cb92ddaa8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:24.459819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c927e985-d0e4-4a42-af7c-e25cb92ddaa8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.105389 Sep 14 20:10:24.460977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1322/2675] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:24 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:25.479902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cea4d966-bb11-45fd-84de-3bd3fbf74ec0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:25.480631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cea4d966-bb11-45fd-84de-3bd3fbf74ec0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:25.488671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cea4d966-bb11-45fd-84de-3bd3fbf74ec0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:25.489122 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cea4d966-bb11-45fd-84de-3bd3fbf74ec0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:25.489937 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cea4d966-bb11-45fd-84de-3bd3fbf74ec0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:25.490383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cea4d966-bb11-45fd-84de-3bd3fbf74ec0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:25.554704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-cea4d966-bb11-45fd-84de-3bd3fbf74ec0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:25.568603 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cea4d966-bb11-45fd-84de-3bd3fbf74ec0 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.093726 Sep 14 20:10:25.578079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1354/2676] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:25 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:26.586044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f8b74e02-ff51-4453-a6f1-0ab86611e3d3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:26.586653 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f8b74e02-ff51-4453-a6f1-0ab86611e3d3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:26.592608 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8b74e02-ff51-4453-a6f1-0ab86611e3d3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:26.593054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8b74e02-ff51-4453-a6f1-0ab86611e3d3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:26.593933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8b74e02-ff51-4453-a6f1-0ab86611e3d3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:26.594369 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8b74e02-ff51-4453-a6f1-0ab86611e3d3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:26.657462 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f8b74e02-ff51-4453-a6f1-0ab86611e3d3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:26.665962 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f8b74e02-ff51-4453-a6f1-0ab86611e3d3 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084109 Sep 14 20:10:26.671574 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1323/2677] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:26 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:27.690414 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-087d9f42-1338-4d8b-a094-877f4bd2193c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:27.691179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-087d9f42-1338-4d8b-a094-877f4bd2193c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:27.697130 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-087d9f42-1338-4d8b-a094-877f4bd2193c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:27.697527 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-087d9f42-1338-4d8b-a094-877f4bd2193c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:27.698325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-087d9f42-1338-4d8b-a094-877f4bd2193c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:27.698766 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-087d9f42-1338-4d8b-a094-877f4bd2193c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:27.763862 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-087d9f42-1338-4d8b-a094-877f4bd2193c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:27.772794 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-087d9f42-1338-4d8b-a094-877f4bd2193c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.085619 Sep 14 20:10:27.773388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1355/2678] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:27 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:28.915780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1ccca46c-bf64-4b38-95e8-4e173b48d242 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:28.915780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1ccca46c-bf64-4b38-95e8-4e173b48d242 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:28.915780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1ccca46c-bf64-4b38-95e8-4e173b48d242 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:28.915780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1ccca46c-bf64-4b38-95e8-4e173b48d242 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:28.918245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1ccca46c-bf64-4b38-95e8-4e173b48d242 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:28.918245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1ccca46c-bf64-4b38-95e8-4e173b48d242 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:28.918245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1ccca46c-bf64-4b38-95e8-4e173b48d242 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:28.918955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1ccca46c-bf64-4b38-95e8-4e173b48d242 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082259 Sep 14 20:10:28.918955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1324/2679] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:28 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:29.891669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-37da688d-2e18-475f-aa23-a97b11e21174 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:29.892137 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-37da688d-2e18-475f-aa23-a97b11e21174 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:29.898467 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37da688d-2e18-475f-aa23-a97b11e21174 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:29.898988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37da688d-2e18-475f-aa23-a97b11e21174 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:29.899988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37da688d-2e18-475f-aa23-a97b11e21174 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:29.900432 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-37da688d-2e18-475f-aa23-a97b11e21174 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:29.968734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-37da688d-2e18-475f-aa23-a97b11e21174 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:29.976962 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-37da688d-2e18-475f-aa23-a97b11e21174 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.092514 Sep 14 20:10:29.977558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1356/2680] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:29 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:30.993879 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b20a4771-3cbb-421a-b037-2ba82e0a9481 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:30.994487 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b20a4771-3cbb-421a-b037-2ba82e0a9481 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:31.000815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b20a4771-3cbb-421a-b037-2ba82e0a9481 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:31.001264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b20a4771-3cbb-421a-b037-2ba82e0a9481 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:31.002098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b20a4771-3cbb-421a-b037-2ba82e0a9481 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:31.002508 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b20a4771-3cbb-421a-b037-2ba82e0a9481 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:31.065043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b20a4771-3cbb-421a-b037-2ba82e0a9481 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:31.073469 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b20a4771-3cbb-421a-b037-2ba82e0a9481 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.083755 Sep 14 20:10:31.074086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1325/2681] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:30 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:32.090801 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-54bb6458-07d4-4c00-86f6-6a47a5de939c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:32.091421 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-54bb6458-07d4-4c00-86f6-6a47a5de939c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:32.097331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54bb6458-07d4-4c00-86f6-6a47a5de939c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:32.097893 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54bb6458-07d4-4c00-86f6-6a47a5de939c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:32.099259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54bb6458-07d4-4c00-86f6-6a47a5de939c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:32.100078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-54bb6458-07d4-4c00-86f6-6a47a5de939c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:32.161005 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-54bb6458-07d4-4c00-86f6-6a47a5de939c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:32.169814 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-54bb6458-07d4-4c00-86f6-6a47a5de939c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082653 Sep 14 20:10:32.170395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1357/2682] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:32 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:33.186385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3f19f20c-16d1-421f-89b0-e5cc61ec824b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:33.187018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3f19f20c-16d1-421f-89b0-e5cc61ec824b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:33.192895 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f19f20c-16d1-421f-89b0-e5cc61ec824b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:33.193326 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f19f20c-16d1-421f-89b0-e5cc61ec824b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:33.194236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f19f20c-16d1-421f-89b0-e5cc61ec824b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:33.194665 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3f19f20c-16d1-421f-89b0-e5cc61ec824b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:33.257555 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3f19f20c-16d1-421f-89b0-e5cc61ec824b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:33.270242 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3f19f20c-16d1-421f-89b0-e5cc61ec824b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.087031 Sep 14 20:10:33.271193 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1326/2683] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:33 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:34.288597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-073599d7-546d-4b8a-a52e-dc98ed528870 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:34.289208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-073599d7-546d-4b8a-a52e-dc98ed528870 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:34.295184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-073599d7-546d-4b8a-a52e-dc98ed528870 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:34.295643 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-073599d7-546d-4b8a-a52e-dc98ed528870 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:34.296426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-073599d7-546d-4b8a-a52e-dc98ed528870 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:34.296866 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-073599d7-546d-4b8a-a52e-dc98ed528870 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:34.357923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-073599d7-546d-4b8a-a52e-dc98ed528870 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:34.365891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-073599d7-546d-4b8a-a52e-dc98ed528870 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081465 Sep 14 20:10:34.366442 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1358/2684] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:34 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:35.382721 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-88746fcd-b782-4ea4-8d3f-1213e03cb65d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:35.383237 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-88746fcd-b782-4ea4-8d3f-1213e03cb65d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:35.389163 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-88746fcd-b782-4ea4-8d3f-1213e03cb65d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:35.389644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-88746fcd-b782-4ea4-8d3f-1213e03cb65d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:35.390423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-88746fcd-b782-4ea4-8d3f-1213e03cb65d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:35.390871 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-88746fcd-b782-4ea4-8d3f-1213e03cb65d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:35.453379 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-88746fcd-b782-4ea4-8d3f-1213e03cb65d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:35.461780 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-88746fcd-b782-4ea4-8d3f-1213e03cb65d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082725 Sep 14 20:10:35.462370 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1327/2685] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:35 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:36.479190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d3aa7852-fc6e-43e0-b367-8350ff9403e5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:36.479912 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d3aa7852-fc6e-43e0-b367-8350ff9403e5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:36.486354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3aa7852-fc6e-43e0-b367-8350ff9403e5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:36.486804 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3aa7852-fc6e-43e0-b367-8350ff9403e5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:36.487598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3aa7852-fc6e-43e0-b367-8350ff9403e5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:36.488030 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d3aa7852-fc6e-43e0-b367-8350ff9403e5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:36.554066 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d3aa7852-fc6e-43e0-b367-8350ff9403e5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:36.562366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d3aa7852-fc6e-43e0-b367-8350ff9403e5 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.087460 Sep 14 20:10:36.562942 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1359/2686] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:36 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:37.579082 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-69e5dc40-4911-4375-94cd-014420c7e112 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:37.579792 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-69e5dc40-4911-4375-94cd-014420c7e112 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:37.586632 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-69e5dc40-4911-4375-94cd-014420c7e112 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:37.587079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-69e5dc40-4911-4375-94cd-014420c7e112 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:37.587921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-69e5dc40-4911-4375-94cd-014420c7e112 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:37.588300 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-69e5dc40-4911-4375-94cd-014420c7e112 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:37.651764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-69e5dc40-4911-4375-94cd-014420c7e112 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:37.660315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-69e5dc40-4911-4375-94cd-014420c7e112 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084896 Sep 14 20:10:37.660904 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1328/2687] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:37 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:38.679386 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d9db71ff-d9c6-40e4-80d5-bfcfb8f8c17a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:38.680006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d9db71ff-d9c6-40e4-80d5-bfcfb8f8c17a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:38.687964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9db71ff-d9c6-40e4-80d5-bfcfb8f8c17a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:38.687964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9db71ff-d9c6-40e4-80d5-bfcfb8f8c17a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:38.687964 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9db71ff-d9c6-40e4-80d5-bfcfb8f8c17a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:38.688213 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d9db71ff-d9c6-40e4-80d5-bfcfb8f8c17a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:38.752448 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d9db71ff-d9c6-40e4-80d5-bfcfb8f8c17a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:38.760458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d9db71ff-d9c6-40e4-80d5-bfcfb8f8c17a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.085615 Sep 14 20:10:38.761025 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1360/2688] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:38 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:39.777024 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1b5ead8a-dbbc-4789-9ec4-fd5798887061 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:39.777664 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1b5ead8a-dbbc-4789-9ec4-fd5798887061 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:39.783502 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b5ead8a-dbbc-4789-9ec4-fd5798887061 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:39.783945 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b5ead8a-dbbc-4789-9ec4-fd5798887061 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:39.784874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b5ead8a-dbbc-4789-9ec4-fd5798887061 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:39.785307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1b5ead8a-dbbc-4789-9ec4-fd5798887061 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:39.851551 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-1b5ead8a-dbbc-4789-9ec4-fd5798887061 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:39.859562 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1b5ead8a-dbbc-4789-9ec4-fd5798887061 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.086067 Sep 14 20:10:39.860146 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1329/2689] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:39 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:40.876212 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5a26d74c-1fe4-4dc1-9a91-05f1a41dfc9f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:40.876817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5a26d74c-1fe4-4dc1-9a91-05f1a41dfc9f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:40.882952 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a26d74c-1fe4-4dc1-9a91-05f1a41dfc9f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:40.883402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a26d74c-1fe4-4dc1-9a91-05f1a41dfc9f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:40.884189 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a26d74c-1fe4-4dc1-9a91-05f1a41dfc9f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:40.884674 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5a26d74c-1fe4-4dc1-9a91-05f1a41dfc9f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:40.947043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-5a26d74c-1fe4-4dc1-9a91-05f1a41dfc9f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:40.955362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5a26d74c-1fe4-4dc1-9a91-05f1a41dfc9f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082881 Sep 14 20:10:40.955947 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1361/2690] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:40 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:41.972661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-628205de-b9a0-4b67-ae6b-90c3be00e9f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:41.973177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-628205de-b9a0-4b67-ae6b-90c3be00e9f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:41.979393 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-628205de-b9a0-4b67-ae6b-90c3be00e9f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:41.979829 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-628205de-b9a0-4b67-ae6b-90c3be00e9f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:41.980594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-628205de-b9a0-4b67-ae6b-90c3be00e9f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:41.981124 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-628205de-b9a0-4b67-ae6b-90c3be00e9f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:42.043061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-628205de-b9a0-4b67-ae6b-90c3be00e9f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:42.051347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-628205de-b9a0-4b67-ae6b-90c3be00e9f9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082276 Sep 14 20:10:42.051928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1330/2691] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:41 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:43.068644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3249bb6c-5ae7-44e9-aa98-86bef7a6b6ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:43.069197 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3249bb6c-5ae7-44e9-aa98-86bef7a6b6ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:43.076332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3249bb6c-5ae7-44e9-aa98-86bef7a6b6ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:43.076902 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3249bb6c-5ae7-44e9-aa98-86bef7a6b6ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:43.077817 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3249bb6c-5ae7-44e9-aa98-86bef7a6b6ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:43.078307 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3249bb6c-5ae7-44e9-aa98-86bef7a6b6ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:43.145628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3249bb6c-5ae7-44e9-aa98-86bef7a6b6ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:43.154454 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3249bb6c-5ae7-44e9-aa98-86bef7a6b6ea tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.089699 Sep 14 20:10:43.155207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1362/2692] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:43 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:44.172414 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-17061be7-9aac-4efe-944a-4aafd2beff8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:44.173155 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-17061be7-9aac-4efe-944a-4aafd2beff8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:44.180247 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-17061be7-9aac-4efe-944a-4aafd2beff8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:44.180764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-17061be7-9aac-4efe-944a-4aafd2beff8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:44.181644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-17061be7-9aac-4efe-944a-4aafd2beff8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:44.182130 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-17061be7-9aac-4efe-944a-4aafd2beff8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:44.246463 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-17061be7-9aac-4efe-944a-4aafd2beff8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:44.255112 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-17061be7-9aac-4efe-944a-4aafd2beff8e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.086345 Sep 14 20:10:44.255709 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1331/2693] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:44 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:45.272669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-adc2fe22-a554-44e4-8059-26bfff96d18e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:45.273458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-adc2fe22-a554-44e4-8059-26bfff96d18e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:45.279694 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adc2fe22-a554-44e4-8059-26bfff96d18e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:45.280156 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adc2fe22-a554-44e4-8059-26bfff96d18e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:45.280963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adc2fe22-a554-44e4-8059-26bfff96d18e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:45.281406 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-adc2fe22-a554-44e4-8059-26bfff96d18e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:45.362368 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-adc2fe22-a554-44e4-8059-26bfff96d18e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:45.371348 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-adc2fe22-a554-44e4-8059-26bfff96d18e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.102694 Sep 14 20:10:45.371928 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1363/2694] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:45 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:46.386043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 20:10:46.389310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-23653a88-a931-444d-bf0d-b31efa02504d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:46.389939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-23653a88-a931-444d-bf0d-b31efa02504d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:46.396299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23653a88-a931-444d-bf0d-b31efa02504d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:46.397243 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23653a88-a931-444d-bf0d-b31efa02504d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:46.398079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23653a88-a931-444d-bf0d-b31efa02504d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:46.398516 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-23653a88-a931-444d-bf0d-b31efa02504d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:46.486604 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-23653a88-a931-444d-bf0d-b31efa02504d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:46.494922 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-23653a88-a931-444d-bf0d-b31efa02504d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.110143 Sep 14 20:10:46.495518 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1332/2695] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:46 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:47.512326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f606e437-4ba1-48ba-8b61-7129d4f9566b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:47.513009 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f606e437-4ba1-48ba-8b61-7129d4f9566b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:47.519107 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f606e437-4ba1-48ba-8b61-7129d4f9566b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:47.519558 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f606e437-4ba1-48ba-8b61-7129d4f9566b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:47.520350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f606e437-4ba1-48ba-8b61-7129d4f9566b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:47.520792 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f606e437-4ba1-48ba-8b61-7129d4f9566b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:47.583756 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f606e437-4ba1-48ba-8b61-7129d4f9566b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:47.592916 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f606e437-4ba1-48ba-8b61-7129d4f9566b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084222 Sep 14 20:10:47.593535 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1364/2696] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:47 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:48.610623 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-423da8af-7e62-4ac4-b7b3-d31773566434 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:48.611268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-423da8af-7e62-4ac4-b7b3-d31773566434 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:48.636579 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 40282. Sep 14 20:10:48.638357 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-423da8af-7e62-4ac4-b7b3-d31773566434 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:48.638809 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-423da8af-7e62-4ac4-b7b3-d31773566434 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:48.639595 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-423da8af-7e62-4ac4-b7b3-d31773566434 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:48.640027 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-423da8af-7e62-4ac4-b7b3-d31773566434 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:48.719158 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-423da8af-7e62-4ac4-b7b3-d31773566434 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:48.728122 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-423da8af-7e62-4ac4-b7b3-d31773566434 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.121362 Sep 14 20:10:48.728761 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1333/2697] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:48 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:49.745979 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6002b901-b552-43e0-978b-8910ee907e90 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:49.746765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6002b901-b552-43e0-978b-8910ee907e90 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:49.752838 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6002b901-b552-43e0-978b-8910ee907e90 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:49.753287 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6002b901-b552-43e0-978b-8910ee907e90 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:49.754090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6002b901-b552-43e0-978b-8910ee907e90 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:49.754534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6002b901-b552-43e0-978b-8910ee907e90 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:49.819932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6002b901-b552-43e0-978b-8910ee907e90 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:49.828182 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6002b901-b552-43e0-978b-8910ee907e90 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.086635 Sep 14 20:10:49.828781 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1365/2698] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:49 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:50.848255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ca2eeec8-3958-47f7-a111-ace77ed5efaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:50.848877 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ca2eeec8-3958-47f7-a111-ace77ed5efaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:50.855764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca2eeec8-3958-47f7-a111-ace77ed5efaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:50.856208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca2eeec8-3958-47f7-a111-ace77ed5efaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:50.856988 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca2eeec8-3958-47f7-a111-ace77ed5efaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:50.857419 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ca2eeec8-3958-47f7-a111-ace77ed5efaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:50.936044 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ca2eeec8-3958-47f7-a111-ace77ed5efaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:50.945295 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ca2eeec8-3958-47f7-a111-ace77ed5efaf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.103109 Sep 14 20:10:50.945927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1334/2699] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:50 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:51.962310 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3928b26f-11f0-44e4-aac4-0a7682adb8a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:51.962920 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3928b26f-11f0-44e4-aac4-0a7682adb8a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:51.969094 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3928b26f-11f0-44e4-aac4-0a7682adb8a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:51.969566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3928b26f-11f0-44e4-aac4-0a7682adb8a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:51.970383 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3928b26f-11f0-44e4-aac4-0a7682adb8a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:51.970842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3928b26f-11f0-44e4-aac4-0a7682adb8a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:52.054965 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3928b26f-11f0-44e4-aac4-0a7682adb8a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:52.063590 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3928b26f-11f0-44e4-aac4-0a7682adb8a8 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.104880 Sep 14 20:10:52.064176 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1366/2700] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:51 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:53.080662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8c54aebe-5c44-4f62-ab62-629d0a6daa2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:53.081198 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8c54aebe-5c44-4f62-ab62-629d0a6daa2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:53.087898 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c54aebe-5c44-4f62-ab62-629d0a6daa2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:53.093054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c54aebe-5c44-4f62-ab62-629d0a6daa2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:53.093054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c54aebe-5c44-4f62-ab62-629d0a6daa2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:53.093054 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8c54aebe-5c44-4f62-ab62-629d0a6daa2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:53.157644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8c54aebe-5c44-4f62-ab62-629d0a6daa2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:53.165882 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8c54aebe-5c44-4f62-ab62-629d0a6daa2b tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.088959 Sep 14 20:10:53.166455 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1335/2701] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:53 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:54.183252 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b390de16-756c-46bb-aaf4-b3966419b51e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:54.183875 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b390de16-756c-46bb-aaf4-b3966419b51e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:54.190179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b390de16-756c-46bb-aaf4-b3966419b51e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:54.190631 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b390de16-756c-46bb-aaf4-b3966419b51e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:54.191411 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b390de16-756c-46bb-aaf4-b3966419b51e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:54.191846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b390de16-756c-46bb-aaf4-b3966419b51e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:54.254633 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b390de16-756c-46bb-aaf4-b3966419b51e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:54.263387 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b390de16-756c-46bb-aaf4-b3966419b51e tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.083752 Sep 14 20:10:54.263962 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1367/2702] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:54 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:55.285202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4e3e2e9c-a2f0-4edb-bb2e-e9222c323e1f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:55.285866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4e3e2e9c-a2f0-4edb-bb2e-e9222c323e1f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:55.294612 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e3e2e9c-a2f0-4edb-bb2e-e9222c323e1f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:55.295142 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e3e2e9c-a2f0-4edb-bb2e-e9222c323e1f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:55.295943 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e3e2e9c-a2f0-4edb-bb2e-e9222c323e1f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:55.296387 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e3e2e9c-a2f0-4edb-bb2e-e9222c323e1f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:55.359907 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4e3e2e9c-a2f0-4edb-bb2e-e9222c323e1f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:55.368624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4e3e2e9c-a2f0-4edb-bb2e-e9222c323e1f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.087144 Sep 14 20:10:55.369214 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1336/2703] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:55 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:56.385300 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e61c3999-1fc2-4dc5-855d-6c99c032dbc7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:56.386193 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e61c3999-1fc2-4dc5-855d-6c99c032dbc7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:56.391712 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e61c3999-1fc2-4dc5-855d-6c99c032dbc7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:56.392152 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e61c3999-1fc2-4dc5-855d-6c99c032dbc7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:56.392908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e61c3999-1fc2-4dc5-855d-6c99c032dbc7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:56.393336 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e61c3999-1fc2-4dc5-855d-6c99c032dbc7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:56.456960 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e61c3999-1fc2-4dc5-855d-6c99c032dbc7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:56.464760 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e61c3999-1fc2-4dc5-855d-6c99c032dbc7 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.083147 Sep 14 20:10:56.465316 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1368/2704] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:56 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:57.480351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d89485cb-b0aa-44e1-9257-50c21458d447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:57.480992 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d89485cb-b0aa-44e1-9257-50c21458d447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:57.486876 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d89485cb-b0aa-44e1-9257-50c21458d447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:57.487328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d89485cb-b0aa-44e1-9257-50c21458d447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:57.488087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d89485cb-b0aa-44e1-9257-50c21458d447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:57.488519 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d89485cb-b0aa-44e1-9257-50c21458d447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:57.548903 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d89485cb-b0aa-44e1-9257-50c21458d447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:57.557727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d89485cb-b0aa-44e1-9257-50c21458d447 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.080947 Sep 14 20:10:57.561061 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1337/2705] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:57 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:58.576299 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2a7bc441-3239-41aa-9af9-f784f0efd7ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:58.584325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-2a7bc441-3239-41aa-9af9-f784f0efd7ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:58.584325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a7bc441-3239-41aa-9af9-f784f0efd7ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:58.584325 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a7bc441-3239-41aa-9af9-f784f0efd7ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:58.585045 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a7bc441-3239-41aa-9af9-f784f0efd7ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:58.585516 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-2a7bc441-3239-41aa-9af9-f784f0efd7ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:58.648079 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-2a7bc441-3239-41aa-9af9-f784f0efd7ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:58.660675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2a7bc441-3239-41aa-9af9-f784f0efd7ec tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.087858 Sep 14 20:10:58.669651 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1369/2706] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:58 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:10:59.677194 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4e8e5d18-49ff-406b-a8e8-e69465cb7d81 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:10:59.678478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4e8e5d18-49ff-406b-a8e8-e69465cb7d81 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:10:59.684175 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e8e5d18-49ff-406b-a8e8-e69465cb7d81 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:59.684610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e8e5d18-49ff-406b-a8e8-e69465cb7d81 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:59.685366 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e8e5d18-49ff-406b-a8e8-e69465cb7d81 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:10:59.685815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e8e5d18-49ff-406b-a8e8-e69465cb7d81 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:10:59.744939 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4e8e5d18-49ff-406b-a8e8-e69465cb7d81 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:10:59.752501 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4e8e5d18-49ff-406b-a8e8-e69465cb7d81 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.079264 Sep 14 20:10:59.753057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1338/2707] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:10:59 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:00.772297 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e3fa48b6-90be-4ea6-9483-e5b9ac0fe05d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:00.773464 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-e3fa48b6-90be-4ea6-9483-e5b9ac0fe05d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:00.783046 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3fa48b6-90be-4ea6-9483-e5b9ac0fe05d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:00.783680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3fa48b6-90be-4ea6-9483-e5b9ac0fe05d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:00.784525 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3fa48b6-90be-4ea6-9483-e5b9ac0fe05d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:00.785032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-e3fa48b6-90be-4ea6-9483-e5b9ac0fe05d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:00.867147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-e3fa48b6-90be-4ea6-9483-e5b9ac0fe05d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:00.879887 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e3fa48b6-90be-4ea6-9483-e5b9ac0fe05d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.114399 Sep 14 20:11:00.880584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1370/2708] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:00 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:01.899762 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ecd38b98-a098-4afd-8dcf-61d8761c4d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:01.900418 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ecd38b98-a098-4afd-8dcf-61d8761c4d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:01.907641 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecd38b98-a098-4afd-8dcf-61d8761c4d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:01.908219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecd38b98-a098-4afd-8dcf-61d8761c4d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:01.909104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecd38b98-a098-4afd-8dcf-61d8761c4d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:01.909778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ecd38b98-a098-4afd-8dcf-61d8761c4d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:01.983777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ecd38b98-a098-4afd-8dcf-61d8761c4d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:01.992954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ecd38b98-a098-4afd-8dcf-61d8761c4d5f tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.099092 Sep 14 20:11:02.002582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1339/2709] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:01 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:03.009635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-af2d7954-e71c-4981-b0ce-ef8a0ed65e67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:03.010279 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-af2d7954-e71c-4981-b0ce-ef8a0ed65e67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:03.016225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-af2d7954-e71c-4981-b0ce-ef8a0ed65e67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:03.016669 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-af2d7954-e71c-4981-b0ce-ef8a0ed65e67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:03.017452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-af2d7954-e71c-4981-b0ce-ef8a0ed65e67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:03.017908 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-af2d7954-e71c-4981-b0ce-ef8a0ed65e67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:03.087598 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-af2d7954-e71c-4981-b0ce-ef8a0ed65e67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:03.095704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-af2d7954-e71c-4981-b0ce-ef8a0ed65e67 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.089571 Sep 14 20:11:03.096203 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1371/2710] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:03 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:04.112655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-eedf6497-de48-4c45-acfd-809305c90658 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:04.113331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-eedf6497-de48-4c45-acfd-809305c90658 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:04.120523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eedf6497-de48-4c45-acfd-809305c90658 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:04.120977 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eedf6497-de48-4c45-acfd-809305c90658 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:04.121777 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eedf6497-de48-4c45-acfd-809305c90658 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:04.122217 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-eedf6497-de48-4c45-acfd-809305c90658 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:04.182982 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-eedf6497-de48-4c45-acfd-809305c90658 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:04.191018 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-eedf6497-de48-4c45-acfd-809305c90658 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082698 Sep 14 20:11:04.191600 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1340/2711] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:04 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:05.207608 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c1c7aaf6-6b71-4dac-b119-caa9a0b45d73 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:05.208722 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c1c7aaf6-6b71-4dac-b119-caa9a0b45d73 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:05.214613 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c7aaf6-6b71-4dac-b119-caa9a0b45d73 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:05.215069 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c7aaf6-6b71-4dac-b119-caa9a0b45d73 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:05.215837 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c7aaf6-6b71-4dac-b119-caa9a0b45d73 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:05.216268 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c1c7aaf6-6b71-4dac-b119-caa9a0b45d73 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:05.277795 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c1c7aaf6-6b71-4dac-b119-caa9a0b45d73 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:05.287588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c1c7aaf6-6b71-4dac-b119-caa9a0b45d73 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.083645 Sep 14 20:11:05.288163 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1372/2712] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:05 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:06.304693 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d1f8bde0-0ae9-472e-a12d-dd21100b289d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:06.305299 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d1f8bde0-0ae9-472e-a12d-dd21100b289d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:06.311172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1f8bde0-0ae9-472e-a12d-dd21100b289d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:06.311614 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1f8bde0-0ae9-472e-a12d-dd21100b289d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:06.312368 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1f8bde0-0ae9-472e-a12d-dd21100b289d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:06.312798 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d1f8bde0-0ae9-472e-a12d-dd21100b289d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:06.376539 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d1f8bde0-0ae9-472e-a12d-dd21100b289d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:06.384868 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d1f8bde0-0ae9-472e-a12d-dd21100b289d tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084918 Sep 14 20:11:06.385461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1341/2713] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:06 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:07.403259 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-83675e54-5986-4c74-8cec-743209fa608a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:07.404243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-83675e54-5986-4c74-8cec-743209fa608a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:07.410560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83675e54-5986-4c74-8cec-743209fa608a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:07.411015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83675e54-5986-4c74-8cec-743209fa608a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:07.411802 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83675e54-5986-4c74-8cec-743209fa608a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:07.412276 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-83675e54-5986-4c74-8cec-743209fa608a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:07.490994 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-83675e54-5986-4c74-8cec-743209fa608a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:07.498986 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-83675e54-5986-4c74-8cec-743209fa608a tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.099600 Sep 14 20:11:07.499592 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1373/2714] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:07 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:08.515031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-7dc3775f-c33b-41bf-853c-4cd442592fc1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:08.515705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-7dc3775f-c33b-41bf-853c-4cd442592fc1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:08.522333 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7dc3775f-c33b-41bf-853c-4cd442592fc1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:08.522818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7dc3775f-c33b-41bf-853c-4cd442592fc1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:08.523706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7dc3775f-c33b-41bf-853c-4cd442592fc1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:08.524161 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-7dc3775f-c33b-41bf-853c-4cd442592fc1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:08.591995 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-7dc3775f-c33b-41bf-853c-4cd442592fc1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:08.600911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-7dc3775f-c33b-41bf-853c-4cd442592fc1 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.089288 Sep 14 20:11:08.614218 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1342/2715] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:08 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:09.628574 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-785114a9-474e-4411-981e-ba1696da6895 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:09.629266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-785114a9-474e-4411-981e-ba1696da6895 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:09.635727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-785114a9-474e-4411-981e-ba1696da6895 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:09.636178 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-785114a9-474e-4411-981e-ba1696da6895 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:09.636949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-785114a9-474e-4411-981e-ba1696da6895 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:09.637395 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-785114a9-474e-4411-981e-ba1696da6895 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:09.700043 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-785114a9-474e-4411-981e-ba1696da6895 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:09.707880 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-785114a9-474e-4411-981e-ba1696da6895 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.083466 Sep 14 20:11:09.708443 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1374/2716] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:09 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:10.724154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3be98f75-b19b-4cb0-ab1b-68bd18c8d23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:10.724766 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3be98f75-b19b-4cb0-ab1b-68bd18c8d23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:10.730557 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3be98f75-b19b-4cb0-ab1b-68bd18c8d23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:10.730985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3be98f75-b19b-4cb0-ab1b-68bd18c8d23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:10.731782 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3be98f75-b19b-4cb0-ab1b-68bd18c8d23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:10.732222 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3be98f75-b19b-4cb0-ab1b-68bd18c8d23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:10.791902 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3be98f75-b19b-4cb0-ab1b-68bd18c8d23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:10.799985 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3be98f75-b19b-4cb0-ab1b-68bd18c8d23c tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.079450 Sep 14 20:11:10.800552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1343/2717] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:10 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:11.815824 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d6732f3c-df16-4775-961f-e91492b8ee74 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:11.816439 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d6732f3c-df16-4775-961f-e91492b8ee74 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:11.822519 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6732f3c-df16-4775-961f-e91492b8ee74 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:11.822970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6732f3c-df16-4775-961f-e91492b8ee74 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:11.823737 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6732f3c-df16-4775-961f-e91492b8ee74 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:11.824178 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6732f3c-df16-4775-961f-e91492b8ee74 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:11.887733 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d6732f3c-df16-4775-961f-e91492b8ee74 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:11.895365 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d6732f3c-df16-4775-961f-e91492b8ee74 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.083168 Sep 14 20:11:11.895932 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1375/2718] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:11 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:12.913253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-07e06066-6e15-43e4-affc-c5702d3422bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:12.913897 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-07e06066-6e15-43e4-affc-c5702d3422bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:12.919848 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-07e06066-6e15-43e4-affc-c5702d3422bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:12.920315 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-07e06066-6e15-43e4-affc-c5702d3422bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:12.921087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-07e06066-6e15-43e4-affc-c5702d3422bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:12.921545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-07e06066-6e15-43e4-affc-c5702d3422bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:12.982513 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-07e06066-6e15-43e4-affc-c5702d3422bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:12.991303 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-07e06066-6e15-43e4-affc-c5702d3422bd tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.081691 Sep 14 20:11:12.991805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1344/2719] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:12 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:14.008475 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-a30772d5-0c07-4a67-83cf-31dffa90f6f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:14.009070 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-a30772d5-0c07-4a67-83cf-31dffa90f6f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:14.015004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a30772d5-0c07-4a67-83cf-31dffa90f6f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:14.015449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a30772d5-0c07-4a67-83cf-31dffa90f6f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:14.016213 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a30772d5-0c07-4a67-83cf-31dffa90f6f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:14.016647 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-a30772d5-0c07-4a67-83cf-31dffa90f6f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:14.078735 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-a30772d5-0c07-4a67-83cf-31dffa90f6f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:14.086855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-a30772d5-0c07-4a67-83cf-31dffa90f6f2 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.082479 Sep 14 20:11:14.087440 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1376/2720] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:14 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:15.103176 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6f52f922-4849-417a-bc93-75039d551059 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:15.103823 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6f52f922-4849-417a-bc93-75039d551059 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:15.111070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f52f922-4849-417a-bc93-75039d551059 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:15.111591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f52f922-4849-417a-bc93-75039d551059 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:15.112582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f52f922-4849-417a-bc93-75039d551059 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:15.113152 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6f52f922-4849-417a-bc93-75039d551059 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:15.176102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6f52f922-4849-417a-bc93-75039d551059 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:15.184759 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6f52f922-4849-417a-bc93-75039d551059 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.085389 Sep 14 20:11:15.185334 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1345/2721] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:15 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:16.202001 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-13e4e76c-8c21-409a-86a5-db68769c2db9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:16.202619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-13e4e76c-8c21-409a-86a5-db68769c2db9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:16.208426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13e4e76c-8c21-409a-86a5-db68769c2db9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:16.210595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13e4e76c-8c21-409a-86a5-db68769c2db9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:16.210595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13e4e76c-8c21-409a-86a5-db68769c2db9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:16.210767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-13e4e76c-8c21-409a-86a5-db68769c2db9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:16.275445 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-13e4e76c-8c21-409a-86a5-db68769c2db9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:16.286882 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-13e4e76c-8c21-409a-86a5-db68769c2db9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.088483 Sep 14 20:11:16.288291 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1377/2722] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:16 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:17.304772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-6c448ba5-3a4a-4695-a5f2-5583109139a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:17.305382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-6c448ba5-3a4a-4695-a5f2-5583109139a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:17.311581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6c448ba5-3a4a-4695-a5f2-5583109139a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:17.312024 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6c448ba5-3a4a-4695-a5f2-5583109139a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:17.312800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6c448ba5-3a4a-4695-a5f2-5583109139a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:17.313233 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-6c448ba5-3a4a-4695-a5f2-5583109139a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:17.375880 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-6c448ba5-3a4a-4695-a5f2-5583109139a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:17.384507 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-6c448ba5-3a4a-4695-a5f2-5583109139a9 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.083616 Sep 14 20:11:17.385075 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1346/2723] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:17 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:18.401524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-b0d368a8-9e78-43fd-a883-2e0afecbcadf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:18.402142 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-b0d368a8-9e78-43fd-a883-2e0afecbcadf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:18.415115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0d368a8-9e78-43fd-a883-2e0afecbcadf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:18.415115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0d368a8-9e78-43fd-a883-2e0afecbcadf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:18.415115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0d368a8-9e78-43fd-a883-2e0afecbcadf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:18.415115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-b0d368a8-9e78-43fd-a883-2e0afecbcadf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:18.473619 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-b0d368a8-9e78-43fd-a883-2e0afecbcadf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a700c999f2d4e79a1172c08f2cd49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbe7998841742abab1d80b084f6be1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:18.482165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-b0d368a8-9e78-43fd-a883-2e0afecbcadf tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 200 len: 1353 microversion: 2.1 time: 0.084774 Sep 14 20:11:18.482745 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1378/2724] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:18 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:19.498853 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-06654fe1-ef56-4c1d-a258-37f499a8f2e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:19.499581 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-06654fe1-ef56-4c1d-a258-37f499a8f2e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] [instance: 0b9185a2-5afd-4c39-bb28-beb531d58eb0] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:11:19.505534 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06654fe1-ef56-4c1d-a258-37f499a8f2e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:19.506022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06654fe1-ef56-4c1d-a258-37f499a8f2e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:19.507384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06654fe1-ef56-4c1d-a258-37f499a8f2e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:11:19.507816 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-06654fe1-ef56-4c1d-a258-37f499a8f2e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:11:19.521594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-06654fe1-ef56-4c1d-a258-37f499a8f2e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] HTTP exception thrown: Instance 0b9185a2-5afd-4c39-bb28-beb531d58eb0 could not be found. Sep 14 20:11:19.522219 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-06654fe1-ef56-4c1d-a258-37f499a8f2e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] Returning 404 to user: Instance 0b9185a2-5afd-4c39-bb28-beb531d58eb0 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:11:19.523094 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-06654fe1-ef56-4c1d-a258-37f499a8f2e6 tempest-ServerRescueNegativeTestJSON-1214568309 tempest-ServerRescueNegativeTestJSON-1214568309-project] 10.222.0.58 "GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0" status: 404 len: 111 microversion: 2.1 time: 0.028257 Sep 14 20:11:19.523647 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1347/2725] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:11:19 2021] GET /compute/v2.1/servers/0b9185a2-5afd-4c39-bb28-beb531d58eb0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:12:00.438618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:12:00.439194 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:12:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:12:06.319891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7598ae44-5bdd-4f3c-ab4f-e444edde8bf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:12:06.320555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7598ae44-5bdd-4f3c-ab4f-e444edde8bf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:12:06.322784 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 20:12:06.327260 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7598ae44-5bdd-4f3c-ab4f-e444edde8bf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:06.327717 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7598ae44-5bdd-4f3c-ab4f-e444edde8bf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:06.328484 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7598ae44-5bdd-4f3c-ab4f-e444edde8bf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:06.328921 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7598ae44-5bdd-4f3c-ab4f-e444edde8bf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:06.353858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7598ae44-5bdd-4f3c-ab4f-e444edde8bf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Going to try to terminate instance {{(pid=115678) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 20:12:06.637165 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7598ae44-5bdd-4f3c-ab4f-e444edde8bf2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "DELETE /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 204 len: 0 microversion: 2.1 time: 0.321369 Sep 14 20:12:06.637810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1379/2726] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:12:06 2021] DELETE /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:12:06.645680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ce3ae452-0a88-4658-9380-d2a9dcf24ba3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:12:06.646287 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ce3ae452-0a88-4658-9380-d2a9dcf24ba3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:12:06.652556 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce3ae452-0a88-4658-9380-d2a9dcf24ba3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:06.652997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce3ae452-0a88-4658-9380-d2a9dcf24ba3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:06.653800 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce3ae452-0a88-4658-9380-d2a9dcf24ba3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:06.654231 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce3ae452-0a88-4658-9380-d2a9dcf24ba3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:06.776392 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ce3ae452-0a88-4658-9380-d2a9dcf24ba3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:12:06.783624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ce3ae452-0a88-4658-9380-d2a9dcf24ba3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1515 microversion: 2.1 time: 0.141623 Sep 14 20:12:06.784217 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1348/2727] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:12:06 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1515 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:12:07.584596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-5073c119-738a-4d0c-9098-bb50dc1979ae req-7c130a4e-a4d7-4e23-ac2b-d6d54b15860d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a4a9d3-a4e1-47ad-af23-b7b3b9445f03", "name": "network-vif-deleted", "tag": "9de31650-de64-4bf5-b67f-0fe7fe3c2861"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:12:07.586131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:12:07.586131 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 20:12:07.607970 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 41174. Sep 14 20:12:07.612715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-5073c119-738a-4d0c-9098-bb50dc1979ae req-7c130a4e-a4d7-4e23-ac2b-d6d54b15860d service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:07.613155 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-5073c119-738a-4d0c-9098-bb50dc1979ae req-7c130a4e-a4d7-4e23-ac2b-d6d54b15860d service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:07.625584 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-5073c119-738a-4d0c-9098-bb50dc1979ae req-7c130a4e-a4d7-4e23-ac2b-d6d54b15860d service nova] Creating event network-vif-deleted:9de31650-de64-4bf5-b67f-0fe7fe3c2861 for instance 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 on hv-cinder-80588 Sep 14 20:12:07.635121 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-5073c119-738a-4d0c-9098-bb50dc1979ae req-7c130a4e-a4d7-4e23-ac2b-d6d54b15860d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050828 Sep 14 20:12:07.635121 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1380/2728] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:12:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:12:07.800117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ac2a9ce0-7756-436d-a229-ceb112faa421 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:12:07.800654 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ac2a9ce0-7756-436d-a229-ceb112faa421 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:12:07.807365 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac2a9ce0-7756-436d-a229-ceb112faa421 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:07.816015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac2a9ce0-7756-436d-a229-ceb112faa421 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:07.816015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac2a9ce0-7756-436d-a229-ceb112faa421 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:07.816015 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ac2a9ce0-7756-436d-a229-ceb112faa421 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:07.872328 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ac2a9ce0-7756-436d-a229-ceb112faa421 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:12:07.880102 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ac2a9ce0-7756-436d-a229-ceb112faa421 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 200 len: 1303 microversion: 2.1 time: 0.083723 Sep 14 20:12:07.881284 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1349/2729] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:12:07 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:12:08.898144 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-204c12b1-3f6b-4334-9656-7200f0a9c955 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:12:08.898840 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-204c12b1-3f6b-4334-9656-7200f0a9c955 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:12:08.904818 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-204c12b1-3f6b-4334-9656-7200f0a9c955 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:08.905247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-204c12b1-3f6b-4334-9656-7200f0a9c955 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:08.906031 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-204c12b1-3f6b-4334-9656-7200f0a9c955 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:08.906468 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-204c12b1-3f6b-4334-9656-7200f0a9c955 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:08.919191 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-204c12b1-3f6b-4334-9656-7200f0a9c955 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] HTTP exception thrown: Instance 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 could not be found. Sep 14 20:12:08.919783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-204c12b1-3f6b-4334-9656-7200f0a9c955 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Returning 404 to user: Instance 63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:12:08.920597 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-204c12b1-3f6b-4334-9656-7200f0a9c955 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03" status: 404 len: 111 microversion: 2.1 time: 0.027089 Sep 14 20:12:08.921119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1381/2730] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:12:08 2021] GET /compute/v2.1/servers/63a4a9d3-a4e1-47ad-af23-b7b3b9445f03 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:12:08.929077 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9ff475ad-86db-4296-a096-741d3f1620d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:12:08.929627 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9ff475ad-86db-4296-a096-741d3f1620d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:12:08.935322 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ff475ad-86db-4296-a096-741d3f1620d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:08.935773 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ff475ad-86db-4296-a096-741d3f1620d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:08.936552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ff475ad-86db-4296-a096-741d3f1620d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:08.936987 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ff475ad-86db-4296-a096-741d3f1620d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:08.968706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9ff475ad-86db-4296-a096-741d3f1620d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Going to try to terminate instance {{(pid=115679) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 20:12:09.197026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9ff475ad-86db-4296-a096-741d3f1620d9 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "DELETE /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 204 len: 0 microversion: 2.1 time: 0.271537 Sep 14 20:12:09.197690 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1350/2731] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:12:08 2021] DELETE /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:12:09.205373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d6d5279d-159e-49d6-a9b1-9ba55e29e0e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:12:09.206020 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d6d5279d-159e-49d6-a9b1-9ba55e29e0e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:12:09.212098 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6d5279d-159e-49d6-a9b1-9ba55e29e0e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:09.212583 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6d5279d-159e-49d6-a9b1-9ba55e29e0e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:09.213352 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6d5279d-159e-49d6-a9b1-9ba55e29e0e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:09.214065 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d6d5279d-159e-49d6-a9b1-9ba55e29e0e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:09.339811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d6d5279d-159e-49d6-a9b1-9ba55e29e0e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:12:09.347115 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d6d5279d-159e-49d6-a9b1-9ba55e29e0e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1515 microversion: 2.1 time: 0.145437 Sep 14 20:12:09.347697 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1382/2732] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:12:09 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:12:10.211911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-1f0f1a16-10bd-4faf-b63c-9ab0fcbf4269 req-3a3adff3-1ead-4dd6-aa6e-14f6555e7467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44d453d4-8637-4162-94d2-835dcd3e4990", "name": "network-vif-deleted", "tag": "13411508-b65f-4a95-834a-741874266297"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:12:10.213460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:12:10.213460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:12:10.220444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-1f0f1a16-10bd-4faf-b63c-9ab0fcbf4269 req-3a3adff3-1ead-4dd6-aa6e-14f6555e7467 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:10.220894 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-1f0f1a16-10bd-4faf-b63c-9ab0fcbf4269 req-3a3adff3-1ead-4dd6-aa6e-14f6555e7467 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:10.232423 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-1f0f1a16-10bd-4faf-b63c-9ab0fcbf4269 req-3a3adff3-1ead-4dd6-aa6e-14f6555e7467 service nova] Creating event network-vif-deleted:13411508-b65f-4a95-834a-741874266297 for instance 44d453d4-8637-4162-94d2-835dcd3e4990 on hv-cinder-80588 Sep 14 20:12:10.237377 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-1f0f1a16-10bd-4faf-b63c-9ab0fcbf4269 req-3a3adff3-1ead-4dd6-aa6e-14f6555e7467 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030001 Sep 14 20:12:10.238115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1351/2733] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:12:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:12:10.363912 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-36b27202-444d-4247-83a7-4b734a7ea7c2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:12:10.364354 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-36b27202-444d-4247-83a7-4b734a7ea7c2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:12:10.370731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36b27202-444d-4247-83a7-4b734a7ea7c2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:10.371176 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36b27202-444d-4247-83a7-4b734a7ea7c2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:10.371934 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36b27202-444d-4247-83a7-4b734a7ea7c2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:10.372366 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-36b27202-444d-4247-83a7-4b734a7ea7c2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:10.431326 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-36b27202-444d-4247-83a7-4b734a7ea7c2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:12:10.438524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-36b27202-444d-4247-83a7-4b734a7ea7c2 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 200 len: 1303 microversion: 2.1 time: 0.078583 Sep 14 20:12:10.439078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1383/2734] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:12:10 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 1303 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:12:11.456162 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8884316a-72e2-42cf-9197-c718bafd54f4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:12:11.456887 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8884316a-72e2-42cf-9197-c718bafd54f4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: 44d453d4-8637-4162-94d2-835dcd3e4990] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:12:11.463022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8884316a-72e2-42cf-9197-c718bafd54f4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:11.463468 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8884316a-72e2-42cf-9197-c718bafd54f4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:11.464226 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8884316a-72e2-42cf-9197-c718bafd54f4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:12:11.464657 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8884316a-72e2-42cf-9197-c718bafd54f4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:12:11.477272 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-8884316a-72e2-42cf-9197-c718bafd54f4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] HTTP exception thrown: Instance 44d453d4-8637-4162-94d2-835dcd3e4990 could not be found. Sep 14 20:12:11.477884 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8884316a-72e2-42cf-9197-c718bafd54f4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Returning 404 to user: Instance 44d453d4-8637-4162-94d2-835dcd3e4990 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:12:11.478699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8884316a-72e2-42cf-9197-c718bafd54f4 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990" status: 404 len: 111 microversion: 2.1 time: 0.026591 Sep 14 20:12:11.479215 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1352/2735] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:12:11 2021] GET /compute/v2.1/servers/44d453d4-8637-4162-94d2-835dcd3e4990 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:13:22.686232 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:13:22.686818 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:13:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:13:23.476155 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:13:23.476347 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:13:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:13:24.739746 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:13:24.740565 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:13:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:13:48.092923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-da7a3e5d-213d-4d9f-9fc9-687843a6f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:48.093627 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-da7a3e5d-213d-4d9f-9fc9-687843a6f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:13:48.100147 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da7a3e5d-213d-4d9f-9fc9-687843a6f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:13:48.100593 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da7a3e5d-213d-4d9f-9fc9-687843a6f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:13:48.101374 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da7a3e5d-213d-4d9f-9fc9-687843a6f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:13:48.101929 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-da7a3e5d-213d-4d9f-9fc9-687843a6f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:13:48.117592 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-da7a3e5d-213d-4d9f-9fc9-687843a6f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] HTTP exception thrown: Instance dad1f171-af6a-4426-911c-022a3216f1f6 could not be found. Sep 14 20:13:48.118207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-da7a3e5d-213d-4d9f-9fc9-687843a6f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Returning 404 to user: Instance dad1f171-af6a-4426-911c-022a3216f1f6 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:13:48.119058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-da7a3e5d-213d-4d9f-9fc9-687843a6f2c3 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 404 len: 111 microversion: 2.1 time: 0.030746 Sep 14 20:13:48.119640 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1384/2736] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:13:48 2021] DELETE /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:13:48.129141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1a9a0c40-b115-48b1-b845-8a4dabf0285f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:48.129857 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-1a9a0c40-b115-48b1-b845-8a4dabf0285f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: dad1f171-af6a-4426-911c-022a3216f1f6] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:13:48.136139 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a9a0c40-b115-48b1-b845-8a4dabf0285f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:13:48.136587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a9a0c40-b115-48b1-b845-8a4dabf0285f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:13:48.137361 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a9a0c40-b115-48b1-b845-8a4dabf0285f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:13:48.137837 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-1a9a0c40-b115-48b1-b845-8a4dabf0285f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:13:48.152114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-1a9a0c40-b115-48b1-b845-8a4dabf0285f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] HTTP exception thrown: Instance dad1f171-af6a-4426-911c-022a3216f1f6 could not be found. Sep 14 20:13:48.152711 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1a9a0c40-b115-48b1-b845-8a4dabf0285f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Returning 404 to user: Instance dad1f171-af6a-4426-911c-022a3216f1f6 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:13:48.153591 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1a9a0c40-b115-48b1-b845-8a4dabf0285f tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6" status: 404 len: 111 microversion: 2.1 time: 0.029643 Sep 14 20:13:48.154154 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1353/2737] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:13:48 2021] GET /compute/v2.1/servers/dad1f171-af6a-4426-911c-022a3216f1f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:15:20.456284 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:15:20.456904 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:15:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:16:05.761596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-727bf4ac-8088-4408-811f-e76eba4044dd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:05.770077 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-727bf4ac-8088-4408-811f-e76eba4044dd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:16:05.770077 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] AMQP server on 10.222.0.58:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 14 20:16:05.789632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-727bf4ac-8088-4408-811f-e76eba4044dd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:05.794662 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-727bf4ac-8088-4408-811f-e76eba4044dd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:05.795775 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-727bf4ac-8088-4408-811f-e76eba4044dd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:05.796422 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-727bf4ac-8088-4408-811f-e76eba4044dd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:05.852410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-727bf4ac-8088-4408-811f-e76eba4044dd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Going to try to terminate instance {{(pid=115678) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 20:16:06.120452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-727bf4ac-8088-4408-811f-e76eba4044dd tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 204 len: 0 microversion: 2.1 time: 0.376893 Sep 14 20:16:06.121049 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1385/2738] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:16:05 2021] DELETE /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:16:06.132376 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 20:16:06.135735 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-61baabbc-d94a-4106-80fe-1792beff998e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:06.136338 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-61baabbc-d94a-4106-80fe-1792beff998e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:16:06.142324 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61baabbc-d94a-4106-80fe-1792beff998e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:06.142774 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61baabbc-d94a-4106-80fe-1792beff998e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:06.143602 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61baabbc-d94a-4106-80fe-1792beff998e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:06.144116 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-61baabbc-d94a-4106-80fe-1792beff998e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:06.394026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-61baabbc-d94a-4106-80fe-1792beff998e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:16:06.402208 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-61baabbc-d94a-4106-80fe-1792beff998e tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1513 microversion: 2.1 time: 0.271579 Sep 14 20:16:06.403019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1354/2739] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:16:06 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:16:07.421915 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-1b575b07-c588-4f5a-8313-49c9c2ef9cf1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:07.426855 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-1b575b07-c588-4f5a-8313-49c9c2ef9cf1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:16:07.441240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b575b07-c588-4f5a-8313-49c9c2ef9cf1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:07.441728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b575b07-c588-4f5a-8313-49c9c2ef9cf1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:07.442508 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b575b07-c588-4f5a-8313-49c9c2ef9cf1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:07.442946 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-1b575b07-c588-4f5a-8313-49c9c2ef9cf1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:07.448311 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 43576. Sep 14 20:16:07.628464 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-1b575b07-c588-4f5a-8313-49c9c2ef9cf1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:16:07.635944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-1b575b07-c588-4f5a-8313-49c9c2ef9cf1 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1513 microversion: 2.1 time: 0.218193 Sep 14 20:16:07.636502 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1386/2740] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:16:07 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:16:08.652662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-57c0491f-56b0-470c-9b66-6465ce65e029 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:08.653530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-57c0491f-56b0-470c-9b66-6465ce65e029 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:16:08.671745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57c0491f-56b0-470c-9b66-6465ce65e029 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:08.677227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57c0491f-56b0-470c-9b66-6465ce65e029 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:08.677227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57c0491f-56b0-470c-9b66-6465ce65e029 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:08.677227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-57c0491f-56b0-470c-9b66-6465ce65e029 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:08.680186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 43626. Sep 14 20:16:08.811979 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-57c0491f-56b0-470c-9b66-6465ce65e029 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:16:08.824872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-57c0491f-56b0-470c-9b66-6465ce65e029 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1513 microversion: 2.1 time: 0.175533 Sep 14 20:16:08.825892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1355/2741] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:16:08 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:16:09.390685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-823047e4-0c50-4c0a-8ab4-a9165517aba4 req-f7a1a543-b8c2-4bef-8ef6-a732595213a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d23b109a-dab1-48fd-b306-2d1c00fdeb0d", "name": "network-vif-deleted", "tag": "d7f50ba9-6855-4fe4-865c-864b6863e673"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:16:09.392295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:16:09.392295 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 20:16:09.399778 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-823047e4-0c50-4c0a-8ab4-a9165517aba4 req-f7a1a543-b8c2-4bef-8ef6-a732595213a8 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:09.400223 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-823047e4-0c50-4c0a-8ab4-a9165517aba4 req-f7a1a543-b8c2-4bef-8ef6-a732595213a8 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:09.410849 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-823047e4-0c50-4c0a-8ab4-a9165517aba4 req-f7a1a543-b8c2-4bef-8ef6-a732595213a8 service nova] Creating event network-vif-deleted:d7f50ba9-6855-4fe4-865c-864b6863e673 for instance d23b109a-dab1-48fd-b306-2d1c00fdeb0d on hv-cinder-80588 Sep 14 20:16:09.416660 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-823047e4-0c50-4c0a-8ab4-a9165517aba4 req-f7a1a543-b8c2-4bef-8ef6-a732595213a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089811 Sep 14 20:16:09.417225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1387/2742] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:16:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:16:09.842212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:09.845351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:16:09.849185 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:09.849662 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:09.850444 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:09.850874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:09.880197 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:09.880669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:09.881628 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.objects.instance [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lazy-loading 'fault' on Instance uuid d23b109a-dab1-48fd-b306-2d1c00fdeb0d {{(pid=115679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 20:16:09.925234 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de96771b60a4d658f0e371f6b695bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627619b6d80a4c4ca01e48750b307056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:16:09.934862 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-21225fdb-cd61-40c8-a640-d3147f7f31e0 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 200 len: 1307 microversion: 2.1 time: 0.096288 Sep 14 20:16:09.935430 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1356/2743] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:16:09 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:16:10.953680 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cc72b913-9af2-44eb-b886-590eeafea6e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:10.954392 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-cc72b913-9af2-44eb-b886-590eeafea6e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] [instance: d23b109a-dab1-48fd-b306-2d1c00fdeb0d] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:16:10.961646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc72b913-9af2-44eb-b886-590eeafea6e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:10.962373 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc72b913-9af2-44eb-b886-590eeafea6e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:10.963361 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc72b913-9af2-44eb-b886-590eeafea6e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:16:10.963988 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-cc72b913-9af2-44eb-b886-590eeafea6e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:16:10.979588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-cc72b913-9af2-44eb-b886-590eeafea6e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] HTTP exception thrown: Instance d23b109a-dab1-48fd-b306-2d1c00fdeb0d could not be found. Sep 14 20:16:10.980258 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-cc72b913-9af2-44eb-b886-590eeafea6e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] Returning 404 to user: Instance d23b109a-dab1-48fd-b306-2d1c00fdeb0d could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:16:10.981267 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-cc72b913-9af2-44eb-b886-590eeafea6e3 tempest-AttachVolumeNegativeTest-1862589563 tempest-AttachVolumeNegativeTest-1862589563-project] 10.222.0.58 "GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d" status: 404 len: 111 microversion: 2.1 time: 0.032107 Sep 14 20:16:10.981857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1388/2744] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:16:10 2021] GET /compute/v2.1/servers/d23b109a-dab1-48fd-b306-2d1c00fdeb0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:16:15.589911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e72f2a79-0793-45fb-9425-44f1592cb28b tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0c83c4940>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:15.643566 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e72f2a79-0793-45fb-9425-44f1592cb28b tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/fdca8a7b-a275-46b1-9bc7-3ed1fc7673cd" status: 200 len: 351 microversion: 2.1 time: 0.057396 Sep 14 20:16:15.644135 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1357/2745] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 20:16:15 2021] GET /compute/v2.1/os-volumes/fdca8a7b-a275-46b1-9bc7-3ed1fc7673cd => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:16:18.510110 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e82ecf3c-3890-4d42-a02e-0f71e09eff13 tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0ccb03f70>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:18.589051 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-e82ecf3c-3890-4d42-a02e-0f71e09eff13 tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/508a8846-0d06-42bf-8e89-6a010f31430a" status: 200 len: 351 microversion: 2.1 time: 0.082411 Sep 14 20:16:18.589644 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1389/2746] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 20:16:18 2021] GET /compute/v2.1/os-volumes/508a8846-0d06-42bf-8e89-6a010f31430a => generated 351 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:16:20.292812 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1254a0a5-cb0e-4584-bc5e-843d6395cca5 tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0c835e040>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:20.378182 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1254a0a5-cb0e-4584-bc5e-843d6395cca5 tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/dec412b1-5a5e-4182-9d45-ecc30bbb64e6" status: 200 len: 347 microversion: 2.1 time: 0.088969 Sep 14 20:16:20.378746 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1358/2747] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Sep 14 20:16:20 2021] GET /compute/v2.1/os-volumes/dec412b1-5a5e-4182-9d45-ecc30bbb64e6 => generated 347 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:16:20.389989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ec6f767d-3e2f-4d39-be2a-f090e96e8a66 tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0ccae4820>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:20.502727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ec6f767d-3e2f-4d39-be2a-f090e96e8a66 tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.116179 Sep 14 20:16:20.503280 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1390/2748] 10.222.0.58 () {58 vars in 1134 bytes} [Tue Sep 14 20:16:20 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:16:20.515670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-013c7576-baa2-46d6-93d1-c455d5844b3b tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0c83c4280>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:20.611742 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-013c7576-baa2-46d6-93d1-c455d5844b3b tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.099700 Sep 14 20:16:20.612351 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1359/2749] 10.222.0.58 () {58 vars in 1149 bytes} [Tue Sep 14 20:16:20 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 691 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:16:20.624688 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-2d73f057-ed5c-4862-b00d-8623bcd7a41f tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0ccb0de50>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:20.720742 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-2d73f057-ed5c-4862-b00d-8623bcd7a41f tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.099697 Sep 14 20:16:20.721534 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1391/2750] 10.222.0.58 () {58 vars in 1134 bytes} [Tue Sep 14 20:16:20 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:16:20.733832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-a20b4f6b-8240-4bab-a3aa-d9ec700e07aa tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0c87291f0>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:21.137592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-a20b4f6b-8240-4bab-a3aa-d9ec700e07aa tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.405407 Sep 14 20:16:21.137592 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1360/2751] 10.222.0.58 () {58 vars in 1167 bytes} [Tue Sep 14 20:16:20 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:16:21.146638 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-fcd20c7c-5736-4711-84d6-38d98e27926b tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0ccaee430>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:21.262809 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-fcd20c7c-5736-4711-84d6-38d98e27926b tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.119700 Sep 14 20:16:21.263596 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1392/2752] 10.222.0.58 () {58 vars in 1170 bytes} [Tue Sep 14 20:16:21 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 691 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:16:21.283290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-1aa73529-b784-4e0f-8133-7e47ccf42a34 tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0c835caf0>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:21.369397 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-1aa73529-b784-4e0f-8133-7e47ccf42a34 tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.089479 Sep 14 20:16:21.370245 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1361/2753] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Sep 14 20:16:21 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:16:21.380891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ff93838a-38fc-453d-8d0f-5a9e96741fe8 tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0ccb0d790>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:21.463531 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ff93838a-38fc-453d-8d0f-5a9e96741fe8 tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086177 Sep 14 20:16:21.464146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1393/2754] 10.222.0.58 () {58 vars in 1188 bytes} [Tue Sep 14 20:16:21 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:16:21.476286 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-91488974-ece7-44e1-a535-5749264edece tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] Calling method '.version_select at 0x7fd0c835e040>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:16:21.559545 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-91488974-ece7-44e1-a535-5749264edece tempest-VolumesTestJSON-682406459 tempest-VolumesTestJSON-682406459-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.087548 Sep 14 20:16:21.560066 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1362/2755] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Sep 14 20:16:21 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:16:42.708824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:16:42.708824 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:16:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:16:43.493283 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:16:43.493464 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:16:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:16:44.761926 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:16:44.762434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:16:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:17:05.841093 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-323246381", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "networks": [{"uuid": "39089a7f-f7db-4780-8e11-5e1a14598c4b"}]}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:17:05.894426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.network.neutron [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] validate_networks() for [('39089a7f-f7db-4780-8e11-5e1a14598c4b', None, None, None, None, None)] {{(pid=115678) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 20:17:06.334278 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Flavor limits 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:17:06.334705 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Image limits 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:17:06.335192 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Flavor pref 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:17:06.335649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Image pref 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:17:06.336067 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:17:06.346628 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:06.347405 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:06.349545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:06.349545 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:06.370078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Getting quotas for project c00403620d064739885fdc3605faf0bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 20:17:06.374864 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Getting quotas for user 74057879f0fd4f11bc7f86d63fa95987 and project c00403620d064739885fdc3605faf0bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 20:17:06.386567 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Going to run 1 instances... {{(pid=115678) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 20:17:06.389588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 20:17:06.595240 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6d91122e-2b8c-485d-995c-a5514d3372a0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765705 Sep 14 20:17:06.595846 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1394/2756] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 20:17:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:17:06.609236 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-52d2780b-bbfb-473a-8bda-815db0cedefd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:06.610025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-52d2780b-bbfb-473a-8bda-815db0cedefd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:06.666019 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-52d2780b-bbfb-473a-8bda-815db0cedefd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:06.672872 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-52d2780b-bbfb-473a-8bda-815db0cedefd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1213 microversion: 2.1 time: 0.069980 Sep 14 20:17:06.673453 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1363/2757] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:06 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:07.690168 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-402ab511-7f5d-4ef4-a975-2ff756977fd5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:07.690780 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-402ab511-7f5d-4ef4-a975-2ff756977fd5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:07.741779 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-402ab511-7f5d-4ef4-a975-2ff756977fd5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:07.748859 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-402ab511-7f5d-4ef4-a975-2ff756977fd5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1213 microversion: 2.1 time: 0.062691 Sep 14 20:17:07.749643 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1395/2758] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:07 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:08.766021 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ce7f3da7-0b32-46c0-a39a-f285253c0a08 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:08.766700 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ce7f3da7-0b32-46c0-a39a-f285253c0a08 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:08.773209 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce7f3da7-0b32-46c0-a39a-f285253c0a08 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:08.773705 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce7f3da7-0b32-46c0-a39a-f285253c0a08 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:08.774471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce7f3da7-0b32-46c0-a39a-f285253c0a08 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:08.774905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ce7f3da7-0b32-46c0-a39a-f285253c0a08 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:08.840971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ce7f3da7-0b32-46c0-a39a-f285253c0a08 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:08.849079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ce7f3da7-0b32-46c0-a39a-f285253c0a08 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1265 microversion: 2.1 time: 0.087037 Sep 14 20:17:08.849806 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1364/2759] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:08 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:09.866635 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-87606cea-c2f6-4ffb-822b-556e9d1da7aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:09.867249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-87606cea-c2f6-4ffb-822b-556e9d1da7aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:09.874397 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87606cea-c2f6-4ffb-822b-556e9d1da7aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:09.874980 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87606cea-c2f6-4ffb-822b-556e9d1da7aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:09.875776 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87606cea-c2f6-4ffb-822b-556e9d1da7aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:09.876215 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-87606cea-c2f6-4ffb-822b-556e9d1da7aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:09.949086 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-87606cea-c2f6-4ffb-822b-556e9d1da7aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:09.957458 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-87606cea-c2f6-4ffb-822b-556e9d1da7aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1271 microversion: 2.1 time: 0.094247 Sep 14 20:17:09.958636 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1396/2760] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:09 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:10.975259 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-c0d0060f-ceb0-4c6b-b86a-3f44db1d0b0b tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:10.976098 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-c0d0060f-ceb0-4c6b-b86a-3f44db1d0b0b tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:10.982858 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0d0060f-ceb0-4c6b-b86a-3f44db1d0b0b tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:10.983471 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0d0060f-ceb0-4c6b-b86a-3f44db1d0b0b tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:10.984426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0d0060f-ceb0-4c6b-b86a-3f44db1d0b0b tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:10.984815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-c0d0060f-ceb0-4c6b-b86a-3f44db1d0b0b tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:11.124413 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-c0d0060f-ceb0-4c6b-b86a-3f44db1d0b0b tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:11.132594 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-c0d0060f-ceb0-4c6b-b86a-3f44db1d0b0b tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1313 microversion: 2.1 time: 0.161281 Sep 14 20:17:11.142764 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1365/2761] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:10 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:11.737510 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-c87327a0-95b9-4055-8184-25c4d2d07cc0 req-7565ee8b-cc5b-4af9-a13c-e0cd7fbdd9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f576abc2-f1fb-4065-89f1-044285b9b737", "tag": "d6ea1381-9197-45c7-b0cf-f632310bf6d9"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:17:11.739616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:17:11.739616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 20:17:11.746536 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-c87327a0-95b9-4055-8184-25c4d2d07cc0 req-7565ee8b-cc5b-4af9-a13c-e0cd7fbdd9df service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:11.746984 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-c87327a0-95b9-4055-8184-25c4d2d07cc0 req-7565ee8b-cc5b-4af9-a13c-e0cd7fbdd9df service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:11.759204 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-c87327a0-95b9-4055-8184-25c4d2d07cc0 req-7565ee8b-cc5b-4af9-a13c-e0cd7fbdd9df service nova] Creating event network-changed:d6ea1381-9197-45c7-b0cf-f632310bf6d9 for instance f576abc2-f1fb-4065-89f1-044285b9b737 on hv-cinder-80588 Sep 14 20:17:11.765038 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-c87327a0-95b9-4055-8184-25c4d2d07cc0 req-7565ee8b-cc5b-4af9-a13c-e0cd7fbdd9df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036237 Sep 14 20:17:11.765835 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1397/2762] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:17:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:17:12.151034 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-cbb4f32a-96ca-4f18-8044-7adec8c72091 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:12.151865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-cbb4f32a-96ca-4f18-8044-7adec8c72091 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:12.159455 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbb4f32a-96ca-4f18-8044-7adec8c72091 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:12.160048 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbb4f32a-96ca-4f18-8044-7adec8c72091 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:12.160940 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbb4f32a-96ca-4f18-8044-7adec8c72091 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:12.161461 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-cbb4f32a-96ca-4f18-8044-7adec8c72091 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:12.308878 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-cbb4f32a-96ca-4f18-8044-7adec8c72091 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:12.318424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-cbb4f32a-96ca-4f18-8044-7adec8c72091 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1313 microversion: 2.1 time: 0.170445 Sep 14 20:17:12.318424 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1366/2763] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:12 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:12.842843 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:17:12.843010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:17:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:17:13.333842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f4cf4074-e3d4-4d66-a440-41d92c135ecc tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:13.336830 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f4cf4074-e3d4-4d66-a440-41d92c135ecc tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:13.340476 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4cf4074-e3d4-4d66-a440-41d92c135ecc tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:13.340918 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4cf4074-e3d4-4d66-a440-41d92c135ecc tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:13.341716 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4cf4074-e3d4-4d66-a440-41d92c135ecc tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:13.342184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f4cf4074-e3d4-4d66-a440-41d92c135ecc tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:13.467731 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f4cf4074-e3d4-4d66-a440-41d92c135ecc tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:13.474865 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f4cf4074-e3d4-4d66-a440-41d92c135ecc tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1313 microversion: 2.1 time: 0.145025 Sep 14 20:17:13.475426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1398/2764] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:13 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:14.491390 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-aaf45965-0163-4fb7-829d-9ccf1705f0bd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:14.492001 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-aaf45965-0163-4fb7-829d-9ccf1705f0bd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:14.497888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aaf45965-0163-4fb7-829d-9ccf1705f0bd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:14.498371 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aaf45965-0163-4fb7-829d-9ccf1705f0bd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:14.499143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aaf45965-0163-4fb7-829d-9ccf1705f0bd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:14.499578 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-aaf45965-0163-4fb7-829d-9ccf1705f0bd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:14.619483 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-aaf45965-0163-4fb7-829d-9ccf1705f0bd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:14.626765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-aaf45965-0163-4fb7-829d-9ccf1705f0bd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1313 microversion: 2.1 time: 0.139043 Sep 14 20:17:14.627321 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1367/2765] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:14 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:15.642153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-928d1cd2-714a-43b6-8004-0a53039adaf4 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:15.642767 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-928d1cd2-714a-43b6-8004-0a53039adaf4 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:15.648719 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-928d1cd2-714a-43b6-8004-0a53039adaf4 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:15.649169 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-928d1cd2-714a-43b6-8004-0a53039adaf4 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:15.649963 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-928d1cd2-714a-43b6-8004-0a53039adaf4 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:15.650402 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-928d1cd2-714a-43b6-8004-0a53039adaf4 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:15.775039 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-928d1cd2-714a-43b6-8004-0a53039adaf4 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:15.783256 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-928d1cd2-714a-43b6-8004-0a53039adaf4 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1313 microversion: 2.1 time: 0.144687 Sep 14 20:17:15.789015 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1399/2766] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:15 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:16.800177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-ee69ad65-1479-478b-a2ea-3f29706235c1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:16.800838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-ee69ad65-1479-478b-a2ea-3f29706235c1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:16.807117 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee69ad65-1479-478b-a2ea-3f29706235c1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:16.807552 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee69ad65-1479-478b-a2ea-3f29706235c1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:16.808644 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee69ad65-1479-478b-a2ea-3f29706235c1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:16.809086 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-ee69ad65-1479-478b-a2ea-3f29706235c1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:16.936587 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-ee69ad65-1479-478b-a2ea-3f29706235c1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:16.943906 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-ee69ad65-1479-478b-a2ea-3f29706235c1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1313 microversion: 2.1 time: 0.147810 Sep 14 20:17:16.944478 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1368/2767] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:16 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:17.962184 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-15cbf35e-4f7a-4c32-bbe3-0d341f5b74c7 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:17.963460 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-15cbf35e-4f7a-4c32-bbe3-0d341f5b74c7 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:17.970313 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-15cbf35e-4f7a-4c32-bbe3-0d341f5b74c7 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:17.970765 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-15cbf35e-4f7a-4c32-bbe3-0d341f5b74c7 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:17.971560 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-15cbf35e-4f7a-4c32-bbe3-0d341f5b74c7 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:17.971996 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-15cbf35e-4f7a-4c32-bbe3-0d341f5b74c7 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:18.099426 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-15cbf35e-4f7a-4c32-bbe3-0d341f5b74c7 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:18.106685 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-15cbf35e-4f7a-4c32-bbe3-0d341f5b74c7 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1313 microversion: 2.1 time: 0.149047 Sep 14 20:17:18.115923 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1400/2768] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:17 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:18.165239 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-653ed9da-ee01-4e2a-82a5-3ad994df01ab req-37d0d32b-2d14-455d-a54a-081241264bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f576abc2-f1fb-4065-89f1-044285b9b737", "name": "network-vif-plugged", "status": "completed", "tag": "d6ea1381-9197-45c7-b0cf-f632310bf6d9"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:17:18.166804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:17:18.166804 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:17:18.176297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-653ed9da-ee01-4e2a-82a5-3ad994df01ab req-37d0d32b-2d14-455d-a54a-081241264bf1 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:18.176297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-653ed9da-ee01-4e2a-82a5-3ad994df01ab req-37d0d32b-2d14-455d-a54a-081241264bf1 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:18.186389 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-653ed9da-ee01-4e2a-82a5-3ad994df01ab req-37d0d32b-2d14-455d-a54a-081241264bf1 service nova] Creating event network-vif-plugged:d6ea1381-9197-45c7-b0cf-f632310bf6d9 for instance f576abc2-f1fb-4065-89f1-044285b9b737 on hv-cinder-80588 Sep 14 20:17:18.192892 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-653ed9da-ee01-4e2a-82a5-3ad994df01ab req-37d0d32b-2d14-455d-a54a-081241264bf1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152220 Sep 14 20:17:18.193826 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1369/2769] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:17:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:17:19.124083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-d7c63bf2-dc11-4f5e-86fa-22b52c4e84f1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:19.124732 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-d7c63bf2-dc11-4f5e-86fa-22b52c4e84f1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:19.130538 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d7c63bf2-dc11-4f5e-86fa-22b52c4e84f1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:19.130985 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d7c63bf2-dc11-4f5e-86fa-22b52c4e84f1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:19.135447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d7c63bf2-dc11-4f5e-86fa-22b52c4e84f1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:19.135447 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-d7c63bf2-dc11-4f5e-86fa-22b52c4e84f1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:19.266111 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-d7c63bf2-dc11-4f5e-86fa-22b52c4e84f1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:19.273877 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-d7c63bf2-dc11-4f5e-86fa-22b52c4e84f1 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1313 microversion: 2.1 time: 0.154039 Sep 14 20:17:19.274452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1401/2770] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:19 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:20.291635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-3b262c93-78ae-48aa-bdf2-62b0423a678a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:20.292262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-3b262c93-78ae-48aa-bdf2-62b0423a678a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:20.298437 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b262c93-78ae-48aa-bdf2-62b0423a678a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:20.298888 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b262c93-78ae-48aa-bdf2-62b0423a678a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:20.299663 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b262c93-78ae-48aa-bdf2-62b0423a678a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:20.300104 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-3b262c93-78ae-48aa-bdf2-62b0423a678a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:20.420923 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-3b262c93-78ae-48aa-bdf2-62b0423a678a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:20.428052 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-3b262c93-78ae-48aa-bdf2-62b0423a678a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1313 microversion: 2.1 time: 0.140498 Sep 14 20:17:20.428617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1370/2771] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:20 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:21.448441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c03aa5a1-bfa2-4049-b92f-4e5360dd349d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:21.449083 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c03aa5a1-bfa2-4049-b92f-4e5360dd349d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:21.455725 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c03aa5a1-bfa2-4049-b92f-4e5360dd349d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:21.456180 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c03aa5a1-bfa2-4049-b92f-4e5360dd349d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:21.457010 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c03aa5a1-bfa2-4049-b92f-4e5360dd349d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:21.457449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c03aa5a1-bfa2-4049-b92f-4e5360dd349d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:21.577017 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-c03aa5a1-bfa2-4049-b92f-4e5360dd349d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:21.584195 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c03aa5a1-bfa2-4049-b92f-4e5360dd349d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1313 microversion: 2.1 time: 0.139403 Sep 14 20:17:21.584757 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1402/2772] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:21 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:22.601290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-62d16893-9f4f-432a-96a4-6228c0007559 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:22.601927 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-62d16893-9f4f-432a-96a4-6228c0007559 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:22.607954 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-62d16893-9f4f-432a-96a4-6228c0007559 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:22.608398 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-62d16893-9f4f-432a-96a4-6228c0007559 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:22.611030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-62d16893-9f4f-432a-96a4-6228c0007559 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:22.611030 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-62d16893-9f4f-432a-96a4-6228c0007559 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:22.733669 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-62d16893-9f4f-432a-96a4-6228c0007559 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:22.741141 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-62d16893-9f4f-432a-96a4-6228c0007559 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1496 microversion: 2.1 time: 0.144817 Sep 14 20:17:22.741745 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1371/2773] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:22 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1496 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:23.629541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-61c82f81-d258-4bae-a693-c6280873e3c5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:23.630080 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-61c82f81-d258-4bae-a693-c6280873e3c5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:23.635783 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-61c82f81-d258-4bae-a693-c6280873e3c5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:23.636230 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-61c82f81-d258-4bae-a693-c6280873e3c5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:23.636989 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-61c82f81-d258-4bae-a693-c6280873e3c5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:23.637423 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-61c82f81-d258-4bae-a693-c6280873e3c5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:23.663618 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-61c82f81-d258-4bae-a693-c6280873e3c5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Going to try to terminate instance {{(pid=115678) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 20:17:23.959744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-61c82f81-d258-4bae-a693-c6280873e3c5 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 204 len: 0 microversion: 2.1 time: 0.333543 Sep 14 20:17:23.960346 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1403/2774] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:17:23 2021] DELETE /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:17:23.968362 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5a2b62fa-2541-4b8d-8313-966add5aa7a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:23.969137 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5a2b62fa-2541-4b8d-8313-966add5aa7a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:23.975033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a2b62fa-2541-4b8d-8313-966add5aa7a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:23.975475 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a2b62fa-2541-4b8d-8313-966add5aa7a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:23.976227 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a2b62fa-2541-4b8d-8313-966add5aa7a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:23.976655 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-5a2b62fa-2541-4b8d-8313-966add5aa7a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:24.099114 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5a2b62fa-2541-4b8d-8313-966add5aa7a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:24.106543 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5a2b62fa-2541-4b8d-8313-966add5aa7a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1502 microversion: 2.1 time: 0.141806 Sep 14 20:17:24.107108 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1372/2775] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:23 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1502 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:25.125612 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0fa4fb39-875b-4eb4-971c-6a7c7fc6bb8c tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:25.126340 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0fa4fb39-875b-4eb4-971c-6a7c7fc6bb8c tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:25.133057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0fa4fb39-875b-4eb4-971c-6a7c7fc6bb8c tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:25.133533 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0fa4fb39-875b-4eb4-971c-6a7c7fc6bb8c tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:25.134358 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0fa4fb39-875b-4eb4-971c-6a7c7fc6bb8c tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:25.134800 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0fa4fb39-875b-4eb4-971c-6a7c7fc6bb8c tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:25.284225 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0fa4fb39-875b-4eb4-971c-6a7c7fc6bb8c tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:25.291479 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0fa4fb39-875b-4eb4-971c-6a7c7fc6bb8c tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1502 microversion: 2.1 time: 0.170961 Sep 14 20:17:25.292090 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1404/2776] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:25 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:26.044266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-d26dcdf9-2b4e-441e-8456-c5b211cb2658 req-3ed14704-8e35-4acb-a3f2-c84075b96ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f576abc2-f1fb-4065-89f1-044285b9b737", "name": "network-vif-deleted", "tag": "d6ea1381-9197-45c7-b0cf-f632310bf6d9"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:17:26.045787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:17:26.045787 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:17:26.052543 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-d26dcdf9-2b4e-441e-8456-c5b211cb2658 req-3ed14704-8e35-4acb-a3f2-c84075b96ce4 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:26.052984 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-d26dcdf9-2b4e-441e-8456-c5b211cb2658 req-3ed14704-8e35-4acb-a3f2-c84075b96ce4 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:26.064955 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-d26dcdf9-2b4e-441e-8456-c5b211cb2658 req-3ed14704-8e35-4acb-a3f2-c84075b96ce4 service nova] Creating event network-vif-deleted:d6ea1381-9197-45c7-b0cf-f632310bf6d9 for instance f576abc2-f1fb-4065-89f1-044285b9b737 on hv-cinder-80588 Sep 14 20:17:26.070010 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-d26dcdf9-2b4e-441e-8456-c5b211cb2658 req-3ed14704-8e35-4acb-a3f2-c84075b96ce4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029406 Sep 14 20:17:26.070609 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1373/2777] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:17:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:17:26.308050 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:26.308919 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:26.315344 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:26.319330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:26.319330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:26.319330 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:26.348342 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:26.348790 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:26.349292 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lazy-loading 'fault' on Instance uuid f576abc2-f1fb-4065-89f1-044285b9b737 {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 20:17:26.392992 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:26.400222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-29a75050-3b9c-453d-93fd-4513839da826 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 200 len: 1303 microversion: 2.1 time: 0.095973 Sep 14 20:17:26.400799 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1405/2778] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:26 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:27.416313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-98a9252b-7701-41bb-be20-1cd651c926e0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:27.417119 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-98a9252b-7701-41bb-be20-1cd651c926e0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: f576abc2-f1fb-4065-89f1-044285b9b737] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:27.423116 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98a9252b-7701-41bb-be20-1cd651c926e0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:27.423659 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98a9252b-7701-41bb-be20-1cd651c926e0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:27.424636 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98a9252b-7701-41bb-be20-1cd651c926e0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:27.425191 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-98a9252b-7701-41bb-be20-1cd651c926e0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:27.438915 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-98a9252b-7701-41bb-be20-1cd651c926e0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] HTTP exception thrown: Instance f576abc2-f1fb-4065-89f1-044285b9b737 could not be found. Sep 14 20:17:27.439511 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-98a9252b-7701-41bb-be20-1cd651c926e0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Returning 404 to user: Instance f576abc2-f1fb-4065-89f1-044285b9b737 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:17:27.440386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-98a9252b-7701-41bb-be20-1cd651c926e0 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737" status: 404 len: 111 microversion: 2.1 time: 0.028057 Sep 14 20:17:27.440933 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1374/2779] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:27 2021] GET /compute/v2.1/servers/f576abc2-f1fb-4065-89f1-044285b9b737 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:17:27.536005 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1184693545", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452", "networks": [{"uuid": "39089a7f-f7db-4780-8e11-5e1a14598c4b"}]}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:17:27.586999 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.network.neutron [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] validate_networks() for [('39089a7f-f7db-4780-8e11-5e1a14598c4b', None, None, None, None, None)] {{(pid=115678) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 20:17:27.933884 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Flavor limits 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:17:27.934301 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Image limits 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:17:27.934820 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Flavor pref 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:17:27.935892 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Image pref 0:0:0 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:17:27.936349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.virt.hardware [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115678) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:17:27.945762 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:27.946332 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:27.947164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:27.947595 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:27.964646 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Getting quotas for project c00403620d064739885fdc3605faf0bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 20:17:27.968501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Getting quotas for user 74057879f0fd4f11bc7f86d63fa95987 and project c00403620d064739885fdc3605faf0bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 20:17:27.978934 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Going to run 1 instances... {{(pid=115678) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 20:17:27.981277 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115678) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 20:17:28.103980 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-595b25bb-7cc5-4742-bab9-a89ea9271d14 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571587 Sep 14 20:17:28.104903 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1406/2780] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 20:17:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:17:28.115225 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-5f7f4243-4862-4418-8bc1-a6abcfa346a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:28.115778 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-5f7f4243-4862-4418-8bc1-a6abcfa346a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:28.168699 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-5f7f4243-4862-4418-8bc1-a6abcfa346a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:28.176276 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-5f7f4243-4862-4418-8bc1-a6abcfa346a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1214 microversion: 2.1 time: 0.065004 Sep 14 20:17:28.176835 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1375/2781] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:28 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:29.194309 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-813598a7-a511-4505-a21b-dd1af922de39 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:29.194949 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-813598a7-a511-4505-a21b-dd1af922de39 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:29.201649 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-813598a7-a511-4505-a21b-dd1af922de39 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:29.202099 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-813598a7-a511-4505-a21b-dd1af922de39 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:29.202863 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-813598a7-a511-4505-a21b-dd1af922de39 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:29.203298 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-813598a7-a511-4505-a21b-dd1af922de39 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:29.261140 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-813598a7-a511-4505-a21b-dd1af922de39 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:29.269616 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-813598a7-a511-4505-a21b-dd1af922de39 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1218 microversion: 2.1 time: 0.079239 Sep 14 20:17:29.270249 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1407/2782] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:29 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:30.289723 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-64b2710f-0fb5-41d8-8766-bd4071740658 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:30.290847 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-64b2710f-0fb5-41d8-8766-bd4071740658 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:30.311133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-64b2710f-0fb5-41d8-8766-bd4071740658 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:30.311133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-64b2710f-0fb5-41d8-8766-bd4071740658 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:30.311133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-64b2710f-0fb5-41d8-8766-bd4071740658 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:30.311133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-64b2710f-0fb5-41d8-8766-bd4071740658 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:30.406924 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-64b2710f-0fb5-41d8-8766-bd4071740658 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:30.414331 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-64b2710f-0fb5-41d8-8766-bd4071740658 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1284 microversion: 2.1 time: 0.131438 Sep 14 20:17:30.414905 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1376/2783] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:30 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:31.436632 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-98166d80-15e3-4e1c-96f9-d9be866f4202 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:31.443349 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-98166d80-15e3-4e1c-96f9-d9be866f4202 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:31.444207 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98166d80-15e3-4e1c-96f9-d9be866f4202 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:31.445208 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98166d80-15e3-4e1c-96f9-d9be866f4202 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:31.447064 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98166d80-15e3-4e1c-96f9-d9be866f4202 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:31.448363 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-98166d80-15e3-4e1c-96f9-d9be866f4202 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:31.650054 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-98166d80-15e3-4e1c-96f9-d9be866f4202 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:31.657977 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-98166d80-15e3-4e1c-96f9-d9be866f4202 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1314 microversion: 2.1 time: 0.227066 Sep 14 20:17:31.658557 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1408/2784] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:31 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:31.850058 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-6bda3029-9213-41b7-9b8a-e30958cdc4c3 req-089ad68f-53cb-461a-8568-3f9bc46d84ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238f3948-f5ba-4a42-9f98-202ec73614b9", "tag": "258f37f5-65f7-4f3d-9ab3-2b3040445ba8"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:17:31.852092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:17:31.852092 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:17:31.859341 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-6bda3029-9213-41b7-9b8a-e30958cdc4c3 req-089ad68f-53cb-461a-8568-3f9bc46d84ba service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:31.859865 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-6bda3029-9213-41b7-9b8a-e30958cdc4c3 req-089ad68f-53cb-461a-8568-3f9bc46d84ba service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:31.870807 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-6bda3029-9213-41b7-9b8a-e30958cdc4c3 req-089ad68f-53cb-461a-8568-3f9bc46d84ba service nova] Creating event network-changed:258f37f5-65f7-4f3d-9ab3-2b3040445ba8 for instance 238f3948-f5ba-4a42-9f98-202ec73614b9 on hv-cinder-80588 Sep 14 20:17:31.877282 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-6bda3029-9213-41b7-9b8a-e30958cdc4c3 req-089ad68f-53cb-461a-8568-3f9bc46d84ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030687 Sep 14 20:17:31.877934 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1377/2785] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:17:32.676087 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f3958b02-7f2a-4754-a530-3ae003e41abd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:32.676629 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f3958b02-7f2a-4754-a530-3ae003e41abd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:32.682501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3958b02-7f2a-4754-a530-3ae003e41abd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:32.682947 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3958b02-7f2a-4754-a530-3ae003e41abd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:32.683953 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3958b02-7f2a-4754-a530-3ae003e41abd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:32.684379 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f3958b02-7f2a-4754-a530-3ae003e41abd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:32.810811 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f3958b02-7f2a-4754-a530-3ae003e41abd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:32.817895 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f3958b02-7f2a-4754-a530-3ae003e41abd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1314 microversion: 2.1 time: 0.145443 Sep 14 20:17:32.818449 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1409/2786] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:32 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:17:33.834973 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4b88d57b-7453-430f-b718-803798196974 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:33.835583 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4b88d57b-7453-430f-b718-803798196974 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:33.842087 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b88d57b-7453-430f-b718-803798196974 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:33.842539 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b88d57b-7453-430f-b718-803798196974 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:33.843450 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b88d57b-7453-430f-b718-803798196974 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:33.843883 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4b88d57b-7453-430f-b718-803798196974 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:33.966926 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4b88d57b-7453-430f-b718-803798196974 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:33.974385 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4b88d57b-7453-430f-b718-803798196974 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1314 microversion: 2.1 time: 0.143404 Sep 14 20:17:33.974953 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1378/2787] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:33 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:34.990452 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-0cf5175d-6899-4097-a922-032511012a38 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:34.991058 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-0cf5175d-6899-4097-a922-032511012a38 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:34.996995 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0cf5175d-6899-4097-a922-032511012a38 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:34.997434 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0cf5175d-6899-4097-a922-032511012a38 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:34.998728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0cf5175d-6899-4097-a922-032511012a38 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:34.999185 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-0cf5175d-6899-4097-a922-032511012a38 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:35.125232 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-0cf5175d-6899-4097-a922-032511012a38 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:35.132362 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-0cf5175d-6899-4097-a922-032511012a38 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1314 microversion: 2.1 time: 0.145569 Sep 14 20:17:35.132914 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1410/2788] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:34 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:36.149696 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b7f30270-74db-4a4a-9247-258b74f39e30 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:36.150343 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b7f30270-74db-4a4a-9247-258b74f39e30 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:36.157727 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7f30270-74db-4a4a-9247-258b74f39e30 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:36.158170 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7f30270-74db-4a4a-9247-258b74f39e30 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:36.158932 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7f30270-74db-4a4a-9247-258b74f39e30 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:36.159354 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b7f30270-74db-4a4a-9247-258b74f39e30 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:36.286582 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b7f30270-74db-4a4a-9247-258b74f39e30 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:36.294143 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b7f30270-74db-4a4a-9247-258b74f39e30 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1314 microversion: 2.1 time: 0.148490 Sep 14 20:17:36.295262 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1379/2789] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:36 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:37.312314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-393d7f2d-5266-48df-a3e7-deccede3e3a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:37.313027 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-393d7f2d-5266-48df-a3e7-deccede3e3a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:37.319282 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-393d7f2d-5266-48df-a3e7-deccede3e3a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:37.319727 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-393d7f2d-5266-48df-a3e7-deccede3e3a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:37.320501 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-393d7f2d-5266-48df-a3e7-deccede3e3a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:37.320934 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-393d7f2d-5266-48df-a3e7-deccede3e3a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:37.439738 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-393d7f2d-5266-48df-a3e7-deccede3e3a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:37.447247 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-393d7f2d-5266-48df-a3e7-deccede3e3a2 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1314 microversion: 2.1 time: 0.139592 Sep 14 20:17:37.447848 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1411/2790] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:37 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:38.119622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-0bb2d577-dff3-4b67-9c8b-bfb4c6bb7019 req-4df9c896-9e35-410a-9f75-712d67ff75b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238f3948-f5ba-4a42-9f98-202ec73614b9", "name": "network-vif-plugged", "status": "completed", "tag": "258f37f5-65f7-4f3d-9ab3-2b3040445ba8"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:17:38.121308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:17:38.121308 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:17:38.130226 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-0bb2d577-dff3-4b67-9c8b-bfb4c6bb7019 req-4df9c896-9e35-410a-9f75-712d67ff75b5 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:38.130226 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-0bb2d577-dff3-4b67-9c8b-bfb4c6bb7019 req-4df9c896-9e35-410a-9f75-712d67ff75b5 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:38.139797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-0bb2d577-dff3-4b67-9c8b-bfb4c6bb7019 req-4df9c896-9e35-410a-9f75-712d67ff75b5 service nova] Creating event network-vif-plugged:258f37f5-65f7-4f3d-9ab3-2b3040445ba8 for instance 238f3948-f5ba-4a42-9f98-202ec73614b9 on hv-cinder-80588 Sep 14 20:17:38.145055 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-0bb2d577-dff3-4b67-9c8b-bfb4c6bb7019 req-4df9c896-9e35-410a-9f75-712d67ff75b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029045 Sep 14 20:17:38.145891 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1380/2791] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:17:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:17:38.468410 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-7a24ac9d-d067-4ce6-9a61-de85c3b9e99d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:38.473446 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-7a24ac9d-d067-4ce6-9a61-de85c3b9e99d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:38.480285 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7a24ac9d-d067-4ce6-9a61-de85c3b9e99d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:38.480837 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7a24ac9d-d067-4ce6-9a61-de85c3b9e99d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:38.481728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7a24ac9d-d067-4ce6-9a61-de85c3b9e99d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:38.482798 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-7a24ac9d-d067-4ce6-9a61-de85c3b9e99d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:38.627982 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-7a24ac9d-d067-4ce6-9a61-de85c3b9e99d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:38.635331 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-7a24ac9d-d067-4ce6-9a61-de85c3b9e99d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1314 microversion: 2.1 time: 0.170735 Sep 14 20:17:38.635894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1412/2792] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:38 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:39.657235 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-e43f43bd-2990-4b6f-92cc-b1f3b20a158a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:39.657970 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-e43f43bd-2990-4b6f-92cc-b1f3b20a158a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:39.664115 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e43f43bd-2990-4b6f-92cc-b1f3b20a158a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:39.664635 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e43f43bd-2990-4b6f-92cc-b1f3b20a158a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:39.665427 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e43f43bd-2990-4b6f-92cc-b1f3b20a158a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:39.665997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-e43f43bd-2990-4b6f-92cc-b1f3b20a158a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:39.794367 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-e43f43bd-2990-4b6f-92cc-b1f3b20a158a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:39.801765 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-e43f43bd-2990-4b6f-92cc-b1f3b20a158a tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1314 microversion: 2.1 time: 0.149337 Sep 14 20:17:39.802455 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1381/2793] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:39 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:40.819271 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-68e51dc1-dda5-4aa5-9be0-26fa3c10225d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:40.819896 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-68e51dc1-dda5-4aa5-9be0-26fa3c10225d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:40.826398 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68e51dc1-dda5-4aa5-9be0-26fa3c10225d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:40.826900 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68e51dc1-dda5-4aa5-9be0-26fa3c10225d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:40.827718 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68e51dc1-dda5-4aa5-9be0-26fa3c10225d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:40.828157 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-68e51dc1-dda5-4aa5-9be0-26fa3c10225d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:40.960808 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-68e51dc1-dda5-4aa5-9be0-26fa3c10225d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:40.968862 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-68e51dc1-dda5-4aa5-9be0-26fa3c10225d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1498 microversion: 2.1 time: 0.153232 Sep 14 20:17:40.969431 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1413/2794] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:40 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:41.812290 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-37795db1-9f7e-43a9-acb7-3f0f480271fd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:41.815148 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-37795db1-9f7e-43a9-acb7-3f0f480271fd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:41.818815 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-37795db1-9f7e-43a9-acb7-3f0f480271fd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:41.819264 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-37795db1-9f7e-43a9-acb7-3f0f480271fd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:41.820025 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-37795db1-9f7e-43a9-acb7-3f0f480271fd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:41.820596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-37795db1-9f7e-43a9-acb7-3f0f480271fd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:41.846921 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-37795db1-9f7e-43a9-acb7-3f0f480271fd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Going to try to terminate instance {{(pid=115679) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 20:17:42.123153 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-37795db1-9f7e-43a9-acb7-3f0f480271fd tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "DELETE /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 204 len: 0 microversion: 2.1 time: 0.315135 Sep 14 20:17:42.129861 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1382/2795] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:17:41 2021] DELETE /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:17:42.132576 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-f0477e21-34b6-41cf-801e-bf35a7cd206d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:42.133221 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-f0477e21-34b6-41cf-801e-bf35a7cd206d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:42.138894 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0477e21-34b6-41cf-801e-bf35a7cd206d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:42.139376 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0477e21-34b6-41cf-801e-bf35a7cd206d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:42.140153 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0477e21-34b6-41cf-801e-bf35a7cd206d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:42.140586 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-f0477e21-34b6-41cf-801e-bf35a7cd206d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:42.265707 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-f0477e21-34b6-41cf-801e-bf35a7cd206d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:42.273071 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-f0477e21-34b6-41cf-801e-bf35a7cd206d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1504 microversion: 2.1 time: 0.144324 Sep 14 20:17:42.273686 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1414/2796] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:42 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1504 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:43.290889 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-d91d0f14-091c-40e7-bba2-34a1815712aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:43.291576 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-d91d0f14-091c-40e7-bba2-34a1815712aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:43.297405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d91d0f14-091c-40e7-bba2-34a1815712aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:43.301912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d91d0f14-091c-40e7-bba2-34a1815712aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:43.301912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d91d0f14-091c-40e7-bba2-34a1815712aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:43.301912 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-d91d0f14-091c-40e7-bba2-34a1815712aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:43.422252 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-d91d0f14-091c-40e7-bba2-34a1815712aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:43.428928 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-d91d0f14-091c-40e7-bba2-34a1815712aa tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1504 microversion: 2.1 time: 0.142041 Sep 14 20:17:43.429523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1383/2797] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:43 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1504 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:44.255051 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-9cfa6e1e-10ae-48e3-b955-ddd7416d1c5c req-2f94e16d-aed5-42fe-9ca1-780ea82e2d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238f3948-f5ba-4a42-9f98-202ec73614b9", "name": "network-vif-deleted", "tag": "258f37f5-65f7-4f3d-9ab3-2b3040445ba8"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:17:44.256774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:17:44.256774 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 20:17:44.263744 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-9cfa6e1e-10ae-48e3-b955-ddd7416d1c5c req-2f94e16d-aed5-42fe-9ca1-780ea82e2d79 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:44.264179 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-9cfa6e1e-10ae-48e3-b955-ddd7416d1c5c req-2f94e16d-aed5-42fe-9ca1-780ea82e2d79 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:44.275220 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-9cfa6e1e-10ae-48e3-b955-ddd7416d1c5c req-2f94e16d-aed5-42fe-9ca1-780ea82e2d79 service nova] Creating event network-vif-deleted:258f37f5-65f7-4f3d-9ab3-2b3040445ba8 for instance 238f3948-f5ba-4a42-9f98-202ec73614b9 on hv-cinder-80588 Sep 14 20:17:44.281040 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-9cfa6e1e-10ae-48e3-b955-ddd7416d1c5c req-2f94e16d-aed5-42fe-9ca1-780ea82e2d79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029439 Sep 14 20:17:44.281661 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1415/2798] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:17:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:17:44.446547 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4e69a247-ac0a-42e0-a20a-97a173236b0d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:44.447126 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4e69a247-ac0a-42e0-a20a-97a173236b0d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:44.453184 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e69a247-ac0a-42e0-a20a-97a173236b0d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:44.453736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e69a247-ac0a-42e0-a20a-97a173236b0d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:44.454528 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e69a247-ac0a-42e0-a20a-97a173236b0d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:44.454960 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4e69a247-ac0a-42e0-a20a-97a173236b0d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:44.519172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-4e69a247-ac0a-42e0-a20a-97a173236b0d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74057879f0fd4f11bc7f86d63fa95987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00403620d064739885fdc3605faf0bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:17:44.528997 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4e69a247-ac0a-42e0-a20a-97a173236b0d tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 200 len: 1299 microversion: 2.1 time: 0.086078 Sep 14 20:17:44.529617 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1384/2799] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:44 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:17:45.547794 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-26ca2240-db21-4ab0-8e75-1de64d6f0148 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:17:45.548499 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-26ca2240-db21-4ab0-8e75-1de64d6f0148 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] [instance: 238f3948-f5ba-4a42-9f98-202ec73614b9] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:17:45.554692 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26ca2240-db21-4ab0-8e75-1de64d6f0148 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:45.555141 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26ca2240-db21-4ab0-8e75-1de64d6f0148 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:45.555938 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26ca2240-db21-4ab0-8e75-1de64d6f0148 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:17:45.556380 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-26ca2240-db21-4ab0-8e75-1de64d6f0148 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:17:45.569675 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-26ca2240-db21-4ab0-8e75-1de64d6f0148 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] HTTP exception thrown: Instance 238f3948-f5ba-4a42-9f98-202ec73614b9 could not be found. Sep 14 20:17:45.570283 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-26ca2240-db21-4ab0-8e75-1de64d6f0148 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] Returning 404 to user: Instance 238f3948-f5ba-4a42-9f98-202ec73614b9 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:17:45.571154 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-26ca2240-db21-4ab0-8e75-1de64d6f0148 tempest-VolumesActionsTest-163973081 tempest-VolumesActionsTest-163973081-project] 10.222.0.58 "GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9" status: 404 len: 111 microversion: 2.1 time: 0.028080 Sep 14 20:17:45.571939 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1416/2800] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:17:45 2021] GET /compute/v2.1/servers/238f3948-f5ba-4a42-9f98-202ec73614b9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:19:48.412810 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] AMQP server on 10.222.0.58:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Sep 14 20:19:48.416174 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2cdb1fc2-6a24-4f1f-ac8e-8e1685e6dfd9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:19:48.416661 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2cdb1fc2-6a24-4f1f-ac8e-8e1685e6dfd9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:19:48.423310 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2cdb1fc2-6a24-4f1f-ac8e-8e1685e6dfd9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:19:48.423760 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2cdb1fc2-6a24-4f1f-ac8e-8e1685e6dfd9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:19:48.424520 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2cdb1fc2-6a24-4f1f-ac8e-8e1685e6dfd9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:19:48.424958 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2cdb1fc2-6a24-4f1f-ac8e-8e1685e6dfd9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:19:48.438772 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-2cdb1fc2-6a24-4f1f-ac8e-8e1685e6dfd9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] HTTP exception thrown: Instance 72a26129-f7fb-4755-979a-968cdf0c7d34 could not be found. Sep 14 20:19:48.439382 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2cdb1fc2-6a24-4f1f-ac8e-8e1685e6dfd9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Returning 404 to user: Instance 72a26129-f7fb-4755-979a-968cdf0c7d34 could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:19:48.440340 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2cdb1fc2-6a24-4f1f-ac8e-8e1685e6dfd9 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "DELETE /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 404 len: 111 microversion: 2.1 time: 0.029537 Sep 14 20:19:48.440874 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1385/2801] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:19:48 2021] DELETE /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:19:48.448461 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 20:19:48.451868 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c843e293-22d7-46b9-a666-42cb3a541978 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:19:48.452496 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-c843e293-22d7-46b9-a666-42cb3a541978 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] [instance: 72a26129-f7fb-4755-979a-968cdf0c7d34] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:19:48.458566 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c843e293-22d7-46b9-a666-42cb3a541978 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:19:48.459188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c843e293-22d7-46b9-a666-42cb3a541978 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:19:48.460472 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c843e293-22d7-46b9-a666-42cb3a541978 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:19:48.461190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-c843e293-22d7-46b9-a666-42cb3a541978 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:19:48.482085 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.wsgi [None req-c843e293-22d7-46b9-a666-42cb3a541978 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] HTTP exception thrown: Instance 72a26129-f7fb-4755-979a-968cdf0c7d34 could not be found. Sep 14 20:19:48.483032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-c843e293-22d7-46b9-a666-42cb3a541978 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] Returning 404 to user: Instance 72a26129-f7fb-4755-979a-968cdf0c7d34 could not be found. {{(pid=115678) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:19:48.485002 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-c843e293-22d7-46b9-a666-42cb3a541978 tempest-AttachVolumeShelveTestJSON-1124889405 tempest-AttachVolumeShelveTestJSON-1124889405-project] 10.222.0.58 "GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34" status: 404 len: 111 microversion: 2.1 time: 0.038388 Sep 14 20:19:48.485857 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1417/2802] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:19:48 2021] GET /compute/v2.1/servers/72a26129-f7fb-4755-979a-968cdf0c7d34 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:20:02.722335 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:20:02.722962 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:20:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:20:03.510570 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:20:03.510785 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:20:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:20:04.781588 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:20:04.782145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:20:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:20:20.475004 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:20:20.475842 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:20:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:20:32.860258 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:20:32.860990 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:20:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:20:54.269167 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1938077733", "imageRef": "7aeebae2-e143-4430-a73e-040b865f2806", "flavorRef": "452"}} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:20:54.289688 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2916145-47ad-41b4-9f0f-49af2611ea0b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47098. Sep 14 20:20:54.326255 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.network.neutron [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] validate_networks() for None {{(pid=115679) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 14 20:20:54.642866 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Flavor limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:20:54.643386 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Image limits 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:20:54.643964 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Flavor pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:20:54.644426 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Image pref 0:0:0 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:20:54.644886 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.virt.hardware [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:20:54.655011 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:54.655529 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:54.656380 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:54.656854 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:54.678622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Getting quotas for project 508fb216c3354f98a3ccd1e2519beb1f. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 20:20:54.683677 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.quota [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Getting quotas for user 59e62825d2d0486b859e77ced70e65c9 and project 508fb216c3354f98a3ccd1e2519beb1f. Resources: {'cores', 'ram', 'instances'} {{(pid=115679) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 20:20:54.696911 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Going to run 1 instances... {{(pid=115679) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 14 20:20:54.699384 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7aeebae2-e143-4430-a73e-040b865f2806',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 14 20:20:54.807904 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-4c580742-2a62-4c63-8d73-1b834a849c29 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554915 Sep 14 20:20:54.808838 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1386/2803] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Sep 14 20:20:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:20:54.832520 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ea7e86ca-019c-4eb6-a4fc-97f34890fd2f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:20:54.834008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ea7e86ca-019c-4eb6-a4fc-97f34890fd2f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:20:54.844891 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] [6e08dd42-32e0-4479-9fd5-b14afc34e061] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47112. Sep 14 20:20:54.912116 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ea7e86ca-019c-4eb6-a4fc-97f34890fd2f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:20:54.924182 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ea7e86ca-019c-4eb6-a4fc-97f34890fd2f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1215 microversion: 2.1 time: 0.108264 Sep 14 20:20:54.925224 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1418/2804] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:20:54 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:20:55.945530 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-9ae10400-5136-44ff-be3b-c22f3b4221f6 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:20:55.946186 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-9ae10400-5136-44ff-be3b-c22f3b4221f6 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:20:55.952523 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ae10400-5136-44ff-be3b-c22f3b4221f6 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:55.952968 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ae10400-5136-44ff-be3b-c22f3b4221f6 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:55.953919 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ae10400-5136-44ff-be3b-c22f3b4221f6 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:55.954484 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-9ae10400-5136-44ff-be3b-c22f3b4221f6 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:56.023317 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-9ae10400-5136-44ff-be3b-c22f3b4221f6 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:20:56.030890 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-9ae10400-5136-44ff-be3b-c22f3b4221f6 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1219 microversion: 2.1 time: 0.089813 Sep 14 20:20:56.034057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1387/2805] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:20:55 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:20:57.049149 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-3c8eef96-946c-4df8-a778-6e11ff823837 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:20:57.050441 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-3c8eef96-946c-4df8-a778-6e11ff823837 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:20:57.059008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c8eef96-946c-4df8-a778-6e11ff823837 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:57.059008 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c8eef96-946c-4df8-a778-6e11ff823837 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:57.061145 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c8eef96-946c-4df8-a778-6e11ff823837 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:57.061541 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-3c8eef96-946c-4df8-a778-6e11ff823837 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:57.175105 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-3c8eef96-946c-4df8-a778-6e11ff823837 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:20:57.186657 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-3c8eef96-946c-4df8-a778-6e11ff823837 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1285 microversion: 2.1 time: 0.141456 Sep 14 20:20:57.187414 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1419/2806] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:20:57 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:20:58.215415 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-75dc9831-6c7e-4599-826c-587f2495114e tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:20:58.216031 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-75dc9831-6c7e-4599-826c-587f2495114e tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:20:58.222460 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75dc9831-6c7e-4599-826c-587f2495114e tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:58.223549 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75dc9831-6c7e-4599-826c-587f2495114e tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:58.224297 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75dc9831-6c7e-4599-826c-587f2495114e tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:58.224737 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-75dc9831-6c7e-4599-826c-587f2495114e tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:58.371022 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-75dc9831-6c7e-4599-826c-587f2495114e tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:20:58.382033 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-75dc9831-6c7e-4599-826c-587f2495114e tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1315 microversion: 2.1 time: 0.170181 Sep 14 20:20:58.382673 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1388/2807] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:20:58 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:20:58.992739 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-a548f000-1d72-4f7d-9112-e08e338e6864 req-af093917-8aa9-40e0-ba5e-2de8e7c36c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adc4c0a3-ca85-4e1c-a315-10b1e074f07c", "tag": "803566a2-4e72-4c8f-821d-fc1d7939b4d4"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:20:58.993190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:20:58.993190 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 20:20:59.001581 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-a548f000-1d72-4f7d-9112-e08e338e6864 req-af093917-8aa9-40e0-ba5e-2de8e7c36c9f service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:59.002253 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-a548f000-1d72-4f7d-9112-e08e338e6864 req-af093917-8aa9-40e0-ba5e-2de8e7c36c9f service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:59.016170 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-a548f000-1d72-4f7d-9112-e08e338e6864 req-af093917-8aa9-40e0-ba5e-2de8e7c36c9f service nova] Creating event network-changed:803566a2-4e72-4c8f-821d-fc1d7939b4d4 for instance adc4c0a3-ca85-4e1c-a315-10b1e074f07c on hv-cinder-80588 Sep 14 20:20:59.025815 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-a548f000-1d72-4f7d-9112-e08e338e6864 req-af093917-8aa9-40e0-ba5e-2de8e7c36c9f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043245 Sep 14 20:20:59.027658 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1420/2808] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:20:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:20:59.400275 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-8790f4eb-426d-4c76-a71d-8481a09c0414 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:20:59.400971 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-8790f4eb-426d-4c76-a71d-8481a09c0414 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:20:59.407607 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8790f4eb-426d-4c76-a71d-8481a09c0414 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:59.408051 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8790f4eb-426d-4c76-a71d-8481a09c0414 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:59.408844 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8790f4eb-426d-4c76-a71d-8481a09c0414 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:20:59.410032 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-8790f4eb-426d-4c76-a71d-8481a09c0414 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:20:59.573356 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-8790f4eb-426d-4c76-a71d-8481a09c0414 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:20:59.581063 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-8790f4eb-426d-4c76-a71d-8481a09c0414 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1315 microversion: 2.1 time: 0.184483 Sep 14 20:20:59.581670 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1389/2809] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:20:59 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:21:00.603006 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-6cd5ea60-07f7-4d1c-8132-32d7546f3a56 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:00.603715 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-6cd5ea60-07f7-4d1c-8132-32d7546f3a56 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:00.610175 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd5ea60-07f7-4d1c-8132-32d7546f3a56 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:00.610626 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd5ea60-07f7-4d1c-8132-32d7546f3a56 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:00.611414 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd5ea60-07f7-4d1c-8132-32d7546f3a56 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:00.611858 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-6cd5ea60-07f7-4d1c-8132-32d7546f3a56 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:00.741222 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-6cd5ea60-07f7-4d1c-8132-32d7546f3a56 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:21:00.748947 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-6cd5ea60-07f7-4d1c-8132-32d7546f3a56 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1315 microversion: 2.1 time: 0.149967 Sep 14 20:21:00.749606 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1421/2810] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:00 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:21:01.769212 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-f8feff2c-d607-40fd-98e5-74f222a3156f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:01.769873 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-f8feff2c-d607-40fd-98e5-74f222a3156f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:01.775951 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8feff2c-d607-40fd-98e5-74f222a3156f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:01.776391 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8feff2c-d607-40fd-98e5-74f222a3156f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:01.777172 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8feff2c-d607-40fd-98e5-74f222a3156f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:01.777671 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-f8feff2c-d607-40fd-98e5-74f222a3156f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:01.912202 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-f8feff2c-d607-40fd-98e5-74f222a3156f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:21:01.920253 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-f8feff2c-d607-40fd-98e5-74f222a3156f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1315 microversion: 2.1 time: 0.154912 Sep 14 20:21:01.920849 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1390/2811] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:01 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:21:02.939044 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-ea9c29ec-9160-450f-b645-2ddf948a7277 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:02.939667 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-ea9c29ec-9160-450f-b645-2ddf948a7277 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:02.946690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea9c29ec-9160-450f-b645-2ddf948a7277 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:02.947146 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea9c29ec-9160-450f-b645-2ddf948a7277 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:02.947944 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea9c29ec-9160-450f-b645-2ddf948a7277 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:02.948388 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-ea9c29ec-9160-450f-b645-2ddf948a7277 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:03.080245 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-ea9c29ec-9160-450f-b645-2ddf948a7277 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:21:03.089181 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-ea9c29ec-9160-450f-b645-2ddf948a7277 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1315 microversion: 2.1 time: 0.154448 Sep 14 20:21:03.089860 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1422/2812] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:02 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:21:04.106127 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-dcdeea9b-3fbf-4beb-b933-ddec6aa575d9 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:04.106666 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-dcdeea9b-3fbf-4beb-b933-ddec6aa575d9 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:04.112706 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcdeea9b-3fbf-4beb-b933-ddec6aa575d9 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:04.113159 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcdeea9b-3fbf-4beb-b933-ddec6aa575d9 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:04.113972 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcdeea9b-3fbf-4beb-b933-ddec6aa575d9 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:04.114406 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-dcdeea9b-3fbf-4beb-b933-ddec6aa575d9 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:04.241465 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-dcdeea9b-3fbf-4beb-b933-ddec6aa575d9 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:21:04.249057 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-dcdeea9b-3fbf-4beb-b933-ddec6aa575d9 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1315 microversion: 2.1 time: 0.146718 Sep 14 20:21:04.249680 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1391/2813] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:04 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:21:05.040119 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [req-f4d9b290-fc20-48b0-84e6-7bb44bc56335 req-6c90ef84-67f0-44d1-aaaa-a9a6f064ea79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc4c0a3-ca85-4e1c-a315-10b1e074f07c", "name": "network-vif-plugged", "status": "completed", "tag": "803566a2-4e72-4c8f-821d-fc1d7939b4d4"}]} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:21:05.041690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:21:05.041690 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: warnings.warn(msg) Sep 14 20:21:05.048814 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-f4d9b290-fc20-48b0-84e6-7bb44bc56335 req-6c90ef84-67f0-44d1-aaaa-a9a6f064ea79 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:05.049350 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [req-f4d9b290-fc20-48b0-84e6-7bb44bc56335 req-6c90ef84-67f0-44d1-aaaa-a9a6f064ea79 service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:05.062978 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.compute.server_external_events [req-f4d9b290-fc20-48b0-84e6-7bb44bc56335 req-6c90ef84-67f0-44d1-aaaa-a9a6f064ea79 service nova] Creating event network-vif-plugged:803566a2-4e72-4c8f-821d-fc1d7939b4d4 for instance adc4c0a3-ca85-4e1c-a315-10b1e074f07c on hv-cinder-80588 Sep 14 20:21:05.068382 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [req-f4d9b290-fc20-48b0-84e6-7bb44bc56335 req-6c90ef84-67f0-44d1-aaaa-a9a6f064ea79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032013 Sep 14 20:21:05.069057 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1423/2814] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:21:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:21:05.267133 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-b27fe04d-70e0-4ae7-9620-a1d72ad5d210 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:05.268043 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-b27fe04d-70e0-4ae7-9620-a1d72ad5d210 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:05.274852 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b27fe04d-70e0-4ae7-9620-a1d72ad5d210 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:05.275396 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b27fe04d-70e0-4ae7-9620-a1d72ad5d210 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:05.276211 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b27fe04d-70e0-4ae7-9620-a1d72ad5d210 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:05.276736 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-b27fe04d-70e0-4ae7-9620-a1d72ad5d210 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:05.405624 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-b27fe04d-70e0-4ae7-9620-a1d72ad5d210 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:21:05.413490 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-b27fe04d-70e0-4ae7-9620-a1d72ad5d210 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1315 microversion: 2.1 time: 0.150756 Sep 14 20:21:05.414083 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1392/2815] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:05 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:21:06.430708 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-70d54f21-2924-4f66-acb2-eff7f7be87da tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:06.431412 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-70d54f21-2924-4f66-acb2-eff7f7be87da tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:06.437751 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70d54f21-2924-4f66-acb2-eff7f7be87da tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:06.438269 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70d54f21-2924-4f66-acb2-eff7f7be87da tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:06.439042 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70d54f21-2924-4f66-acb2-eff7f7be87da tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:06.439512 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-70d54f21-2924-4f66-acb2-eff7f7be87da tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:06.565228 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-70d54f21-2924-4f66-acb2-eff7f7be87da tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:21:06.572457 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-70d54f21-2924-4f66-acb2-eff7f7be87da tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1315 microversion: 2.1 time: 0.146598 Sep 14 20:21:06.573266 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1424/2816] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:06 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:21:07.588989 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-876d7c36-79a4-4a1f-b221-893b9289b524 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:07.589622 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-876d7c36-79a4-4a1f-b221-893b9289b524 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:07.595614 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-876d7c36-79a4-4a1f-b221-893b9289b524 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:07.596065 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-876d7c36-79a4-4a1f-b221-893b9289b524 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:07.596832 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-876d7c36-79a4-4a1f-b221-893b9289b524 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:07.597268 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-876d7c36-79a4-4a1f-b221-893b9289b524 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:07.857481 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-876d7c36-79a4-4a1f-b221-893b9289b524 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:21:07.865313 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-876d7c36-79a4-4a1f-b221-893b9289b524 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1464 microversion: 2.1 time: 0.280033 Sep 14 20:21:07.865904 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1393/2817] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:07 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1464 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:21:07.900869 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-5922d43d-05c7-4c10-83d8-22d9d5b80cc8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:07.901404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5922d43d-05c7-4c10-83d8-22d9d5b80cc8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:07.907364 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5922d43d-05c7-4c10-83d8-22d9d5b80cc8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:07.907816 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5922d43d-05c7-4c10-83d8-22d9d5b80cc8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:07.908592 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5922d43d-05c7-4c10-83d8-22d9d5b80cc8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:07.909032 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-5922d43d-05c7-4c10-83d8-22d9d5b80cc8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:07.934704 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-5922d43d-05c7-4c10-83d8-22d9d5b80cc8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Going to try to terminate instance {{(pid=115678) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 14 20:21:08.226078 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-5922d43d-05c7-4c10-83d8-22d9d5b80cc8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "DELETE /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 204 len: 0 microversion: 2.1 time: 0.328404 Sep 14 20:21:08.226671 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1425/2818] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Sep 14 20:21:07 2021] DELETE /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:21:08.234779 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-2a6b20eb-84aa-40a7-b39b-28d22d89495f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:08.236266 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-2a6b20eb-84aa-40a7-b39b-28d22d89495f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:08.241332 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2a6b20eb-84aa-40a7-b39b-28d22d89495f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:08.241821 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2a6b20eb-84aa-40a7-b39b-28d22d89495f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:08.242596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2a6b20eb-84aa-40a7-b39b-28d22d89495f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:08.243028 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-2a6b20eb-84aa-40a7-b39b-28d22d89495f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:08.363833 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.policy [None req-2a6b20eb-84aa-40a7-b39b-28d22d89495f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:21:08.371160 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-2a6b20eb-84aa-40a7-b39b-28d22d89495f tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1470 microversion: 2.1 time: 0.140014 Sep 14 20:21:08.371731 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1394/2819] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:08 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1470 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:21:09.389077 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-14870758-5a8e-4304-a606-3b61dab7338d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:09.389810 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-14870758-5a8e-4304-a606-3b61dab7338d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:09.395738 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14870758-5a8e-4304-a606-3b61dab7338d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:09.396180 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14870758-5a8e-4304-a606-3b61dab7338d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:09.396951 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14870758-5a8e-4304-a606-3b61dab7338d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:09.397404 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-14870758-5a8e-4304-a606-3b61dab7338d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:09.611243 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-14870758-5a8e-4304-a606-3b61dab7338d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:21:09.619728 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-14870758-5a8e-4304-a606-3b61dab7338d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1470 microversion: 2.1 time: 0.234571 Sep 14 20:21:09.620314 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1426/2820] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:09 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:21:10.167819 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [req-0f1bb984-1237-42e3-b2d5-d57010d38cc9 req-edd1d63d-3a88-4e17-be28-25f0f29f4ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc4c0a3-ca85-4e1c-a315-10b1e074f07c", "name": "network-vif-deleted", "tag": "803566a2-4e72-4c8f-821d-fc1d7939b4d4"}]} {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:21:10.169420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 20:21:10.169420 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: warnings.warn(msg) Sep 14 20:21:10.177839 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-0f1bb984-1237-42e3-b2d5-d57010d38cc9 req-edd1d63d-3a88-4e17-be28-25f0f29f4ceb service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:10.178089 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [req-0f1bb984-1237-42e3-b2d5-d57010d38cc9 req-edd1d63d-3a88-4e17-be28-25f0f29f4ceb service nova] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:10.190017 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.compute.server_external_events [req-0f1bb984-1237-42e3-b2d5-d57010d38cc9 req-edd1d63d-3a88-4e17-be28-25f0f29f4ceb service nova] Creating event network-vif-deleted:803566a2-4e72-4c8f-821d-fc1d7939b4d4 for instance adc4c0a3-ca85-4e1c-a315-10b1e074f07c on hv-cinder-80588 Sep 14 20:21:10.196805 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [req-0f1bb984-1237-42e3-b2d5-d57010d38cc9 req-edd1d63d-3a88-4e17-be28-25f0f29f4ceb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094868 Sep 14 20:21:10.197620 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1395/2821] 10.222.0.58 () {64 vars in 1318 bytes} [Tue Sep 14 20:21:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:21:10.637047 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:10.637734 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.compute.api [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115678) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:10.643647 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:10.644102 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:10.644883 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:10.645320 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:10.677231 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:10.677708 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG oslo_concurrency.lockutils [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115678) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:10.678164 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.objects.instance [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lazy-loading 'fault' on Instance uuid adc4c0a3-ca85-4e1c-a315-10b1e074f07c {{(pid=115678) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 14 20:21:10.726958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.policy [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e62825d2d0486b859e77ced70e65c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508fb216c3354f98a3ccd1e2519beb1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115678) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:21:10.726958 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO nova.api.openstack.requestlog [None req-967d2895-73bf-4a5a-8c05-64b370f912c8 tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 200 len: 1305 microversion: 2.1 time: 0.093143 Sep 14 20:21:10.727340 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: [pid: 115678|app: 0|req: 1427/2822] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:10 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:21:11.744026 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-21d89684-0536-4170-8e15-b4036f2e331d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Calling method '>' {{(pid=115679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:21:11.744676 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.compute.api [None req-21d89684-0536-4170-8e15-b4036f2e331d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] [instance: adc4c0a3-ca85-4e1c-a315-10b1e074f07c] Fetching instance by UUID {{(pid=115679) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 14 20:21:11.750965 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21d89684-0536-4170-8e15-b4036f2e331d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:11.751405 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21d89684-0536-4170-8e15-b4036f2e331d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:11.752177 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21d89684-0536-4170-8e15-b4036f2e331d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 14 20:21:11.752610 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG oslo_concurrency.lockutils [None req-21d89684-0536-4170-8e15-b4036f2e331d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Lock "29567de0-b844-4d3a-9dfb-4fa25441a86e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 14 20:21:11.766342 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.wsgi [None req-21d89684-0536-4170-8e15-b4036f2e331d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] HTTP exception thrown: Instance adc4c0a3-ca85-4e1c-a315-10b1e074f07c could not be found. Sep 14 20:21:11.766938 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: DEBUG nova.api.openstack.wsgi [None req-21d89684-0536-4170-8e15-b4036f2e331d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] Returning 404 to user: Instance adc4c0a3-ca85-4e1c-a315-10b1e074f07c could not be found. {{(pid=115679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 14 20:21:11.767770 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO nova.api.openstack.requestlog [None req-21d89684-0536-4170-8e15-b4036f2e331d tempest-VolumesNegativeTest-332253397 tempest-VolumesNegativeTest-332253397-project] 10.222.0.58 "GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c" status: 404 len: 111 microversion: 2.1 time: 0.027954 Sep 14 20:21:11.768316 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: [pid: 115679|app: 0|req: 1396/2823] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Sep 14 20:21:11 2021] GET /compute/v2.1/servers/adc4c0a3-ca85-4e1c-a315-10b1e074f07c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:21:30.986668 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.api.openstack.wsgi [None req-e55f9cab-522e-489b-87ee-0d3f35efca73 tempest-TestVolumeBootPattern-1384002929 tempest-TestVolumeBootPattern-1384002929-project] Action: 'create', calling method: .version_select at 0x7fd0ccaa6b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1987212015"}} {{(pid=115678) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:21:31.005706 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-e55f9cab-522e-489b-87ee-0d3f35efca73 tempest-TestVolumeBootPattern-1384002929 tempest-TestVolumeBootPattern-1384002929-project] Getting quotas for project bab04a3fa15146be8d59aebdaa8c1021. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 14 20:21:31.010555 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: DEBUG nova.quota [None req-e55f9cab-522e-489b-87ee-0d3f35efca73 tempest-TestVolumeBootPattern-1384002929 tempest-TestVolumeBootPattern-1384002929-project] Getting quotas for user 59cbd6551b4345108507ee3a737db17e and project bab04a3fa15146be8d59aebdaa8c1021. Resources: {'key_pairs'} {{(pid=115678) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 14 20:23:22.740412 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:23:22.741009 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:23:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:23:23.532813 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:23:23.533046 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:23:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:23:24.805518 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:23:24.806053 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:23:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.58) !!! Sep 14 20:23:40.493188 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:23:40.493876 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:23:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.58) !!! Sep 14 20:23:52.879488 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:23:52.879941 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:23:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:26:42.758079 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:26:42.758797 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:26:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:26:43.550076 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:26:43.550307 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:26:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 14 20:26:44.825319 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:26:44.825947 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:26:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.58) !!! Sep 14 20:27:00.511235 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:27:00.512524 dv-cinder-805887-12-iscsi devstack@n-api.service[115678]: Tue Sep 14 20:27:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.58) !!! Sep 14 20:27:12.896596 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:27:12.897070 dv-cinder-805887-12-iscsi devstack@n-api.service[115679]: Tue Sep 14 20:27:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!